Jun 02 01:10:41.122230 ip-10-0-135-17 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:10:41.479428 ip-10-0-135-17 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:41.479428 ip-10-0-135-17 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:10:41.479428 ip-10-0-135-17 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:41.479428 ip-10-0-135-17 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:10:41.479428 ip-10-0-135-17 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:41.480132 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.480051 2578 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:10:41.485736 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485715 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:41.485736 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485733 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:41.485736 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485737 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:41.485736 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485740 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485743 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485747 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485750 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485753 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485756 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485758 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485761 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485764 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485767 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485770 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485774 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485777 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485780 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485783 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485786 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485788 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485791 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485794 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485804 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:41.485899 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485807 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485810 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485812 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485815 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485817 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485820 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485822 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485826 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485830 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485833 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485836 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485838 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485841 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485844 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485847 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485851 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485854 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485856 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485858 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:41.486388 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485861 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485864 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485866 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485869 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485871 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485874 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485876 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485879 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485882 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485884 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485887 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485889 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485892 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485895 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485897 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485900 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485902 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485905 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485920 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485923 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:41.486848 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485926 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485928 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485931 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485933 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485936 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485938 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485942 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485945 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485948 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485950 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485953 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485956 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485958 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485961 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485963 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485967 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485971 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485974 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485976 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485979 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:41.487426 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485982 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485984 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485987 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.485990 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486369 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486374 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486377 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486380 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486382 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486385 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486388 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486390 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486394 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486397 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486399 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486403 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486407 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486410 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486413 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:41.487964 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486417 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486419 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486422 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486425 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486428 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486430 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486433 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486436 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486438 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486442 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486444 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486447 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486449 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486452 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486454 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486456 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486459 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486461 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486463 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486466 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:41.488421 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486469 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486472 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486474 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486476 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486480 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486484 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486487 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486489 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486492 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486494 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486497 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486500 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486503 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486506 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486508 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486511 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486514 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486516 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486518 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:41.488903 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486521 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486524 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486526 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486530 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486532 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486534 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486537 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486539 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486543 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486546 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486548 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486551 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486553 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486555 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486558 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486560 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486563 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486566 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486568 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486570 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486573 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:41.489390 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486576 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486578 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486581 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486584 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486588 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486590 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486593 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486595 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486598 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486600 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.486603 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487243 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487253 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487260 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487264 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487269 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487273 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487277 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487284 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487288 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487291 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:10:41.489898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487294 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487298 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487301 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487304 2578 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487307 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487310 2578 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487313 2578 flags.go:64] FLAG: --cloud-config="" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487315 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487318 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487322 2578 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487325 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487329 2578 flags.go:64] FLAG: --config-dir="" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487332 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487335 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487339 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487342 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487345 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487348 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487351 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487354 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487357 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487360 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487363 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487367 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487371 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:10:41.490434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487374 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487377 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487380 2578 flags.go:64] FLAG: --enable-server="true" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487384 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487389 2578 flags.go:64] FLAG: --event-burst="100" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487392 2578 flags.go:64] FLAG: --event-qps="50" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487395 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487399 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487402 2578 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487405 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487408 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487411 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487414 2578 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487417 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487421 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487424 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487427 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487431 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487434 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487437 2578 flags.go:64] FLAG: --feature-gates="" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487442 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487445 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487448 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487451 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487454 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:10:41.491081 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487457 2578 flags.go:64] FLAG: --help="false" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487460 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487463 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487466 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487469 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487473 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487476 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487479 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487482 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487485 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487488 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487491 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487495 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487497 2578 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487500 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487503 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487506 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487509 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487512 2578 flags.go:64] FLAG: --lock-file="" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487514 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487517 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487520 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487526 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:10:41.491690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487528 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487532 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487535 2578 flags.go:64] FLAG: --logging-format="text" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487538 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487541 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487544 2578 flags.go:64] FLAG: --manifest-url="" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487547 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487551 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487554 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487558 2578 flags.go:64] FLAG: --max-pods="110" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487560 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487563 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487566 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487570 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487573 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487576 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487579 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487587 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487590 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487593 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487596 2578 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487599 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487606 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487609 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:10:41.492269 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487612 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487614 2578 flags.go:64] FLAG: --port="10250" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487618 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487620 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-010dd5ad5bf9cd5cd" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487624 2578 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487626 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487629 2578 flags.go:64] FLAG: --register-node="true" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487632 2578 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487635 2578 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487638 2578 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487645 2578 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487648 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487650 2578 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487654 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487658 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487660 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487663 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487666 2578 flags.go:64] FLAG: --runonce="false" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487669 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487672 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487675 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487678 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487681 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487684 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487687 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487691 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:10:41.492890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487694 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487696 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487699 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487703 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487706 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487709 2578 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487712 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487717 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487720 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487723 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487727 2578 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487729 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487732 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487735 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487738 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487741 2578 flags.go:64] FLAG: --v="2" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487746 2578 flags.go:64] FLAG: --version="false" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487750 2578 flags.go:64] FLAG: --vmodule="" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487754 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.487757 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487849 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487853 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487856 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487859 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:41.493536 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487862 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487864 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487867 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487870 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487873 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487875 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487878 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487881 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487883 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487886 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487889 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487891 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487894 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487897 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487900 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487902 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487905 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487921 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487924 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487927 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:41.494348 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487929 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487932 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487934 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487937 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487941 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487944 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487946 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487949 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487952 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487954 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487957 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487959 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487962 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487966 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487970 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487975 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487978 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487981 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487984 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:41.495041 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487987 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487989 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487992 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487994 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487997 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.487999 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488003 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488005 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488008 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488011 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488013 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488016 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488018 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488021 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488023 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488025 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488028 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488032 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488034 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488037 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:41.495853 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488040 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488042 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488045 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488048 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488050 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488053 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488055 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488059 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488063 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488065 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488068 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488070 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488073 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488075 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488078 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488080 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488083 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488085 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488088 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488091 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:41.496728 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488094 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488096 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.488098 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.488756 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.496271 2578 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.496292 2578 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496365 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496374 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496380 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496385 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496391 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496396 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496400 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496405 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496409 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496414 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:41.497648 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496418 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496422 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496426 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496430 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496434 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496438 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496442 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496447 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496451 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496455 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496459 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496463 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496467 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496471 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496475 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496480 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496485 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496489 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496493 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496500 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:41.498145 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496506 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496512 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496516 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496520 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496525 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496530 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496535 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496540 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496544 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496548 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496552 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496557 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496561 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496565 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496569 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496573 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496577 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496581 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496586 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:41.498826 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496590 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496596 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496601 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496605 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496609 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496613 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496617 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496621 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496626 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496630 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496634 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496638 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496643 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496647 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496651 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496655 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496659 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496663 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496668 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:41.499310 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496672 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496676 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496680 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496684 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496688 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496692 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496696 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496700 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496704 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496708 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496712 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496716 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496720 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496724 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496728 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496732 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496736 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:41.500071 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496740 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.496747 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496951 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496962 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496967 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496971 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496976 2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496982 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496986 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496990 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496994 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.496999 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497003 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497008 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497012 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497016 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:41.500662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497020 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497024 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497028 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497034 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497040 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497045 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497049 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497054 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497058 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497062 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497066 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497070 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497075 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497078 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497083 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497087 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497091 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497094 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497098 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:41.501306 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497102 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497106 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497110 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497114 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497119 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497124 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497128 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497132 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497136 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497141 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497145 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497149 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497153 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497158 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497162 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497166 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497170 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497174 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497178 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:41.501787 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497182 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497186 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497190 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497194 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497199 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497203 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497207 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497212 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497216 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497220 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497224 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497228 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497232 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497236 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497240 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497244 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497249 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497253 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497262 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497269 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:41.502374 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497274 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497280 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497285 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497290 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497294 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497299 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497304 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497309 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497314 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497319 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497323 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497327 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497332 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:41.497335 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.497343 2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:41.502902 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.497495 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:10:41.503305 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.501104 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:10:41.503305 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.502026 2578 server.go:1019] "Starting client certificate rotation" Jun 02 01:10:41.503305 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.502131 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:10:41.503305 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.502166 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:10:41.521763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.521736 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:10:41.523621 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.523600 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:10:41.535816 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.535797 2578 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:10:41.541060 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.541044 2578 log.go:25] "Validated CRI v1 image API" Jun 02 01:10:41.542743 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.542723 2578 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:10:41.547455 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.547435 2578 fs.go:135] Filesystem UUIDs: map[193d855d-d10b-4d4a-b010-e947ea9a77a1:/dev/nvme0n1p4 7252c65a-5fad-4876-869f-c907554f650c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 02 01:10:41.547521 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.547454 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:10:41.551025 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.551007 2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:10:41.551702 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.551596 2578 manager.go:217] Machine: {Timestamp:2026-06-02 01:10:41.551104808 +0000 UTC m=+0.332023838 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091436 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212ecfe031f93004a1c7a337402c59 SystemUUID:ec212ecf-e031-f930-04a1-c7a337402c59 BootID:bffcfc7a-91e5-415f-9979-da12639b22ac Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3b:b5:a2:21:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3b:b5:a2:21:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:fc:2d:e8:53:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:10:41.552902 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.552890 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:10:41.553005 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.552993 2578 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:10:41.554512 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.554487 2578 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:10:41.554683 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.554514 2578 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:10:41.554759 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.554696 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:10:41.554759 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.554710 2578 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:10:41.554759 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.554720 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:10:41.555365 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.555353 2578 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:10:41.556635 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.556622 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:10:41.556797 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.556786 2578 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:10:41.558814 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.558803 2578 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:10:41.558871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.558820 2578 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:10:41.558871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.558835 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:10:41.558871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.558848 2578 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:10:41.558871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.558861 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:10:41.559818 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.559805 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:10:41.559882 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.559828 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:10:41.562252 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.562235 2578 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:10:41.564115 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.564100 2578 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:10:41.565642 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565623 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565647 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565657 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565665 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565678 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565687 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565695 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565706 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565716 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:10:41.565729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565724 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:10:41.566144 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565751 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:10:41.566144 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.565761 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:10:41.566442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.566429 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:10:41.566479 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.566447 2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:10:41.569658 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.569602 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z2hfm" Jun 02 01:10:41.571280 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.571266 2578 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:10:41.571357 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.571332 2578 server.go:1295] "Started kubelet" Jun 02 01:10:41.571642 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.571469 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:10:41.571741 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.571459 2578 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:10:41.571741 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.571678 2578 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:10:41.572129 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.572099 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:10:41.572201 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.572134 2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:10:41.572255 ip-10-0-135-17 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:10:41.572349 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.572316 2578 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:10:41.573970 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.573949 2578 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:10:41.574958 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.574936 2578 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:10:41.576881 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.576865 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z2hfm" Jun 02 01:10:41.576993 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.576068 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-17.ec2.internal.18b51e63c63b7313 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-17.ec2.internal,UID:ip-10-0-135-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-17.ec2.internal,},FirstTimestamp:2026-06-02 01:10:41.571279635 +0000 UTC m=+0.352198665,LastTimestamp:2026-06-02 01:10:41.571279635 +0000 UTC m=+0.352198665,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-17.ec2.internal,}" Jun 02 01:10:41.578515 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.578493 2578 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:10:41.580534 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.580517 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:10:41.580966 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.580952 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:10:41.581123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581107 2578 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:10:41.581123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581123 2578 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:10:41.581234 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581159 2578 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:10:41.581291 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581264 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:10:41.581291 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581272 2578 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:10:41.581636 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.581610 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:41.581715 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581674 2578 factory.go:153] Registering CRI-O factory Jun 02 01:10:41.581715 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581688 2578 factory.go:223] Registration of the crio container factory successfully Jun 02 01:10:41.581818 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581753 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:10:41.581818 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581762 2578 factory.go:55] Registering systemd factory Jun 02 01:10:41.581818 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581770 2578 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:10:41.581818 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581786 2578 factory.go:103] Registering Raw factory Jun 02 01:10:41.581818 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.581804 2578 manager.go:1196] Started watching for new ooms in manager Jun 02 01:10:41.582237 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.582220 2578 manager.go:319] Starting recovery of all containers Jun 02 01:10:41.593428 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.591677 2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:41.593428 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.592564 2578 manager.go:324] Recovery completed Jun 02 01:10:41.594116 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.594097 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-17.ec2.internal\" not found" node="ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.597544 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.597531 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:41.599342 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.599327 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:41.599433 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.599352 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:41.599433 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.599363 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:41.599841 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.599826 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:10:41.599841 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.599839 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:10:41.599964 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.599855 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:10:41.602096 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.602082 2578 policy_none.go:49] "None policy: Start" Jun 02 01:10:41.602144 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.602108 2578 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:10:41.602144 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.602118 2578 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:10:41.641594 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.641579 2578 manager.go:341] "Starting Device Plugin manager" Jun 02 01:10:41.641703 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.641615 2578 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:10:41.641703 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.641626 2578 server.go:85] "Starting device plugin registration server" Jun 02 01:10:41.641901 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.641888 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:10:41.642002 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.641902 2578 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:10:41.642066 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.642017 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:10:41.642114 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.642091 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:10:41.642114 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.642100 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:10:41.642795 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.642777 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:10:41.642872 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.642815 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:41.687530 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.687487 2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:10:41.688689 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.688678 2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:10:41.688763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.688696 2578 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:10:41.688763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.688720 2578 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:10:41.688763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.688727 2578 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:10:41.688763 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.688762 2578 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:10:41.692316 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.692298 2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:41.742930 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.742836 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:41.744087 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.744073 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:41.744148 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.744106 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:41.744148 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.744121 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:41.744225 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.744154 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.752770 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.752754 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.752842 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.752776 2578 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-17.ec2.internal\": node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:41.775075 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.775053 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:41.789130 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.789104 2578 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal"] Jun 02 01:10:41.789215 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.789171 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:41.790090 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.790075 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:41.790180 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.790102 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:41.790180 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.790113 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:41.791286 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.791275 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:41.791440 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.791425 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.791489 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.791456 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:41.792037 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.792015 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:41.792126 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.792047 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:41.792126 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.792057 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:41.792126 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.792015 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:41.792126 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.792120 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:41.792262 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.792133 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:41.793123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.793106 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.793123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.793128 2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:41.793798 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.793783 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:41.793879 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.793812 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:41.793879 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.793827 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:41.818579 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.818539 2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-17.ec2.internal\" not found" node="ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.821868 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.821851 2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-17.ec2.internal\" not found" node="ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.875462 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.875417 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:41.883617 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.883594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/faaa2ba4daf8787f5aaaffd3e90a7239-config\") pod \"kube-apiserver-proxy-ip-10-0-135-17.ec2.internal\" (UID: \"faaa2ba4daf8787f5aaaffd3e90a7239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.883742 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.883624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/476469497ad600cf1a7d6783e8ab3860-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal\" (UID: \"476469497ad600cf1a7d6783e8ab3860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.883742 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.883657 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476469497ad600cf1a7d6783e8ab3860-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal\" (UID: \"476469497ad600cf1a7d6783e8ab3860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.975990 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:41.975954 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:41.984343 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.984319 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476469497ad600cf1a7d6783e8ab3860-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal\" (UID: \"476469497ad600cf1a7d6783e8ab3860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.984415 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.984359 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/faaa2ba4daf8787f5aaaffd3e90a7239-config\") pod \"kube-apiserver-proxy-ip-10-0-135-17.ec2.internal\" (UID: \"faaa2ba4daf8787f5aaaffd3e90a7239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.984415 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.984377 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/476469497ad600cf1a7d6783e8ab3860-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal\" (UID: \"476469497ad600cf1a7d6783e8ab3860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.984415 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.984407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476469497ad600cf1a7d6783e8ab3860-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal\" (UID: \"476469497ad600cf1a7d6783e8ab3860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.984510 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.984422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/476469497ad600cf1a7d6783e8ab3860-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal\" (UID: \"476469497ad600cf1a7d6783e8ab3860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:41.984510 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:41.984437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/faaa2ba4daf8787f5aaaffd3e90a7239-config\") pod \"kube-apiserver-proxy-ip-10-0-135-17.ec2.internal\" (UID: \"faaa2ba4daf8787f5aaaffd3e90a7239\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" Jun 02 01:10:42.076788 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.076710 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.121191 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.121165 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:42.125042 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.125025 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" Jun 02 01:10:42.177742 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.177702 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.278220 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.278177 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.378735 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.378649 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.385285 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.385253 2578 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:42.479387 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.479355 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.501793 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.501768 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:10:42.502437 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.501961 2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:10:42.502437 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.501961 2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:10:42.502437 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.501964 2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:10:42.579528 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.579493 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.579528 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.579501 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:05:41 +0000 UTC" deadline="2027-11-20 11:47:12.844613175 +0000 UTC" Jun 02 01:10:42.579528 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.579527 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12874h36m30.265089633s" Jun 02 01:10:42.580708 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.580694 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:10:42.591701 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.591674 2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:10:42.612096 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.612076 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sr288" Jun 02 01:10:42.613184 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:42.613162 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaaa2ba4daf8787f5aaaffd3e90a7239.slice/crio-0f2e2c27eb738c38fc10a6fd33772ff4aa318f910761828f5581470d005173f3 WatchSource:0}: Error finding container 0f2e2c27eb738c38fc10a6fd33772ff4aa318f910761828f5581470d005173f3: Status 404 returned error can't find the container with id 0f2e2c27eb738c38fc10a6fd33772ff4aa318f910761828f5581470d005173f3 Jun 02 01:10:42.613358 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:42.613340 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476469497ad600cf1a7d6783e8ab3860.slice/crio-8240f4db51aacc13bb361126e875e3a644387e91466cc8fcc83075c7ec2612b8 WatchSource:0}: Error finding container 8240f4db51aacc13bb361126e875e3a644387e91466cc8fcc83075c7ec2612b8: Status 404 returned error can't find the container with id 8240f4db51aacc13bb361126e875e3a644387e91466cc8fcc83075c7ec2612b8 Jun 02 01:10:42.616811 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.616789 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:10:42.617193 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.617171 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sr288" Jun 02 01:10:42.680377 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.680292 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.691312 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.691263 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" event={"ID":"476469497ad600cf1a7d6783e8ab3860","Type":"ContainerStarted","Data":"8240f4db51aacc13bb361126e875e3a644387e91466cc8fcc83075c7ec2612b8"} Jun 02 01:10:42.692073 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.692051 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" event={"ID":"faaa2ba4daf8787f5aaaffd3e90a7239","Type":"ContainerStarted","Data":"0f2e2c27eb738c38fc10a6fd33772ff4aa318f910761828f5581470d005173f3"} Jun 02 01:10:42.781320 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.781291 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.881645 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:42.881614 2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-17.ec2.internal\" not found" Jun 02 01:10:42.949480 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.949400 2578 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:42.982127 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.982092 2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" Jun 02 01:10:42.995236 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.994546 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:10:42.995839 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:42.995442 2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" Jun 02 01:10:43.012013 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.011988 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:10:43.559970 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.559935 2578 apiserver.go:52] "Watching apiserver" Jun 02 01:10:43.566881 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.566861 2578 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:10:43.567251 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.567222 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-tnb8j","openshift-multus/multus-xvlp8","openshift-network-diagnostics/network-check-target-n5qxb","openshift-ovn-kubernetes/ovnkube-node-5h6vx","kube-system/konnectivity-agent-z7d9x","kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal","openshift-image-registry/node-ca-c9kf6","openshift-multus/network-metrics-daemon-gtv6j","openshift-network-operator/iptables-alerter-7sqcd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz","openshift-cluster-node-tuning-operator/tuned-9ktsk","openshift-dns/node-resolver-pvvrj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal"] Jun 02 01:10:43.568664 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.568630 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.570648 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.570575 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.570750 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.570661 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:10:43.570813 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.570756 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:10:43.570869 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.570854 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5rgxq\"" Jun 02 01:10:43.571137 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.571120 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:10:43.571694 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.571676 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:43.571774 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:43.571742 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:43.572972 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.572708 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:10:43.572972 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.572835 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.572972 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.572891 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:10:43.573385 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.573341 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:10:43.573489 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.573388 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:10:43.573612 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.573598 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9sq9t\"" Jun 02 01:10:43.574011 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.573994 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:10:43.574143 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.574118 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.575158 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.575137 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:10:43.575255 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.575214 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:10:43.575351 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.575335 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tq24g\"" Jun 02 01:10:43.575411 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.575359 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:10:43.575467 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.575420 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:10:43.575577 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.575559 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:10:43.575663 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.575647 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:10:43.576027 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.576008 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:10:43.576173 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.576152 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l8c6d\"" Jun 02 01:10:43.576359 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.576344 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:10:43.576433 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.576388 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:10:43.576433 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.576398 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:10:43.576537 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.576347 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-57wjp\"" Jun 02 01:10:43.576857 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.576558 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:43.576857 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:43.576643 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:43.579002 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.578982 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.581428 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.581123 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.581428 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.581173 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.581428 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.581301 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w8975\"" Jun 02 01:10:43.581599 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.581444 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:10:43.581758 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.581679 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:10:43.581839 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.581826 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:10:43.582536 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.582520 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.583231 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.583211 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:10:43.583327 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.583239 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:10:43.583386 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.583242 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:10:43.583553 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.583536 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lwqs7\"" Jun 02 01:10:43.583635 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.583578 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:10:43.583635 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.583605 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-drbbs\"" Jun 02 01:10:43.583635 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.583614 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:10:43.584533 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.584514 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:10:43.585070 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.585052 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:10:43.585263 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.585249 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4njkl\"" Jun 02 01:10:43.594380 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xfdt\" (UniqueName: \"kubernetes.io/projected/1fc744de-9f37-42ba-a215-839045bc96ae-kube-api-access-8xfdt\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.594515 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-env-overrides\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.594639 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-var-lib-kubelet\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.594744 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594649 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e278cf9d-46fd-41bb-8daf-c486f570e7e9-konnectivity-ca\") pod \"konnectivity-agent-z7d9x\" (UID: \"e278cf9d-46fd-41bb-8daf-c486f570e7e9\") " pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:10:43.594744 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlpbg\" (UniqueName: \"kubernetes.io/projected/501af48d-d29b-428f-a029-9a0a83619b0b-kube-api-access-hlpbg\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:43.594744 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594698 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-sys-fs\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.594744 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594724 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-log-socket\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.594936 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.594936 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-tuned\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.594936 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd623979-8d64-4e1e-8351-cf78981d04d8-tmp\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.594936 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jfg7\" (UniqueName: \"kubernetes.io/projected/bd623979-8d64-4e1e-8351-cf78981d04d8-kube-api-access-5jfg7\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.594936 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:43.595159 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:43.595159 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594974 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-netns\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.595159 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.594999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-kubelet\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595159 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-systemd\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595159 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-run-ovn-kubernetes\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595159 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-tmp-dir\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.595159 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr8d4\" (UniqueName: \"kubernetes.io/projected/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-kube-api-access-qr8d4\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.595159 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-etc-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-cni-bin\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595185 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw7rk\" (UniqueName: \"kubernetes.io/projected/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-kube-api-access-bw7rk\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysctl-conf\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-lib-modules\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-hosts-file\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0341013e-72f1-43aa-8869-7fcc75f8df43-serviceca\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-os-release\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-ovnkube-config\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595453 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4kbt\" (UniqueName: \"kubernetes.io/projected/a2584c13-0ef1-4aec-ba13-53595473cd95-kube-api-access-v4kbt\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-system-cni-dir\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-device-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-socket-dir-parent\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-cnibin\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-k8s-cni-cncf-io\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-etc-kubernetes\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-run-netns\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-ovn\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysconfig\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-kubernetes\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysctl-d\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-cni-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-hostroot\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595861 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-daemon-config\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0341013e-72f1-43aa-8869-7fcc75f8df43-host\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.595940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-cni-binary-copy\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-conf-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.595991 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-var-lib-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-registration-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-slash\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-system-cni-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-systemd-units\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-node-log\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6sc5\" (UniqueName: \"kubernetes.io/projected/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-kube-api-access-k6sc5\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-cnibin\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-ovnkube-script-lib\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-sys\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-host\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-os-release\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-modprobe-d\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-run\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-cni-bin\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.596620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-cni-multus\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-kubelet\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-iptables-alerter-script\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-socket-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlv9v\" (UniqueName: \"kubernetes.io/projected/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-kube-api-access-jlv9v\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-multus-certs\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2584c13-0ef1-4aec-ba13-53595473cd95-ovn-node-metrics-cert\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-systemd\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fq62\" (UniqueName: \"kubernetes.io/projected/0341013e-72f1-43aa-8869-7fcc75f8df43-kube-api-access-4fq62\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-cni-netd\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-host-slash\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.597364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.596797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e278cf9d-46fd-41bb-8daf-c486f570e7e9-agent-certs\") pod \"konnectivity-agent-z7d9x\" (UID: \"e278cf9d-46fd-41bb-8daf-c486f570e7e9\") " pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:10:43.617830 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.617807 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:05:42 +0000 UTC" deadline="2028-01-21 08:05:58.795966461 +0000 UTC" Jun 02 01:10:43.617830 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.617829 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14358h55m15.178139867s" Jun 02 01:10:43.682170 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.682140 2578 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:10:43.697026 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.696998 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-system-cni-dir\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.697026 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697032 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697049 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-device-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697065 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-socket-dir-parent\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-system-cni-dir\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-socket-dir-parent\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697157 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-cnibin\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-device-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697181 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-k8s-cni-cncf-io\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697204 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-etc-kubernetes\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697209 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-cnibin\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697225 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-run-netns\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-k8s-cni-cncf-io\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697247 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-ovn\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697272 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysconfig\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-run-netns\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697295 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-kubernetes\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697319 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysctl-d\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697325 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-ovn\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697343 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-cni-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-kubernetes\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysconfig\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697365 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-hostroot\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697406 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-daemon-config\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-hostroot\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697417 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-cni-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697434 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0341013e-72f1-43aa-8869-7fcc75f8df43-host\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysctl-d\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.697499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697458 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-cni-binary-copy\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697481 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-conf-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0341013e-72f1-43aa-8869-7fcc75f8df43-host\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697521 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-conf-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697551 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-var-lib-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697576 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-registration-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697599 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-slash\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-var-lib-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697622 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-system-cni-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697462 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-etc-kubernetes\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697644 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-registration-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697701 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-system-cni-dir\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697704 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-slash\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-systemd-units\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697648 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-systemd-units\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697795 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-node-log\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697822 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6sc5\" (UniqueName: \"kubernetes.io/projected/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-kube-api-access-k6sc5\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.698284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697850 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-cnibin\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-node-log\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697875 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-ovnkube-script-lib\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697899 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-sys\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697940 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-host\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697958 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-multus-daemon-config\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697965 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-os-release\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.697998 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-modprobe-d\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698026 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-cni-binary-copy\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698026 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-run\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-os-release\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698068 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-cni-bin\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-host\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698079 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-sys\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698106 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-cni-multus\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-cni-bin\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698124 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-cnibin\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-cni-multus\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698139 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-kubelet\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698162 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-run\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698184 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-iptables-alerter-script\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-var-lib-kubelet\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-modprobe-d\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698210 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-socket-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698236 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlv9v\" (UniqueName: \"kubernetes.io/projected/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-kube-api-access-jlv9v\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698260 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-multus-certs\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698296 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-socket-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698302 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2584c13-0ef1-4aec-ba13-53595473cd95-ovn-node-metrics-cert\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-multus-certs\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698325 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-systemd\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698378 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fq62\" (UniqueName: \"kubernetes.io/projected/0341013e-72f1-43aa-8869-7fcc75f8df43-kube-api-access-4fq62\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698391 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-systemd\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698409 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.699874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698434 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698455 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-ovnkube-script-lib\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698463 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698565 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698593 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-cni-netd\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698627 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-host-slash\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698644 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698656 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e278cf9d-46fd-41bb-8daf-c486f570e7e9-agent-certs\") pod \"konnectivity-agent-z7d9x\" (UID: \"e278cf9d-46fd-41bb-8daf-c486f570e7e9\") " pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-cni-netd\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698639 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-iptables-alerter-script\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698685 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xfdt\" (UniqueName: \"kubernetes.io/projected/1fc744de-9f37-42ba-a215-839045bc96ae-kube-api-access-8xfdt\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698686 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-host-slash\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698755 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-env-overrides\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698787 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-var-lib-kubelet\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698813 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e278cf9d-46fd-41bb-8daf-c486f570e7e9-konnectivity-ca\") pod \"konnectivity-agent-z7d9x\" (UID: \"e278cf9d-46fd-41bb-8daf-c486f570e7e9\") " pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:10:43.700646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698839 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlpbg\" (UniqueName: \"kubernetes.io/projected/501af48d-d29b-428f-a029-9a0a83619b0b-kube-api-access-hlpbg\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698863 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-sys-fs\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698885 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-var-lib-kubelet\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698950 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-log-socket\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698888 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-log-socket\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698990 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.698995 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-sys-fs\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699049 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-tuned\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699075 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd623979-8d64-4e1e-8351-cf78981d04d8-tmp\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699105 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jfg7\" (UniqueName: \"kubernetes.io/projected/bd623979-8d64-4e1e-8351-cf78981d04d8-kube-api-access-5jfg7\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-env-overrides\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699135 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699162 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699186 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-netns\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699210 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-kubelet\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.701442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699233 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-systemd\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699262 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-run-ovn-kubernetes\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699286 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-tmp-dir\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699311 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr8d4\" (UniqueName: \"kubernetes.io/projected/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-kube-api-access-qr8d4\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699336 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-etc-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-kubelet\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699360 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-cni-bin\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699385 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bw7rk\" (UniqueName: \"kubernetes.io/projected/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-kube-api-access-bw7rk\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699410 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysctl-conf\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699434 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-lib-modules\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699437 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e278cf9d-46fd-41bb-8daf-c486f570e7e9-konnectivity-ca\") pod \"konnectivity-agent-z7d9x\" (UID: \"e278cf9d-46fd-41bb-8daf-c486f570e7e9\") " pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699458 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-hosts-file\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699483 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0341013e-72f1-43aa-8869-7fcc75f8df43-serviceca\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699506 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-os-release\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:43.699528 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-host-run-netns\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699554 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699590 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-ovnkube-config\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702277 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-run-systemd\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:43.699629 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs podName:501af48d-d29b-428f-a029-9a0a83619b0b nodeName:}" failed. No retries permitted until 2026-06-02 01:10:44.199583899 +0000 UTC m=+2.980502933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs") pod "network-metrics-daemon-gtv6j" (UID: "501af48d-d29b-428f-a029-9a0a83619b0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699638 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-run-ovn-kubernetes\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699810 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4kbt\" (UniqueName: \"kubernetes.io/projected/a2584c13-0ef1-4aec-ba13-53595473cd95-kube-api-access-v4kbt\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-tmp-dir\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.699978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-etc-openvswitch\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.700006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-hosts-file\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.700052 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2584c13-0ef1-4aec-ba13-53595473cd95-ovnkube-config\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.700093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-os-release\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.700094 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-lib-modules\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.700115 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-sysctl-conf\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.700152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2584c13-0ef1-4aec-ba13-53595473cd95-host-cni-bin\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.700168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fc744de-9f37-42ba-a215-839045bc96ae-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.700522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fc744de-9f37-42ba-a215-839045bc96ae-cni-binary-copy\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.701074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0341013e-72f1-43aa-8869-7fcc75f8df43-serviceca\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.701925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd623979-8d64-4e1e-8351-cf78981d04d8-etc-tuned\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.702159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e278cf9d-46fd-41bb-8daf-c486f570e7e9-agent-certs\") pod \"konnectivity-agent-z7d9x\" (UID: \"e278cf9d-46fd-41bb-8daf-c486f570e7e9\") " pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:10:43.702871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.702429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd623979-8d64-4e1e-8351-cf78981d04d8-tmp\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.703477 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.702726 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2584c13-0ef1-4aec-ba13-53595473cd95-ovn-node-metrics-cert\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.705398 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.705341 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6sc5\" (UniqueName: \"kubernetes.io/projected/a7db0dfa-6fe7-42e4-92a8-ebb431d579ee-kube-api-access-k6sc5\") pod \"node-resolver-pvvrj\" (UID: \"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee\") " pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.705970 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.705899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlv9v\" (UniqueName: \"kubernetes.io/projected/0bc8d00b-c07b-412b-9479-bfc1f52e2cf5-kube-api-access-jlv9v\") pod \"aws-ebs-csi-driver-node-bqtjz\" (UID: \"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.706750 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.706732 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fq62\" (UniqueName: \"kubernetes.io/projected/0341013e-72f1-43aa-8869-7fcc75f8df43-kube-api-access-4fq62\") pod \"node-ca-c9kf6\" (UID: \"0341013e-72f1-43aa-8869-7fcc75f8df43\") " pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.710599 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:43.710582 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:43.710700 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:43.710602 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:43.710700 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:43.710615 2578 projected.go:194] Error preparing data for projected volume kube-api-access-zc7nb for pod openshift-network-diagnostics/network-check-target-n5qxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:43.710700 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:43.710692 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb podName:f9738c4d-db83-4b44-9cf5-7df1118311f6 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:44.210668138 +0000 UTC m=+2.991587171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zc7nb" (UniqueName: "kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb") pod "network-check-target-n5qxb" (UID: "f9738c4d-db83-4b44-9cf5-7df1118311f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:43.713035 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.712987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr8d4\" (UniqueName: \"kubernetes.io/projected/ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92-kube-api-access-qr8d4\") pod \"multus-xvlp8\" (UID: \"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92\") " pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.713220 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.713198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw7rk\" (UniqueName: \"kubernetes.io/projected/1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2-kube-api-access-bw7rk\") pod \"iptables-alerter-7sqcd\" (UID: \"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2\") " pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.713298 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.713258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlpbg\" (UniqueName: \"kubernetes.io/projected/501af48d-d29b-428f-a029-9a0a83619b0b-kube-api-access-hlpbg\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:43.713421 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.713400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4kbt\" (UniqueName: \"kubernetes.io/projected/a2584c13-0ef1-4aec-ba13-53595473cd95-kube-api-access-v4kbt\") pod \"ovnkube-node-5h6vx\" (UID: \"a2584c13-0ef1-4aec-ba13-53595473cd95\") " pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.713498 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.713446 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jfg7\" (UniqueName: \"kubernetes.io/projected/bd623979-8d64-4e1e-8351-cf78981d04d8-kube-api-access-5jfg7\") pod \"tuned-9ktsk\" (UID: \"bd623979-8d64-4e1e-8351-cf78981d04d8\") " pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.713933 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.713896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xfdt\" (UniqueName: \"kubernetes.io/projected/1fc744de-9f37-42ba-a215-839045bc96ae-kube-api-access-8xfdt\") pod \"multus-additional-cni-plugins-tnb8j\" (UID: \"1fc744de-9f37-42ba-a215-839045bc96ae\") " pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.881497 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.881427 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c9kf6" Jun 02 01:10:43.890353 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.890331 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:10:43.897849 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.897826 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xvlp8" Jun 02 01:10:43.903613 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.903593 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:10:43.910172 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.910156 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" Jun 02 01:10:43.915654 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.915636 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" Jun 02 01:10:43.923175 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.923160 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7sqcd" Jun 02 01:10:43.928662 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.928645 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" Jun 02 01:10:43.932147 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.932130 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pvvrj" Jun 02 01:10:43.972732 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.972710 2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:43.995647 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:43.995617 2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:44.197155 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:44.197125 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7db0dfa_6fe7_42e4_92a8_ebb431d579ee.slice/crio-aeeee95b8527ca7a08d43ae20982e4844a284fd6757122872676e08a60c111cd WatchSource:0}: Error finding container aeeee95b8527ca7a08d43ae20982e4844a284fd6757122872676e08a60c111cd: Status 404 returned error can't find the container with id aeeee95b8527ca7a08d43ae20982e4844a284fd6757122872676e08a60c111cd Jun 02 01:10:44.197878 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:44.197843 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9a2d6f_d80f_4d2b_9f6b_67ff1bfbff92.slice/crio-f1cf3a442cdb4704e87232bddb4bced9b73f87c94e63ad0394ac239fbf66b17b WatchSource:0}: Error finding container f1cf3a442cdb4704e87232bddb4bced9b73f87c94e63ad0394ac239fbf66b17b: Status 404 returned error can't find the container with id f1cf3a442cdb4704e87232bddb4bced9b73f87c94e63ad0394ac239fbf66b17b Jun 02 01:10:44.198988 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:10:44.198965 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd623979_8d64_4e1e_8351_cf78981d04d8.slice/crio-9aa215d61e29956afd2a90374b3cd7489a4123a728cf80eba4b9658ee8ecc69e WatchSource:0}: Error finding container 9aa215d61e29956afd2a90374b3cd7489a4123a728cf80eba4b9658ee8ecc69e: Status 404 returned error can't find the container with id 9aa215d61e29956afd2a90374b3cd7489a4123a728cf80eba4b9658ee8ecc69e Jun 02 01:10:44.203319 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.203291 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:44.203476 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:44.203457 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:44.203545 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:44.203530 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs podName:501af48d-d29b-428f-a029-9a0a83619b0b nodeName:}" failed. No retries permitted until 2026-06-02 01:10:45.20351081 +0000 UTC m=+3.984430121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs") pod "network-metrics-daemon-gtv6j" (UID: "501af48d-d29b-428f-a029-9a0a83619b0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:44.252420 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.252395 2578 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:44.303614 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.303572 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:44.303755 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:44.303727 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:44.303755 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:44.303748 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:44.303860 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:44.303759 2578 projected.go:194] Error preparing data for projected volume kube-api-access-zc7nb for pod openshift-network-diagnostics/network-check-target-n5qxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:44.303860 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:44.303805 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb podName:f9738c4d-db83-4b44-9cf5-7df1118311f6 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:45.303790636 +0000 UTC m=+4.084709671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zc7nb" (UniqueName: "kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb") pod "network-check-target-n5qxb" (UID: "f9738c4d-db83-4b44-9cf5-7df1118311f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:44.618895 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.618777 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:05:42 +0000 UTC" deadline="2028-03-17 08:50:16.166128306 +0000 UTC" Jun 02 01:10:44.618895 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.618813 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15703h39m31.547318933s" Jun 02 01:10:44.690069 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.689438 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:44.690069 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:44.689564 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:44.690503 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.690352 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:44.690503 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:44.690467 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:44.710840 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.710802 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7sqcd" event={"ID":"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2","Type":"ContainerStarted","Data":"8c51bbac37f47741687911893cf6424f1acd230d92aa42363ff954bd0613f9c4"} Jun 02 01:10:44.712932 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.712859 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xvlp8" event={"ID":"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92","Type":"ContainerStarted","Data":"f1cf3a442cdb4704e87232bddb4bced9b73f87c94e63ad0394ac239fbf66b17b"} Jun 02 01:10:44.715878 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.715855 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" event={"ID":"1fc744de-9f37-42ba-a215-839045bc96ae","Type":"ContainerStarted","Data":"d3a6adf0c2c7c352e91265248d4e40c1566caa58dc13bb0ee150717cec83a1ed"} Jun 02 01:10:44.717762 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.717712 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" event={"ID":"bd623979-8d64-4e1e-8351-cf78981d04d8","Type":"ContainerStarted","Data":"9aa215d61e29956afd2a90374b3cd7489a4123a728cf80eba4b9658ee8ecc69e"} Jun 02 01:10:44.728985 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.728924 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pvvrj" event={"ID":"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee","Type":"ContainerStarted","Data":"aeeee95b8527ca7a08d43ae20982e4844a284fd6757122872676e08a60c111cd"} Jun 02 01:10:44.734755 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.734725 2578 generic.go:358] "Generic (PLEG): container finished" podID="476469497ad600cf1a7d6783e8ab3860" containerID="0cbce85dc465353d67b040b3f92924dff582ee9d25b2e693336b964cdc3d64c6" exitCode=0 Jun 02 01:10:44.734863 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.734806 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" event={"ID":"476469497ad600cf1a7d6783e8ab3860","Type":"ContainerDied","Data":"0cbce85dc465353d67b040b3f92924dff582ee9d25b2e693336b964cdc3d64c6"} Jun 02 01:10:44.741880 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.741476 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" event={"ID":"faaa2ba4daf8787f5aaaffd3e90a7239","Type":"ContainerStarted","Data":"333d9a04722f73fa67bc6b56b6cf50b0b9f8b20a472baadb3b33d59ba92fd783"} Jun 02 01:10:44.747094 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.747044 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" event={"ID":"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5","Type":"ContainerStarted","Data":"cd1bcd0cec92ecf169990fb64969c851ea3735c3d731083120329ec39aef4071"} Jun 02 01:10:44.752697 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.752636 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"9ff59f65125f031bc44e32f852f050bca7ae4154f47ee3edd1e82712ae032ce9"} Jun 02 01:10:44.754893 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.754836 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c9kf6" event={"ID":"0341013e-72f1-43aa-8869-7fcc75f8df43","Type":"ContainerStarted","Data":"d08b75546a438976d379b0a1cc9fbe1b5b3d9fd543fea0a35abfe1fdef720e88"} Jun 02 01:10:44.764559 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:44.764521 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z7d9x" event={"ID":"e278cf9d-46fd-41bb-8daf-c486f570e7e9","Type":"ContainerStarted","Data":"5a26a5a6bb05b51ee38effb1f1415609dd49790be529f3ce33440511551dbf5b"} Jun 02 01:10:45.210403 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:45.209819 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:45.210403 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:45.210001 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:45.210403 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:45.210066 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs podName:501af48d-d29b-428f-a029-9a0a83619b0b nodeName:}" failed. No retries permitted until 2026-06-02 01:10:47.210047826 +0000 UTC m=+5.990966863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs") pod "network-metrics-daemon-gtv6j" (UID: "501af48d-d29b-428f-a029-9a0a83619b0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:45.310207 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:45.310164 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:45.310387 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:45.310368 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:45.310464 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:45.310394 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:45.310464 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:45.310407 2578 projected.go:194] Error preparing data for projected volume kube-api-access-zc7nb for pod openshift-network-diagnostics/network-check-target-n5qxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:45.310570 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:45.310464 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb podName:f9738c4d-db83-4b44-9cf5-7df1118311f6 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:47.31044602 +0000 UTC m=+6.091365060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zc7nb" (UniqueName: "kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb") pod "network-check-target-n5qxb" (UID: "f9738c4d-db83-4b44-9cf5-7df1118311f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:45.771025 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:45.770991 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" event={"ID":"476469497ad600cf1a7d6783e8ab3860","Type":"ContainerStarted","Data":"3ae46b9dda87168d2ac1aab7189109e0e9b4c5ee1d1addb62452ab44794616c0"} Jun 02 01:10:45.788938 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:45.788372 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-17.ec2.internal" podStartSLOduration=3.788353272 podStartE2EDuration="3.788353272s" podCreationTimestamp="2026-06-02 01:10:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:10:44.762398462 +0000 UTC m=+3.543317502" watchObservedRunningTime="2026-06-02 01:10:45.788353272 +0000 UTC m=+4.569272314" Jun 02 01:10:46.689696 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:46.689656 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:46.689868 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:46.689810 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:46.690248 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:46.690230 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:46.690368 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:46.690342 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:47.223770 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:47.223719 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:47.224273 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:47.223890 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:47.224273 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:47.223980 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs podName:501af48d-d29b-428f-a029-9a0a83619b0b nodeName:}" failed. No retries permitted until 2026-06-02 01:10:51.223960812 +0000 UTC m=+10.004879830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs") pod "network-metrics-daemon-gtv6j" (UID: "501af48d-d29b-428f-a029-9a0a83619b0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:47.324658 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:47.324607 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:47.324865 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:47.324832 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:47.324865 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:47.324854 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:47.324865 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:47.324868 2578 projected.go:194] Error preparing data for projected volume kube-api-access-zc7nb for pod openshift-network-diagnostics/network-check-target-n5qxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:47.325178 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:47.325161 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb podName:f9738c4d-db83-4b44-9cf5-7df1118311f6 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:51.325133398 +0000 UTC m=+10.106052430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zc7nb" (UniqueName: "kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb") pod "network-check-target-n5qxb" (UID: "f9738c4d-db83-4b44-9cf5-7df1118311f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:48.690279 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:48.689815 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:48.690279 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:48.689887 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:48.690279 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:48.690012 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:48.690279 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:48.690122 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:50.689638 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:50.689605 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:50.690078 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:50.689722 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:50.690078 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:50.689773 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:50.690078 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:50.689867 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:51.256889 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:51.256846 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:51.257095 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:51.257006 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:51.257095 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:51.257094 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs podName:501af48d-d29b-428f-a029-9a0a83619b0b nodeName:}" failed. No retries permitted until 2026-06-02 01:10:59.257070511 +0000 UTC m=+18.037989547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs") pod "network-metrics-daemon-gtv6j" (UID: "501af48d-d29b-428f-a029-9a0a83619b0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:51.357495 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:51.357454 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:51.357685 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:51.357590 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:51.357685 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:51.357610 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:51.357685 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:51.357624 2578 projected.go:194] Error preparing data for projected volume kube-api-access-zc7nb for pod openshift-network-diagnostics/network-check-target-n5qxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:51.357685 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:51.357685 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb podName:f9738c4d-db83-4b44-9cf5-7df1118311f6 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:59.357669314 +0000 UTC m=+18.138588331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zc7nb" (UniqueName: "kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb") pod "network-check-target-n5qxb" (UID: "f9738c4d-db83-4b44-9cf5-7df1118311f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:52.689113 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:52.689053 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:52.689113 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:52.689078 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:52.689683 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:52.689195 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:52.689683 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:52.689282 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:54.689378 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:54.689308 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:54.689781 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:54.689317 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:54.689781 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:54.689402 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:54.689781 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:54.689501 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:56.574007 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.573947 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-17.ec2.internal" podStartSLOduration=14.573932341 podStartE2EDuration="14.573932341s" podCreationTimestamp="2026-06-02 01:10:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:10:45.788674345 +0000 UTC m=+4.569593385" watchObservedRunningTime="2026-06-02 01:10:56.573932341 +0000 UTC m=+15.354851381" Jun 02 01:10:56.574468 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.574435 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q77t7"] Jun 02 01:10:56.577410 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.577386 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.577510 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:56.577450 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:10:56.689582 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.689551 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:56.689741 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.689555 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:56.689741 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:56.689685 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:56.689741 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:56.689729 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:56.698344 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.698308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9953c519-40ab-4a49-91f9-d25e41679017-dbus\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.698451 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.698405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9953c519-40ab-4a49-91f9-d25e41679017-kubelet-config\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.698451 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.698437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.799754 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.799722 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9953c519-40ab-4a49-91f9-d25e41679017-dbus\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.799972 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.799809 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9953c519-40ab-4a49-91f9-d25e41679017-kubelet-config\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.799972 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.799843 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.800089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.799967 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9953c519-40ab-4a49-91f9-d25e41679017-kubelet-config\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.800089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:56.799948 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9953c519-40ab-4a49-91f9-d25e41679017-dbus\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:56.800745 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:56.799998 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:56.800845 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:56.800816 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret podName:9953c519-40ab-4a49-91f9-d25e41679017 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:57.300793318 +0000 UTC m=+16.081712343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret") pod "global-pull-secret-syncer-q77t7" (UID: "9953c519-40ab-4a49-91f9-d25e41679017") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:57.303714 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:57.303659 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:57.303929 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:57.303831 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:57.303989 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:57.303942 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret podName:9953c519-40ab-4a49-91f9-d25e41679017 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:58.303903732 +0000 UTC m=+17.084822755 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret") pod "global-pull-secret-syncer-q77t7" (UID: "9953c519-40ab-4a49-91f9-d25e41679017") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:58.311258 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:58.311222 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:58.311699 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:58.311398 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:58.311699 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:58.311475 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret podName:9953c519-40ab-4a49-91f9-d25e41679017 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:00.311454986 +0000 UTC m=+19.092374016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret") pod "global-pull-secret-syncer-q77t7" (UID: "9953c519-40ab-4a49-91f9-d25e41679017") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:58.689586 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:58.689506 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:58.689737 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:58.689505 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:58.689737 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:58.689626 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:10:58.689737 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:58.689711 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:10:58.689737 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:58.689506 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:10:58.689958 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:58.689806 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:10:59.317414 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:59.317371 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:10:59.317977 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:59.317520 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:59.317977 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:59.317601 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs podName:501af48d-d29b-428f-a029-9a0a83619b0b nodeName:}" failed. No retries permitted until 2026-06-02 01:11:15.317578818 +0000 UTC m=+34.098497839 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs") pod "network-metrics-daemon-gtv6j" (UID: "501af48d-d29b-428f-a029-9a0a83619b0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:59.417835 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:10:59.417790 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:10:59.418033 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:59.418004 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:59.418033 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:59.418037 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:59.418188 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:59.418051 2578 projected.go:194] Error preparing data for projected volume kube-api-access-zc7nb for pod openshift-network-diagnostics/network-check-target-n5qxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:59.418188 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:10:59.418118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb podName:f9738c4d-db83-4b44-9cf5-7df1118311f6 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:15.418099924 +0000 UTC m=+34.199018949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zc7nb" (UniqueName: "kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb") pod "network-check-target-n5qxb" (UID: "f9738c4d-db83-4b44-9cf5-7df1118311f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:00.324749 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:00.324713 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:00.325184 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:00.324836 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:11:00.325184 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:00.324899 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret podName:9953c519-40ab-4a49-91f9-d25e41679017 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:04.324880115 +0000 UTC m=+23.105799136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret") pod "global-pull-secret-syncer-q77t7" (UID: "9953c519-40ab-4a49-91f9-d25e41679017") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:11:00.689722 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:00.689648 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:00.689868 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:00.689648 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:00.689868 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:00.689791 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:00.689868 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:00.689648 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:00.689868 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:00.689843 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:00.690128 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:00.689960 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:02.689883 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.689767 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:02.690389 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.689770 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:02.690389 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.689769 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:02.690389 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:02.689999 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:02.690389 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:02.690066 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:02.690389 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:02.690140 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:02.804695 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.804666 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" event={"ID":"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5","Type":"ContainerStarted","Data":"0fb489eebb895185a54e4de8c9eaaa7cd7af6055dbca8ac6c45fa88f45244442"} Jun 02 01:11:02.806434 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.806418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:11:02.806741 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.806722 2578 generic.go:358] "Generic (PLEG): container finished" podID="a2584c13-0ef1-4aec-ba13-53595473cd95" containerID="16f95be996ee7148bb0a09b6d4d3f54aec13f47d8e8bda899686ceee79306be2" exitCode=1 Jun 02 01:11:02.806797 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.806777 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"30945df92cc8ba266bac92df29349ae85fbdc459c4ff4e3cd40bf26a4041af66"} Jun 02 01:11:02.806797 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.806794 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"077d151ac28da2d5461b62bc94288db397a78c0719e9a4510c0d1206948dc72c"} Jun 02 01:11:02.806903 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.806805 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerDied","Data":"16f95be996ee7148bb0a09b6d4d3f54aec13f47d8e8bda899686ceee79306be2"} Jun 02 01:11:02.806903 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.806816 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"b16c1e5af96ecc9bae4797abe68a85581e3d01a0a3bb44e972a00cd567d9775b"} Jun 02 01:11:02.807817 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.807797 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c9kf6" event={"ID":"0341013e-72f1-43aa-8869-7fcc75f8df43","Type":"ContainerStarted","Data":"285c2d0cb82419f769a4f9cf3f3e8c0b49b69fb683b4b48f233a9db98d54a075"} Jun 02 01:11:02.808855 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.808835 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z7d9x" event={"ID":"e278cf9d-46fd-41bb-8daf-c486f570e7e9","Type":"ContainerStarted","Data":"f0ac030df7e5f50d03b96950be5c4bef5d46923f0683a1f5431f51ead3b1a20d"} Jun 02 01:11:02.809898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.809882 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xvlp8" event={"ID":"ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92","Type":"ContainerStarted","Data":"a90decbd1f47401b6109f82161ecbe57060a6a169c4304f0b7da069f9218cf63"} Jun 02 01:11:02.811103 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.811081 2578 generic.go:358] "Generic (PLEG): container finished" podID="1fc744de-9f37-42ba-a215-839045bc96ae" containerID="f4d1d07c677f63b3f459172f1c31296e6ecc6bef3c6e9a6d8a44161fd29bad9f" exitCode=0 Jun 02 01:11:02.811180 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.811148 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" event={"ID":"1fc744de-9f37-42ba-a215-839045bc96ae","Type":"ContainerDied","Data":"f4d1d07c677f63b3f459172f1c31296e6ecc6bef3c6e9a6d8a44161fd29bad9f"} Jun 02 01:11:02.812457 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.812393 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" event={"ID":"bd623979-8d64-4e1e-8351-cf78981d04d8","Type":"ContainerStarted","Data":"df44dcde40cf01c7f85374e522527c10e40f80566e0f898fdf7ec0154b70fbea"} Jun 02 01:11:02.813477 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.813455 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pvvrj" event={"ID":"a7db0dfa-6fe7-42e4-92a8-ebb431d579ee","Type":"ContainerStarted","Data":"495e506bcc103100d6c00c6c90e34e4f996ffcb2f8154418886fe79ac0f5040a"} Jun 02 01:11:02.820708 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.820663 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c9kf6" podStartSLOduration=8.459763681 podStartE2EDuration="21.820651461s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.214543377 +0000 UTC m=+2.995462395" lastFinishedPulling="2026-06-02 01:10:57.575431155 +0000 UTC m=+16.356350175" observedRunningTime="2026-06-02 01:11:02.820227635 +0000 UTC m=+21.601146673" watchObservedRunningTime="2026-06-02 01:11:02.820651461 +0000 UTC m=+21.601570500" Jun 02 01:11:02.833228 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.833189 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-pvvrj" podStartSLOduration=3.641369913 podStartE2EDuration="21.833175414s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.199522913 +0000 UTC m=+2.980441936" lastFinishedPulling="2026-06-02 01:11:02.391328413 +0000 UTC m=+21.172247437" observedRunningTime="2026-06-02 01:11:02.832627793 +0000 UTC m=+21.613546833" watchObservedRunningTime="2026-06-02 01:11:02.833175414 +0000 UTC m=+21.614094453" Jun 02 01:11:02.848009 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.847970 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xvlp8" podStartSLOduration=3.652885767 podStartE2EDuration="21.847956426s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.200630016 +0000 UTC m=+2.981549043" lastFinishedPulling="2026-06-02 01:11:02.395700668 +0000 UTC m=+21.176619702" observedRunningTime="2026-06-02 01:11:02.847619473 +0000 UTC m=+21.628538511" watchObservedRunningTime="2026-06-02 01:11:02.847956426 +0000 UTC m=+21.628875465" Jun 02 01:11:02.861050 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.861006 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z7d9x" podStartSLOduration=8.496661365 podStartE2EDuration="21.86099348s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.21110122 +0000 UTC m=+2.992020252" lastFinishedPulling="2026-06-02 01:10:57.575433347 +0000 UTC m=+16.356352367" observedRunningTime="2026-06-02 01:11:02.860640441 +0000 UTC m=+21.641559480" watchObservedRunningTime="2026-06-02 01:11:02.86099348 +0000 UTC m=+21.641912520" Jun 02 01:11:02.894175 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.894139 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:11:02.894659 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.894640 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:11:02.898154 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:02.898114 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9ktsk" podStartSLOduration=3.701756723 podStartE2EDuration="21.89810186s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.201406773 +0000 UTC m=+2.982325793" lastFinishedPulling="2026-06-02 01:11:02.397751901 +0000 UTC m=+21.178670930" observedRunningTime="2026-06-02 01:11:02.897834722 +0000 UTC m=+21.678753760" watchObservedRunningTime="2026-06-02 01:11:02.89810186 +0000 UTC m=+21.679020899" Jun 02 01:11:03.661052 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:03.661030 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:11:03.817257 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:03.817169 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" event={"ID":"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5","Type":"ContainerStarted","Data":"08101f2e46d1308932e91f932b13116de8f6e94d022e545b2b1c8597df651a42"} Jun 02 01:11:03.819829 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:03.819811 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:11:03.820225 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:03.820197 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"95b6f1e5aac9d41a488ea5a142b7b848aae40c04b05f5128604d7222679624b0"} Jun 02 01:11:03.820331 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:03.820231 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"e92d901d8c280ccaf7d28993f3ed7da3972d33a53794ddac81c913443e94f444"} Jun 02 01:11:03.821695 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:03.821666 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7sqcd" event={"ID":"1fdb9b0b-9da8-41fd-bb1d-0f59b264a1c2","Type":"ContainerStarted","Data":"97e492ecc7a73fb846076ce9241256a8b3f9e13a5f81ffaba7db5168c628ced1"} Jun 02 01:11:04.355458 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.355422 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:04.355660 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:04.355547 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:11:04.355660 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:04.355603 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret podName:9953c519-40ab-4a49-91f9-d25e41679017 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:12.355587375 +0000 UTC m=+31.136506409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret") pod "global-pull-secret-syncer-q77t7" (UID: "9953c519-40ab-4a49-91f9-d25e41679017") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:11:04.655867 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.655736 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:11:03.661048053Z","UUID":"d0bcd818-9028-42fb-93c6-03411ccc82fd","Handler":null,"Name":"","Endpoint":""} Jun 02 01:11:04.657662 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.657635 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:11:04.657787 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.657674 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:11:04.689050 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.689020 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:04.689050 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.689042 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:04.689308 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:04.689155 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:04.689308 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.689202 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:04.689410 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:04.689309 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:04.689410 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:04.689375 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:04.824888 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.824849 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" event={"ID":"0bc8d00b-c07b-412b-9479-bfc1f52e2cf5","Type":"ContainerStarted","Data":"8298824a7fe3e9390e5b93aae3209816dbd5b05be4de10c7589bffcdb69ff001"} Jun 02 01:11:04.825352 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.824903 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:11:04.841467 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.841423 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7sqcd" podStartSLOduration=5.655451795 podStartE2EDuration="23.841409982s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.205371538 +0000 UTC m=+2.986290557" lastFinishedPulling="2026-06-02 01:11:02.391329725 +0000 UTC m=+21.172248744" observedRunningTime="2026-06-02 01:11:03.834538711 +0000 UTC m=+22.615457751" watchObservedRunningTime="2026-06-02 01:11:04.841409982 +0000 UTC m=+23.622329021" Jun 02 01:11:04.841591 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:04.841525 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bqtjz" podStartSLOduration=3.439190925 podStartE2EDuration="23.841520769s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.208276477 +0000 UTC m=+2.989195501" lastFinishedPulling="2026-06-02 01:11:04.610606321 +0000 UTC m=+23.391525345" observedRunningTime="2026-06-02 01:11:04.841176938 +0000 UTC m=+23.622095987" watchObservedRunningTime="2026-06-02 01:11:04.841520769 +0000 UTC m=+23.622439801" Jun 02 01:11:05.830554 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:05.830323 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:11:05.831511 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:05.831475 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"6b7f3112558b5792c0bbed18375fdb39163341defdc23cd44d1666c514ca01a9"} Jun 02 01:11:06.689186 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:06.689154 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:06.689359 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:06.689154 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:06.689359 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:06.689275 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:06.689359 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:06.689154 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:06.689514 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:06.689343 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:06.689514 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:06.689446 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:07.763441 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.763268 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:11:07.764252 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.763545 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:11:07.764252 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.763785 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z7d9x" Jun 02 01:11:07.838384 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.838360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:11:07.838668 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.838644 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"916c2d7938cdc2c46197a1e80ded9efccc83178a5db2c7b508d39c6a1de61966"} Jun 02 01:11:07.838985 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.838959 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:11:07.839171 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.839155 2578 scope.go:117] "RemoveContainer" containerID="16f95be996ee7148bb0a09b6d4d3f54aec13f47d8e8bda899686ceee79306be2" Jun 02 01:11:07.840327 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.840304 2578 generic.go:358] "Generic (PLEG): container finished" podID="1fc744de-9f37-42ba-a215-839045bc96ae" containerID="401d06090f5bbf37d377d0c03e31c7fa4e5a26571e34d386f1ca81ab16e8a0ff" exitCode=0 Jun 02 01:11:07.840406 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.840385 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" event={"ID":"1fc744de-9f37-42ba-a215-839045bc96ae","Type":"ContainerDied","Data":"401d06090f5bbf37d377d0c03e31c7fa4e5a26571e34d386f1ca81ab16e8a0ff"} Jun 02 01:11:07.855484 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:07.855460 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:11:08.689642 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.689607 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:08.689823 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.689654 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:08.689823 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.689609 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:08.689823 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:08.689727 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:08.689823 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:08.689817 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:08.690054 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:08.689895 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:08.845601 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.845578 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:11:08.846097 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.845901 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" event={"ID":"a2584c13-0ef1-4aec-ba13-53595473cd95","Type":"ContainerStarted","Data":"df26618846d1b1f891f3fe2839f331eac2645848889f34b9cfa44b29f0a6e5fe"} Jun 02 01:11:08.846097 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.846087 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:11:08.846413 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.846388 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:11:08.862011 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.861976 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:11:08.871787 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:08.871733 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" podStartSLOduration=9.611202029 podStartE2EDuration="27.871713968s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.213806368 +0000 UTC m=+2.994725389" lastFinishedPulling="2026-06-02 01:11:02.474318294 +0000 UTC m=+21.255237328" observedRunningTime="2026-06-02 01:11:08.870833281 +0000 UTC m=+27.651752330" watchObservedRunningTime="2026-06-02 01:11:08.871713968 +0000 UTC m=+27.652633008" Jun 02 01:11:09.125975 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.125748 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q77t7"] Jun 02 01:11:09.126078 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.126064 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:09.126199 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:09.126178 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:09.127888 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.127866 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gtv6j"] Jun 02 01:11:09.128022 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.127971 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:09.128074 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:09.128054 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:09.128710 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.128690 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n5qxb"] Jun 02 01:11:09.128793 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.128761 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:09.128842 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:09.128824 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:09.848893 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.848858 2578 generic.go:358] "Generic (PLEG): container finished" podID="1fc744de-9f37-42ba-a215-839045bc96ae" containerID="74bf4b4c85dc6b9b80101402d67073396841caa9f1c77e8ae9a7f1f6f70285fb" exitCode=0 Jun 02 01:11:09.849280 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.848934 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" event={"ID":"1fc744de-9f37-42ba-a215-839045bc96ae","Type":"ContainerDied","Data":"74bf4b4c85dc6b9b80101402d67073396841caa9f1c77e8ae9a7f1f6f70285fb"} Jun 02 01:11:09.849783 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:09.849525 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:11:10.689585 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:10.689554 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:10.689585 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:10.689574 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:10.689791 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:10.689554 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:10.689791 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:10.689665 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:10.689791 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:10.689723 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:10.689791 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:10.689786 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:10.850286 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:10.850257 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:11:11.663098 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:11.663057 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:11:11.853659 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:11.853629 2578 generic.go:358] "Generic (PLEG): container finished" podID="1fc744de-9f37-42ba-a215-839045bc96ae" containerID="4ee3de7c42627bc1e7c4cf684477657bcab863accf7bd7248a8e0b49dd340c85" exitCode=0 Jun 02 01:11:11.854377 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:11.853713 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" event={"ID":"1fc744de-9f37-42ba-a215-839045bc96ae","Type":"ContainerDied","Data":"4ee3de7c42627bc1e7c4cf684477657bcab863accf7bd7248a8e0b49dd340c85"} Jun 02 01:11:12.423619 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:12.423575 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:12.423796 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:12.423693 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:11:12.423796 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:12.423762 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret podName:9953c519-40ab-4a49-91f9-d25e41679017 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:28.42374152 +0000 UTC m=+47.204660536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret") pod "global-pull-secret-syncer-q77t7" (UID: "9953c519-40ab-4a49-91f9-d25e41679017") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:11:12.689150 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:12.689071 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:12.689150 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:12.689100 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:12.689150 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:12.689071 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:12.689361 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:12.689224 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:12.689361 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:12.689266 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:12.689361 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:12.689345 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:14.689704 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:14.689667 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:14.690345 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:14.689667 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:14.690345 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:14.689796 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q77t7" podUID="9953c519-40ab-4a49-91f9-d25e41679017" Jun 02 01:11:14.690345 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:14.689875 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n5qxb" podUID="f9738c4d-db83-4b44-9cf5-7df1118311f6" Jun 02 01:11:14.690345 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:14.689667 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:14.690345 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:14.690035 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gtv6j" podUID="501af48d-d29b-428f-a029-9a0a83619b0b" Jun 02 01:11:15.096956 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.096926 2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-17.ec2.internal" event="NodeReady" Jun 02 01:11:15.097127 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.097083 2578 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:11:15.137547 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.137502 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j4c5m"] Jun 02 01:11:15.158891 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.158861 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fhkr2"] Jun 02 01:11:15.159057 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.159033 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.161230 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.161203 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:11:15.161359 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.161247 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n98qz\"" Jun 02 01:11:15.161359 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.161264 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:11:15.173879 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.173859 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j4c5m"] Jun 02 01:11:15.174000 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.173883 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fhkr2"] Jun 02 01:11:15.174000 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.173987 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:15.176048 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.176031 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9tnxm\"" Jun 02 01:11:15.176149 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.176101 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:11:15.176149 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.176119 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:11:15.182246 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.182198 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:11:15.249513 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.249473 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:15.249513 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.249523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtx9t\" (UniqueName: \"kubernetes.io/projected/a6d4f294-bdec-4d4b-893c-c9694026c804-kube-api-access-qtx9t\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:15.249952 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.249638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-config-volume\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.249952 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.249670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bt74\" (UniqueName: \"kubernetes.io/projected/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-kube-api-access-8bt74\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.249952 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.249717 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-tmp-dir\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.249952 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.249755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.350845 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.350769 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-tmp-dir\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.350845 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.350834 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:15.351085 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.350860 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.351085 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.350886 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:15.351085 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.350928 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtx9t\" (UniqueName: \"kubernetes.io/projected/a6d4f294-bdec-4d4b-893c-c9694026c804-kube-api-access-qtx9t\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:15.351085 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.350973 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-config-volume\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.351085 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.350998 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8bt74\" (UniqueName: \"kubernetes.io/projected/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-kube-api-access-8bt74\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.351085 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.351030 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:15.351085 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.351044 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:15.351328 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.351030 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:15.351328 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.351101 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert podName:a6d4f294-bdec-4d4b-893c-c9694026c804 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:15.851081249 +0000 UTC m=+34.632000283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert") pod "ingress-canary-fhkr2" (UID: "a6d4f294-bdec-4d4b-893c-c9694026c804") : secret "canary-serving-cert" not found Jun 02 01:11:15.351328 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.351154 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs podName:501af48d-d29b-428f-a029-9a0a83619b0b nodeName:}" failed. No retries permitted until 2026-06-02 01:11:47.351134201 +0000 UTC m=+66.132053230 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs") pod "network-metrics-daemon-gtv6j" (UID: "501af48d-d29b-428f-a029-9a0a83619b0b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:15.351328 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.351164 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-tmp-dir\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.351328 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.351171 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls podName:eb73dfb9-e19a-4a9e-9d70-24a508ba0031 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:15.851161371 +0000 UTC m=+34.632080395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls") pod "dns-default-j4c5m" (UID: "eb73dfb9-e19a-4a9e-9d70-24a508ba0031") : secret "dns-default-metrics-tls" not found Jun 02 01:11:15.351558 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.351531 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-config-volume\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.361457 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.361308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bt74\" (UniqueName: \"kubernetes.io/projected/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-kube-api-access-8bt74\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.361598 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.361470 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtx9t\" (UniqueName: \"kubernetes.io/projected/a6d4f294-bdec-4d4b-893c-c9694026c804-kube-api-access-qtx9t\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:15.452204 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.452172 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:15.452357 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.452329 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:11:15.452357 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.452349 2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:11:15.452357 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.452358 2578 projected.go:194] Error preparing data for projected volume kube-api-access-zc7nb for pod openshift-network-diagnostics/network-check-target-n5qxb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:15.452472 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.452411 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb podName:f9738c4d-db83-4b44-9cf5-7df1118311f6 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:47.452394488 +0000 UTC m=+66.233313505 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zc7nb" (UniqueName: "kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb") pod "network-check-target-n5qxb" (UID: "f9738c4d-db83-4b44-9cf5-7df1118311f6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:15.854818 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.854780 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:15.855291 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:15.854896 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:15.855291 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.854947 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:15.855291 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.855007 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:15.855291 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.855023 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert podName:a6d4f294-bdec-4d4b-893c-c9694026c804 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:16.855002849 +0000 UTC m=+35.635921876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert") pod "ingress-canary-fhkr2" (UID: "a6d4f294-bdec-4d4b-893c-c9694026c804") : secret "canary-serving-cert" not found Jun 02 01:11:15.855291 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:15.855058 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls podName:eb73dfb9-e19a-4a9e-9d70-24a508ba0031 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:16.855043128 +0000 UTC m=+35.635962158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls") pod "dns-default-j4c5m" (UID: "eb73dfb9-e19a-4a9e-9d70-24a508ba0031") : secret "dns-default-metrics-tls" not found Jun 02 01:11:16.689102 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.689067 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:16.689331 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.689067 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:16.689331 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.689067 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:16.691734 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.691712 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:11:16.691734 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.691725 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:11:16.691896 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.691734 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:11:16.692658 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.692523 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:11:16.692658 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.692593 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfq6c\"" Jun 02 01:11:16.692658 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.692657 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5956\"" Jun 02 01:11:16.861460 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.861423 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:16.861898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:16.861473 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:16.861898 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:16.861585 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:16.861898 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:16.861599 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:16.861898 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:16.861647 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert podName:a6d4f294-bdec-4d4b-893c-c9694026c804 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:18.861628201 +0000 UTC m=+37.642547218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert") pod "ingress-canary-fhkr2" (UID: "a6d4f294-bdec-4d4b-893c-c9694026c804") : secret "canary-serving-cert" not found Jun 02 01:11:16.861898 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:16.861673 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls podName:eb73dfb9-e19a-4a9e-9d70-24a508ba0031 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:18.861656307 +0000 UTC m=+37.642575331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls") pod "dns-default-j4c5m" (UID: "eb73dfb9-e19a-4a9e-9d70-24a508ba0031") : secret "dns-default-metrics-tls" not found Jun 02 01:11:18.870387 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:18.870352 2578 generic.go:358] "Generic (PLEG): container finished" podID="1fc744de-9f37-42ba-a215-839045bc96ae" containerID="8821cc5b3fee526877f1e4716c92c1e50d7106e0681cf7de5fe2d99476ace5c4" exitCode=0 Jun 02 01:11:18.870716 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:18.870405 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" event={"ID":"1fc744de-9f37-42ba-a215-839045bc96ae","Type":"ContainerDied","Data":"8821cc5b3fee526877f1e4716c92c1e50d7106e0681cf7de5fe2d99476ace5c4"} Jun 02 01:11:18.878960 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:18.878926 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:18.879090 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:18.879063 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:18.879090 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:18.879072 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:18.879195 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:18.879138 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls podName:eb73dfb9-e19a-4a9e-9d70-24a508ba0031 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:22.879116981 +0000 UTC m=+41.660036012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls") pod "dns-default-j4c5m" (UID: "eb73dfb9-e19a-4a9e-9d70-24a508ba0031") : secret "dns-default-metrics-tls" not found Jun 02 01:11:18.879256 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:18.879193 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:18.879256 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:18.879239 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert podName:a6d4f294-bdec-4d4b-893c-c9694026c804 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:22.87922661 +0000 UTC m=+41.660145633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert") pod "ingress-canary-fhkr2" (UID: "a6d4f294-bdec-4d4b-893c-c9694026c804") : secret "canary-serving-cert" not found Jun 02 01:11:19.874887 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:19.874855 2578 generic.go:358] "Generic (PLEG): container finished" podID="1fc744de-9f37-42ba-a215-839045bc96ae" containerID="48d1b155e49d5ed777aa9492bc4d4ac8f6c4305061179958c212f5ee962c47bb" exitCode=0 Jun 02 01:11:19.875317 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:19.874905 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" event={"ID":"1fc744de-9f37-42ba-a215-839045bc96ae","Type":"ContainerDied","Data":"48d1b155e49d5ed777aa9492bc4d4ac8f6c4305061179958c212f5ee962c47bb"} Jun 02 01:11:20.880125 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:20.880089 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" event={"ID":"1fc744de-9f37-42ba-a215-839045bc96ae","Type":"ContainerStarted","Data":"0662c591b7d29ac48128dac87689d5cc7e6c42682fb3098bff7f4bed9951d350"} Jun 02 01:11:20.901440 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:20.901387 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tnb8j" podStartSLOduration=6.040209861 podStartE2EDuration="39.901372889s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:10:44.210346528 +0000 UTC m=+2.991265548" lastFinishedPulling="2026-06-02 01:11:18.071509559 +0000 UTC m=+36.852428576" observedRunningTime="2026-06-02 01:11:20.901160275 +0000 UTC m=+39.682079314" watchObservedRunningTime="2026-06-02 01:11:20.901372889 +0000 UTC m=+39.682291965" Jun 02 01:11:22.911063 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:22.911021 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:22.911063 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:22.911067 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:22.911496 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:22.911163 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:22.911496 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:22.911221 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls podName:eb73dfb9-e19a-4a9e-9d70-24a508ba0031 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:30.911206142 +0000 UTC m=+49.692125163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls") pod "dns-default-j4c5m" (UID: "eb73dfb9-e19a-4a9e-9d70-24a508ba0031") : secret "dns-default-metrics-tls" not found Jun 02 01:11:22.911496 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:22.911168 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:22.911496 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:22.911290 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert podName:a6d4f294-bdec-4d4b-893c-c9694026c804 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:30.911274765 +0000 UTC m=+49.692193784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert") pod "ingress-canary-fhkr2" (UID: "a6d4f294-bdec-4d4b-893c-c9694026c804") : secret "canary-serving-cert" not found Jun 02 01:11:28.447001 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:28.446960 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:28.450201 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:28.450176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9953c519-40ab-4a49-91f9-d25e41679017-original-pull-secret\") pod \"global-pull-secret-syncer-q77t7\" (UID: \"9953c519-40ab-4a49-91f9-d25e41679017\") " pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:28.715869 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:28.715785 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q77t7" Jun 02 01:11:28.873008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:28.872975 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q77t7"] Jun 02 01:11:28.879761 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:11:28.879729 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9953c519_40ab_4a49_91f9_d25e41679017.slice/crio-9d8f5b496e1282a100e26e22de20438313ac5babaf5b8d52d064879091f07908 WatchSource:0}: Error finding container 9d8f5b496e1282a100e26e22de20438313ac5babaf5b8d52d064879091f07908: Status 404 returned error can't find the container with id 9d8f5b496e1282a100e26e22de20438313ac5babaf5b8d52d064879091f07908 Jun 02 01:11:28.894977 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:28.894946 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q77t7" event={"ID":"9953c519-40ab-4a49-91f9-d25e41679017","Type":"ContainerStarted","Data":"9d8f5b496e1282a100e26e22de20438313ac5babaf5b8d52d064879091f07908"} Jun 02 01:11:30.966179 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:30.966142 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:30.966705 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:30.966192 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:30.966705 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:30.966299 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:30.966705 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:30.966360 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert podName:a6d4f294-bdec-4d4b-893c-c9694026c804 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:46.966346712 +0000 UTC m=+65.747265729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert") pod "ingress-canary-fhkr2" (UID: "a6d4f294-bdec-4d4b-893c-c9694026c804") : secret "canary-serving-cert" not found Jun 02 01:11:30.966705 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:30.966299 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:30.966705 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:30.966432 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls podName:eb73dfb9-e19a-4a9e-9d70-24a508ba0031 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:46.966417491 +0000 UTC m=+65.747336522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls") pod "dns-default-j4c5m" (UID: "eb73dfb9-e19a-4a9e-9d70-24a508ba0031") : secret "dns-default-metrics-tls" not found Jun 02 01:11:33.906115 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:33.906070 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q77t7" event={"ID":"9953c519-40ab-4a49-91f9-d25e41679017","Type":"ContainerStarted","Data":"bb54d825fdb4cc1eb6945439cfe90807915e159307835747342a192a7ad78345"} Jun 02 01:11:33.920067 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:33.920020 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q77t7" podStartSLOduration=33.761521424 podStartE2EDuration="37.920006485s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:11:28.8811227 +0000 UTC m=+47.662041717" lastFinishedPulling="2026-06-02 01:11:33.039607757 +0000 UTC m=+51.820526778" observedRunningTime="2026-06-02 01:11:33.919281636 +0000 UTC m=+52.700200685" watchObservedRunningTime="2026-06-02 01:11:33.920006485 +0000 UTC m=+52.700925523" Jun 02 01:11:38.103791 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.103756 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk"] Jun 02 01:11:38.135491 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.135463 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk"] Jun 02 01:11:38.135640 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.135582 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.137975 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.137946 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 01:11:38.138700 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.138685 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 01:11:38.138768 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.138709 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 01:11:38.138768 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.138735 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 01:11:38.214867 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.214832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4584d232-8786-4b12-8619-dff980f3e13e-klusterlet-config\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.215040 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.214986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4584d232-8786-4b12-8619-dff980f3e13e-tmp\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.215040 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.215020 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nvxl\" (UniqueName: \"kubernetes.io/projected/4584d232-8786-4b12-8619-dff980f3e13e-kube-api-access-2nvxl\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.315788 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.315743 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4584d232-8786-4b12-8619-dff980f3e13e-tmp\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.315788 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.315790 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nvxl\" (UniqueName: \"kubernetes.io/projected/4584d232-8786-4b12-8619-dff980f3e13e-kube-api-access-2nvxl\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.316070 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.315823 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4584d232-8786-4b12-8619-dff980f3e13e-klusterlet-config\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.316233 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.316205 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4584d232-8786-4b12-8619-dff980f3e13e-tmp\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.318497 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.318472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4584d232-8786-4b12-8619-dff980f3e13e-klusterlet-config\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.323868 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.323851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nvxl\" (UniqueName: \"kubernetes.io/projected/4584d232-8786-4b12-8619-dff980f3e13e-kube-api-access-2nvxl\") pod \"klusterlet-addon-workmgr-9fb54d8d5-wnqmk\" (UID: \"4584d232-8786-4b12-8619-dff980f3e13e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.444195 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.444116 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:38.562131 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.562098 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk"] Jun 02 01:11:38.566269 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:11:38.566241 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4584d232_8786_4b12_8619_dff980f3e13e.slice/crio-cadf9949a98c6902d223e2cca9a28b51678c0c1260634d44af6a5d2b5b02f1a3 WatchSource:0}: Error finding container cadf9949a98c6902d223e2cca9a28b51678c0c1260634d44af6a5d2b5b02f1a3: Status 404 returned error can't find the container with id cadf9949a98c6902d223e2cca9a28b51678c0c1260634d44af6a5d2b5b02f1a3 Jun 02 01:11:38.918854 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:38.918818 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" event={"ID":"4584d232-8786-4b12-8619-dff980f3e13e","Type":"ContainerStarted","Data":"cadf9949a98c6902d223e2cca9a28b51678c0c1260634d44af6a5d2b5b02f1a3"} Jun 02 01:11:41.869071 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:41.869038 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5h6vx" Jun 02 01:11:43.929317 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:43.929281 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" event={"ID":"4584d232-8786-4b12-8619-dff980f3e13e","Type":"ContainerStarted","Data":"8ab8a7721d8720c7acc834e4dda7c9c44875342527c61c4b8e6555d330d99fa2"} Jun 02 01:11:43.929725 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:43.929448 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:43.931103 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:43.931083 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" Jun 02 01:11:43.945712 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:43.945672 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-9fb54d8d5-wnqmk" podStartSLOduration=1.1527096239999999 podStartE2EDuration="5.945660487s" podCreationTimestamp="2026-06-02 01:11:38 +0000 UTC" firstStartedPulling="2026-06-02 01:11:38.567666474 +0000 UTC m=+57.348585494" lastFinishedPulling="2026-06-02 01:11:43.360617337 +0000 UTC m=+62.141536357" observedRunningTime="2026-06-02 01:11:43.945075757 +0000 UTC m=+62.725994797" watchObservedRunningTime="2026-06-02 01:11:43.945660487 +0000 UTC m=+62.726579526" Jun 02 01:11:46.978382 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:46.978344 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:11:46.978382 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:46.978386 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:11:46.978833 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:46.978478 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:46.978833 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:46.978502 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:46.978833 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:46.978526 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert podName:a6d4f294-bdec-4d4b-893c-c9694026c804 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:18.978514136 +0000 UTC m=+97.759433153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert") pod "ingress-canary-fhkr2" (UID: "a6d4f294-bdec-4d4b-893c-c9694026c804") : secret "canary-serving-cert" not found Jun 02 01:11:46.978833 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:46.978566 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls podName:eb73dfb9-e19a-4a9e-9d70-24a508ba0031 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:18.97854739 +0000 UTC m=+97.759466411 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls") pod "dns-default-j4c5m" (UID: "eb73dfb9-e19a-4a9e-9d70-24a508ba0031") : secret "dns-default-metrics-tls" not found Jun 02 01:11:47.381401 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.381370 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:11:47.383946 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.383905 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:11:47.391826 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:47.391807 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:11:47.391932 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:11:47.391873 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs podName:501af48d-d29b-428f-a029-9a0a83619b0b nodeName:}" failed. No retries permitted until 2026-06-02 01:12:51.3918504 +0000 UTC m=+130.172769429 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs") pod "network-metrics-daemon-gtv6j" (UID: "501af48d-d29b-428f-a029-9a0a83619b0b") : secret "metrics-daemon-secret" not found Jun 02 01:11:47.482552 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.482517 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:47.485321 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.485300 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:11:47.494552 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.494530 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:11:47.505699 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.505671 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc7nb\" (UniqueName: \"kubernetes.io/projected/f9738c4d-db83-4b44-9cf5-7df1118311f6-kube-api-access-zc7nb\") pod \"network-check-target-n5qxb\" (UID: \"f9738c4d-db83-4b44-9cf5-7df1118311f6\") " pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:47.612217 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.612192 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfq6c\"" Jun 02 01:11:47.620235 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.620216 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:47.735253 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.735221 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n5qxb"] Jun 02 01:11:47.738769 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:11:47.738738 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9738c4d_db83_4b44_9cf5_7df1118311f6.slice/crio-6f7e4daa4eaae59bd7bb7d9742de3d2dac8f6785fd2558e832832821c3cab5ab WatchSource:0}: Error finding container 6f7e4daa4eaae59bd7bb7d9742de3d2dac8f6785fd2558e832832821c3cab5ab: Status 404 returned error can't find the container with id 6f7e4daa4eaae59bd7bb7d9742de3d2dac8f6785fd2558e832832821c3cab5ab Jun 02 01:11:47.936557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:47.936466 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n5qxb" event={"ID":"f9738c4d-db83-4b44-9cf5-7df1118311f6","Type":"ContainerStarted","Data":"6f7e4daa4eaae59bd7bb7d9742de3d2dac8f6785fd2558e832832821c3cab5ab"} Jun 02 01:11:50.944113 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:50.944076 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n5qxb" event={"ID":"f9738c4d-db83-4b44-9cf5-7df1118311f6","Type":"ContainerStarted","Data":"ac45b5e25b52734636b1426e412ae57d0c7c05769d25d9f23347b2053bcd8fb1"} Jun 02 01:11:50.944571 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:50.944221 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:11:50.959023 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:11:50.958972 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n5qxb" podStartSLOduration=66.915093329 podStartE2EDuration="1m9.958949044s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:11:47.740601131 +0000 UTC m=+66.521520147" lastFinishedPulling="2026-06-02 01:11:50.784456831 +0000 UTC m=+69.565375862" observedRunningTime="2026-06-02 01:11:50.958212245 +0000 UTC m=+69.739131285" watchObservedRunningTime="2026-06-02 01:11:50.958949044 +0000 UTC m=+69.739868083" Jun 02 01:12:00.709571 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.709455 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp"] Jun 02 01:12:00.712335 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.712318 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.715810 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.715766 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 01:12:00.715937 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.715774 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:12:00.716518 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.716503 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:12:00.716820 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.716798 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b64zn\"" Jun 02 01:12:00.716864 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.716798 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 01:12:00.721475 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.721455 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp"] Jun 02 01:12:00.778329 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.778286 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/506f5f2f-f1e5-4211-943a-a81fb5904abb-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.778329 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.778332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.778541 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.778354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7zcm\" (UniqueName: \"kubernetes.io/projected/506f5f2f-f1e5-4211-943a-a81fb5904abb-kube-api-access-j7zcm\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.878985 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.878944 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/506f5f2f-f1e5-4211-943a-a81fb5904abb-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.878985 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.878986 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.879191 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.879008 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7zcm\" (UniqueName: \"kubernetes.io/projected/506f5f2f-f1e5-4211-943a-a81fb5904abb-kube-api-access-j7zcm\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.879191 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:00.879146 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:00.879265 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:00.879240 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls podName:506f5f2f-f1e5-4211-943a-a81fb5904abb nodeName:}" failed. No retries permitted until 2026-06-02 01:12:01.37921547 +0000 UTC m=+80.160134508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-lg6fp" (UID: "506f5f2f-f1e5-4211-943a-a81fb5904abb") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:00.879704 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.879684 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/506f5f2f-f1e5-4211-943a-a81fb5904abb-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.889890 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.889861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7zcm\" (UniqueName: \"kubernetes.io/projected/506f5f2f-f1e5-4211-943a-a81fb5904abb-kube-api-access-j7zcm\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:00.917787 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.917757 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl"] Jun 02 01:12:00.920722 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.920701 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-8l28t"] Jun 02 01:12:00.920897 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.920869 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:00.923134 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.923111 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 01:12:00.923234 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.923117 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 01:12:00.923234 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.923161 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bl4hz\"" Jun 02 01:12:00.923399 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.923379 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:12:00.923470 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.923438 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:00.926089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.926053 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 01:12:00.926089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.926135 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ms2r2\"" Jun 02 01:12:00.926089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.926161 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:12:00.926089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.926234 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 01:12:00.926089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.926343 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 01:12:00.932249 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.932222 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl"] Jun 02 01:12:00.934304 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.934283 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-8l28t"] Jun 02 01:12:00.936892 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.936874 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 01:12:00.980227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.980140 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:00.980227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.980175 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea4507ac-5777-4af3-9120-359832712f5d-config\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:00.980227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.980211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4507ac-5777-4af3-9120-359832712f5d-serving-cert\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:00.980227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.980229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea4507ac-5777-4af3-9120-359832712f5d-trusted-ca\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:00.980499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.980247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcwjs\" (UniqueName: \"kubernetes.io/projected/e8037f60-1de8-4e23-b47e-e0a912cf7723-kube-api-access-bcwjs\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:00.980499 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:00.980275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm8f7\" (UniqueName: \"kubernetes.io/projected/ea4507ac-5777-4af3-9120-359832712f5d-kube-api-access-rm8f7\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.080993 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.080957 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rm8f7\" (UniqueName: \"kubernetes.io/projected/ea4507ac-5777-4af3-9120-359832712f5d-kube-api-access-rm8f7\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.081112 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.081057 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:01.081112 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.081086 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea4507ac-5777-4af3-9120-359832712f5d-config\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.081202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.081128 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4507ac-5777-4af3-9120-359832712f5d-serving-cert\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.081202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.081154 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea4507ac-5777-4af3-9120-359832712f5d-trusted-ca\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.081202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.081180 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bcwjs\" (UniqueName: \"kubernetes.io/projected/e8037f60-1de8-4e23-b47e-e0a912cf7723-kube-api-access-bcwjs\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:01.081340 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:01.081203 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:12:01.081340 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:01.081291 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls podName:e8037f60-1de8-4e23-b47e-e0a912cf7723 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:01.581271259 +0000 UTC m=+80.362190298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4ggrl" (UID: "e8037f60-1de8-4e23-b47e-e0a912cf7723") : secret "samples-operator-tls" not found Jun 02 01:12:01.081834 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.081812 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ea4507ac-5777-4af3-9120-359832712f5d-config\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.082468 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.082448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea4507ac-5777-4af3-9120-359832712f5d-trusted-ca\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.083530 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.083511 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ea4507ac-5777-4af3-9120-359832712f5d-serving-cert\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.089965 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.089943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcwjs\" (UniqueName: \"kubernetes.io/projected/e8037f60-1de8-4e23-b47e-e0a912cf7723-kube-api-access-bcwjs\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:01.090060 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.089974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm8f7\" (UniqueName: \"kubernetes.io/projected/ea4507ac-5777-4af3-9120-359832712f5d-kube-api-access-rm8f7\") pod \"console-operator-86d7c6cc77-8l28t\" (UID: \"ea4507ac-5777-4af3-9120-359832712f5d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.239034 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.238949 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:01.355764 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.355725 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-8l28t"] Jun 02 01:12:01.359339 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:01.359316 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4507ac_5777_4af3_9120_359832712f5d.slice/crio-bd59a5f3013c2db5896b7753ff179c7274cad2900cff2918d93db25b9d7f19a5 WatchSource:0}: Error finding container bd59a5f3013c2db5896b7753ff179c7274cad2900cff2918d93db25b9d7f19a5: Status 404 returned error can't find the container with id bd59a5f3013c2db5896b7753ff179c7274cad2900cff2918d93db25b9d7f19a5 Jun 02 01:12:01.384013 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.383986 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:01.384115 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:01.384095 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:01.384175 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:01.384166 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls podName:506f5f2f-f1e5-4211-943a-a81fb5904abb nodeName:}" failed. No retries permitted until 2026-06-02 01:12:02.384137588 +0000 UTC m=+81.165056605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-lg6fp" (UID: "506f5f2f-f1e5-4211-943a-a81fb5904abb") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:01.586256 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.586219 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:01.586406 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:01.586369 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:12:01.586448 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:01.586436 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls podName:e8037f60-1de8-4e23-b47e-e0a912cf7723 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:02.586419544 +0000 UTC m=+81.367338561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4ggrl" (UID: "e8037f60-1de8-4e23-b47e-e0a912cf7723") : secret "samples-operator-tls" not found Jun 02 01:12:01.964874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:01.964784 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" event={"ID":"ea4507ac-5777-4af3-9120-359832712f5d","Type":"ContainerStarted","Data":"bd59a5f3013c2db5896b7753ff179c7274cad2900cff2918d93db25b9d7f19a5"} Jun 02 01:12:02.108331 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.108295 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b8f64669c-xnx6s"] Jun 02 01:12:02.120270 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.120235 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.121243 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.121208 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b8f64669c-xnx6s"] Jun 02 01:12:02.123283 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.123260 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 01:12:02.123425 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.123303 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 01:12:02.123425 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.123260 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 01:12:02.123522 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.123438 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6zdsw\"" Jun 02 01:12:02.130327 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.130298 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 01:12:02.190966 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.190928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-installation-pull-secrets\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.191164 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.190984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.191164 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.191007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-certificates\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.191164 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.191100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-trusted-ca\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.191164 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.191128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms855\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-kube-api-access-ms855\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.191164 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.191152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-bound-sa-token\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.191379 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.191235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-image-registry-private-configuration\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.191379 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.191322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f0f6b3c-260f-4d95-bf68-5b78af196660-ca-trust-extracted\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292629 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.292523 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-installation-pull-secrets\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292629 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.292595 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292629 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.292625 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-certificates\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292905 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.292658 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-trusted-ca\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292905 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.292679 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ms855\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-kube-api-access-ms855\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292905 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.292704 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-bound-sa-token\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292905 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.292740 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-image-registry-private-configuration\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292905 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.292747 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:12:02.292905 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.292770 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8f64669c-xnx6s: secret "image-registry-tls" not found Jun 02 01:12:02.292905 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.292829 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f0f6b3c-260f-4d95-bf68-5b78af196660-ca-trust-extracted\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.292905 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.292852 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls podName:4f0f6b3c-260f-4d95-bf68-5b78af196660 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:02.792831184 +0000 UTC m=+81.573750224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls") pod "image-registry-6b8f64669c-xnx6s" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660") : secret "image-registry-tls" not found Jun 02 01:12:02.293365 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.293337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f0f6b3c-260f-4d95-bf68-5b78af196660-ca-trust-extracted\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.293472 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.293380 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-certificates\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.293688 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.293668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-trusted-ca\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.295199 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.295174 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-installation-pull-secrets\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.295290 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.295222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-image-registry-private-configuration\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.301495 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.301470 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-bound-sa-token\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.301721 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.301698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms855\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-kube-api-access-ms855\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.393585 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.393549 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:02.393755 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.393699 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:02.393806 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.393776 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls podName:506f5f2f-f1e5-4211-943a-a81fb5904abb nodeName:}" failed. No retries permitted until 2026-06-02 01:12:04.393757919 +0000 UTC m=+83.174676937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-lg6fp" (UID: "506f5f2f-f1e5-4211-943a-a81fb5904abb") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:02.595438 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.595395 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:02.595642 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.595443 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:12:02.595642 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.595516 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls podName:e8037f60-1de8-4e23-b47e-e0a912cf7723 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:04.595498352 +0000 UTC m=+83.376417369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4ggrl" (UID: "e8037f60-1de8-4e23-b47e-e0a912cf7723") : secret "samples-operator-tls" not found Jun 02 01:12:02.797555 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:02.797516 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:02.797724 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.797700 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:12:02.797771 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.797730 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8f64669c-xnx6s: secret "image-registry-tls" not found Jun 02 01:12:02.797840 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:02.797831 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls podName:4f0f6b3c-260f-4d95-bf68-5b78af196660 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:03.797808492 +0000 UTC m=+82.578727529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls") pod "image-registry-6b8f64669c-xnx6s" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660") : secret "image-registry-tls" not found Jun 02 01:12:03.803488 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:03.803443 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:03.803863 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:03.803565 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:12:03.803863 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:03.803577 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8f64669c-xnx6s: secret "image-registry-tls" not found Jun 02 01:12:03.803863 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:03.803635 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls podName:4f0f6b3c-260f-4d95-bf68-5b78af196660 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:05.803621565 +0000 UTC m=+84.584540582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls") pod "image-registry-6b8f64669c-xnx6s" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660") : secret "image-registry-tls" not found Jun 02 01:12:03.969867 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:03.969790 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/0.log" Jun 02 01:12:03.969867 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:03.969831 2578 generic.go:358] "Generic (PLEG): container finished" podID="ea4507ac-5777-4af3-9120-359832712f5d" containerID="3cdac766e1a73677136cacb01cd181d5599a96849b3f2fc1f97067c9f106892a" exitCode=255 Jun 02 01:12:03.970079 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:03.969867 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" event={"ID":"ea4507ac-5777-4af3-9120-359832712f5d","Type":"ContainerDied","Data":"3cdac766e1a73677136cacb01cd181d5599a96849b3f2fc1f97067c9f106892a"} Jun 02 01:12:03.970149 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:03.970133 2578 scope.go:117] "RemoveContainer" containerID="3cdac766e1a73677136cacb01cd181d5599a96849b3f2fc1f97067c9f106892a" Jun 02 01:12:04.408341 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:04.408284 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:04.408494 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:04.408449 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:04.408553 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:04.408519 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls podName:506f5f2f-f1e5-4211-943a-a81fb5904abb nodeName:}" failed. No retries permitted until 2026-06-02 01:12:08.408503112 +0000 UTC m=+87.189422129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-lg6fp" (UID: "506f5f2f-f1e5-4211-943a-a81fb5904abb") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:04.609606 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:04.609569 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:04.609751 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:04.609723 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:12:04.609802 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:04.609792 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls podName:e8037f60-1de8-4e23-b47e-e0a912cf7723 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:08.609776857 +0000 UTC m=+87.390695874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4ggrl" (UID: "e8037f60-1de8-4e23-b47e-e0a912cf7723") : secret "samples-operator-tls" not found Jun 02 01:12:04.973182 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:04.973148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:12:04.973580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:04.973492 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/0.log" Jun 02 01:12:04.973580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:04.973524 2578 generic.go:358] "Generic (PLEG): container finished" podID="ea4507ac-5777-4af3-9120-359832712f5d" containerID="fd7d5ac8db9686a86b9ae1efc39baf52b7b1365a1b757eb6bcc0ae96764b4192" exitCode=255 Jun 02 01:12:04.973580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:04.973554 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" event={"ID":"ea4507ac-5777-4af3-9120-359832712f5d","Type":"ContainerDied","Data":"fd7d5ac8db9686a86b9ae1efc39baf52b7b1365a1b757eb6bcc0ae96764b4192"} Jun 02 01:12:04.973676 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:04.973604 2578 scope.go:117] "RemoveContainer" containerID="3cdac766e1a73677136cacb01cd181d5599a96849b3f2fc1f97067c9f106892a" Jun 02 01:12:04.973880 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:04.973861 2578 scope.go:117] "RemoveContainer" containerID="fd7d5ac8db9686a86b9ae1efc39baf52b7b1365a1b757eb6bcc0ae96764b4192" Jun 02 01:12:04.974098 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:04.974077 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-8l28t_openshift-console-operator(ea4507ac-5777-4af3-9120-359832712f5d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" podUID="ea4507ac-5777-4af3-9120-359832712f5d" Jun 02 01:12:05.819556 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:05.819502 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:05.819734 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:05.819648 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:12:05.819734 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:05.819669 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8f64669c-xnx6s: secret "image-registry-tls" not found Jun 02 01:12:05.819734 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:05.819727 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls podName:4f0f6b3c-260f-4d95-bf68-5b78af196660 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:09.819711606 +0000 UTC m=+88.600630623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls") pod "image-registry-6b8f64669c-xnx6s" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660") : secret "image-registry-tls" not found Jun 02 01:12:05.977143 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:05.977114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:12:05.977516 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:05.977458 2578 scope.go:117] "RemoveContainer" containerID="fd7d5ac8db9686a86b9ae1efc39baf52b7b1365a1b757eb6bcc0ae96764b4192" Jun 02 01:12:05.977621 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:05.977605 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-8l28t_openshift-console-operator(ea4507ac-5777-4af3-9120-359832712f5d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" podUID="ea4507ac-5777-4af3-9120-359832712f5d" Jun 02 01:12:06.444821 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:06.444791 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pvvrj_a7db0dfa-6fe7-42e4-92a8-ebb431d579ee/dns-node-resolver/0.log" Jun 02 01:12:07.444136 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:07.444108 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c9kf6_0341013e-72f1-43aa-8869-7fcc75f8df43/node-ca/0.log" Jun 02 01:12:08.443845 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:08.443812 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:08.444068 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:08.443973 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:08.444068 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:08.444046 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls podName:506f5f2f-f1e5-4211-943a-a81fb5904abb nodeName:}" failed. No retries permitted until 2026-06-02 01:12:16.444027484 +0000 UTC m=+95.224946501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-lg6fp" (UID: "506f5f2f-f1e5-4211-943a-a81fb5904abb") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:08.644722 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:08.644682 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:08.645112 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:08.644838 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:12:08.645112 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:08.644925 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls podName:e8037f60-1de8-4e23-b47e-e0a912cf7723 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:16.64489318 +0000 UTC m=+95.425812196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4ggrl" (UID: "e8037f60-1de8-4e23-b47e-e0a912cf7723") : secret "samples-operator-tls" not found Jun 02 01:12:09.854318 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:09.854260 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:09.854719 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:09.854412 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:12:09.854719 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:09.854430 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8f64669c-xnx6s: secret "image-registry-tls" not found Jun 02 01:12:09.854719 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:09.854486 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls podName:4f0f6b3c-260f-4d95-bf68-5b78af196660 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:17.854469508 +0000 UTC m=+96.635388530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls") pod "image-registry-6b8f64669c-xnx6s" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660") : secret "image-registry-tls" not found Jun 02 01:12:11.239813 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:11.239777 2578 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:11.239813 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:11.239817 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:11.240234 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:11.240159 2578 scope.go:117] "RemoveContainer" containerID="fd7d5ac8db9686a86b9ae1efc39baf52b7b1365a1b757eb6bcc0ae96764b4192" Jun 02 01:12:11.240337 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:11.240319 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-8l28t_openshift-console-operator(ea4507ac-5777-4af3-9120-359832712f5d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" podUID="ea4507ac-5777-4af3-9120-359832712f5d" Jun 02 01:12:13.353512 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.353476 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-fgdl6"] Jun 02 01:12:13.355834 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.355818 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.358089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.358068 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 01:12:13.358210 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.358118 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 01:12:13.358210 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.358166 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 01:12:13.358979 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.358959 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 01:12:13.359080 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.358979 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9pvvj\"" Jun 02 01:12:13.363656 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.363637 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-fgdl6"] Jun 02 01:12:13.482778 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.482744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad1cadfc-dafa-4dda-9803-1602d52660cd-signing-key\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.482778 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.482783 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gz9d\" (UniqueName: \"kubernetes.io/projected/ad1cadfc-dafa-4dda-9803-1602d52660cd-kube-api-access-5gz9d\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.482998 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.482959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad1cadfc-dafa-4dda-9803-1602d52660cd-signing-cabundle\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.583521 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.583471 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad1cadfc-dafa-4dda-9803-1602d52660cd-signing-key\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.583521 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.583528 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gz9d\" (UniqueName: \"kubernetes.io/projected/ad1cadfc-dafa-4dda-9803-1602d52660cd-kube-api-access-5gz9d\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.583646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.583585 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad1cadfc-dafa-4dda-9803-1602d52660cd-signing-cabundle\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.584271 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.584248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ad1cadfc-dafa-4dda-9803-1602d52660cd-signing-cabundle\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.585841 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.585814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ad1cadfc-dafa-4dda-9803-1602d52660cd-signing-key\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.591325 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.591301 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gz9d\" (UniqueName: \"kubernetes.io/projected/ad1cadfc-dafa-4dda-9803-1602d52660cd-kube-api-access-5gz9d\") pod \"service-ca-685df94d57-fgdl6\" (UID: \"ad1cadfc-dafa-4dda-9803-1602d52660cd\") " pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.665350 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.665247 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-fgdl6" Jun 02 01:12:13.788524 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.788492 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-fgdl6"] Jun 02 01:12:13.791636 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:13.791608 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1cadfc_dafa_4dda_9803_1602d52660cd.slice/crio-3e2d91b2a17b2ca63e9975cdb5d55e831e8457c46fbb232cb71c071094836809 WatchSource:0}: Error finding container 3e2d91b2a17b2ca63e9975cdb5d55e831e8457c46fbb232cb71c071094836809: Status 404 returned error can't find the container with id 3e2d91b2a17b2ca63e9975cdb5d55e831e8457c46fbb232cb71c071094836809 Jun 02 01:12:13.995805 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:13.995711 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-fgdl6" event={"ID":"ad1cadfc-dafa-4dda-9803-1602d52660cd","Type":"ContainerStarted","Data":"3e2d91b2a17b2ca63e9975cdb5d55e831e8457c46fbb232cb71c071094836809"} Jun 02 01:12:16.508592 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:16.508554 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:16.508998 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:16.508676 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:16.508998 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:16.508730 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls podName:506f5f2f-f1e5-4211-943a-a81fb5904abb nodeName:}" failed. No retries permitted until 2026-06-02 01:12:32.5087161 +0000 UTC m=+111.289635117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-lg6fp" (UID: "506f5f2f-f1e5-4211-943a-a81fb5904abb") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:12:16.710070 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:16.710014 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:16.710305 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:16.710162 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:12:16.710305 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:16.710229 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls podName:e8037f60-1de8-4e23-b47e-e0a912cf7723 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:32.710213751 +0000 UTC m=+111.491132768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-4ggrl" (UID: "e8037f60-1de8-4e23-b47e-e0a912cf7723") : secret "samples-operator-tls" not found Jun 02 01:12:17.004253 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:17.004169 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-fgdl6" event={"ID":"ad1cadfc-dafa-4dda-9803-1602d52660cd","Type":"ContainerStarted","Data":"398e144602b5e757d911bebdcb0d82fe64e90312147ec170414a07747831532a"} Jun 02 01:12:17.019342 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:17.019287 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-fgdl6" podStartSLOduration=1.522571601 podStartE2EDuration="4.019268786s" podCreationTimestamp="2026-06-02 01:12:13 +0000 UTC" firstStartedPulling="2026-06-02 01:12:13.793543623 +0000 UTC m=+92.574462639" lastFinishedPulling="2026-06-02 01:12:16.290240802 +0000 UTC m=+95.071159824" observedRunningTime="2026-06-02 01:12:17.018305996 +0000 UTC m=+95.799225047" watchObservedRunningTime="2026-06-02 01:12:17.019268786 +0000 UTC m=+95.800187826" Jun 02 01:12:17.919833 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:17.919788 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:17.920262 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:17.919939 2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:12:17.920262 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:17.919952 2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b8f64669c-xnx6s: secret "image-registry-tls" not found Jun 02 01:12:17.920262 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:17.920007 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls podName:4f0f6b3c-260f-4d95-bf68-5b78af196660 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:33.919988536 +0000 UTC m=+112.700907553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls") pod "image-registry-6b8f64669c-xnx6s" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660") : secret "image-registry-tls" not found Jun 02 01:12:19.032721 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:19.032626 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:12:19.032721 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:19.032682 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:12:19.033241 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:19.032779 2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:12:19.033241 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:19.032787 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:12:19.033241 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:19.032848 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert podName:a6d4f294-bdec-4d4b-893c-c9694026c804 nodeName:}" failed. No retries permitted until 2026-06-02 01:13:23.032830859 +0000 UTC m=+161.813749879 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert") pod "ingress-canary-fhkr2" (UID: "a6d4f294-bdec-4d4b-893c-c9694026c804") : secret "canary-serving-cert" not found Jun 02 01:12:19.033241 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:19.032862 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls podName:eb73dfb9-e19a-4a9e-9d70-24a508ba0031 nodeName:}" failed. No retries permitted until 2026-06-02 01:13:23.032856428 +0000 UTC m=+161.813775445 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls") pod "dns-default-j4c5m" (UID: "eb73dfb9-e19a-4a9e-9d70-24a508ba0031") : secret "dns-default-metrics-tls" not found Jun 02 01:12:21.948718 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:21.948689 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n5qxb" Jun 02 01:12:24.690253 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:24.690219 2578 scope.go:117] "RemoveContainer" containerID="fd7d5ac8db9686a86b9ae1efc39baf52b7b1365a1b757eb6bcc0ae96764b4192" Jun 02 01:12:25.025869 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:25.025792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:12:25.025869 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:25.025865 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" event={"ID":"ea4507ac-5777-4af3-9120-359832712f5d","Type":"ContainerStarted","Data":"c02f0b604312d1a7d9ab665ea62c8b13fdca2d20ae6dd9f94e8820c4bfe573ec"} Jun 02 01:12:25.026163 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:25.026147 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:25.043952 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:25.043882 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" podStartSLOduration=22.814928027 podStartE2EDuration="25.043866649s" podCreationTimestamp="2026-06-02 01:12:00 +0000 UTC" firstStartedPulling="2026-06-02 01:12:01.361180085 +0000 UTC m=+80.142099102" lastFinishedPulling="2026-06-02 01:12:03.590118695 +0000 UTC m=+82.371037724" observedRunningTime="2026-06-02 01:12:25.043105124 +0000 UTC m=+103.824024166" watchObservedRunningTime="2026-06-02 01:12:25.043866649 +0000 UTC m=+103.824785691" Jun 02 01:12:25.178964 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:25.178933 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-8l28t" Jun 02 01:12:32.540819 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:32.540757 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:32.543145 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:32.543119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/506f5f2f-f1e5-4211-943a-a81fb5904abb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-lg6fp\" (UID: \"506f5f2f-f1e5-4211-943a-a81fb5904abb\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:32.742894 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:32.742834 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:32.745364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:32.745339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8037f60-1de8-4e23-b47e-e0a912cf7723-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-4ggrl\" (UID: \"e8037f60-1de8-4e23-b47e-e0a912cf7723\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:32.821150 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:32.821118 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" Jun 02 01:12:32.944984 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:32.944958 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp"] Jun 02 01:12:32.947469 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:32.947439 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506f5f2f_f1e5_4211_943a_a81fb5904abb.slice/crio-1903e43860050c3efaf07abe412c8549115fc1a1b0893f6df40bce3058338339 WatchSource:0}: Error finding container 1903e43860050c3efaf07abe412c8549115fc1a1b0893f6df40bce3058338339: Status 404 returned error can't find the container with id 1903e43860050c3efaf07abe412c8549115fc1a1b0893f6df40bce3058338339 Jun 02 01:12:32.976284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:32.976249 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b8f64669c-xnx6s"] Jun 02 01:12:32.976461 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:32.976441 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" podUID="4f0f6b3c-260f-4d95-bf68-5b78af196660" Jun 02 01:12:33.017551 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.017513 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zmng2"] Jun 02 01:12:33.022010 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.021990 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.026198 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.025299 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:12:33.026198 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.025498 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:12:33.026379 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.026349 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:12:33.027087 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.026594 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:12:33.027087 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.026631 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7cfzm\"" Jun 02 01:12:33.032096 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.032060 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" Jun 02 01:12:33.033738 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.033717 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zmng2"] Jun 02 01:12:33.043945 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.043902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ca525bf-5363-48b2-92ec-a4046da15baa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.044058 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.043966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ca525bf-5363-48b2-92ec-a4046da15baa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.044058 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.043995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdkrl\" (UniqueName: \"kubernetes.io/projected/3ca525bf-5363-48b2-92ec-a4046da15baa-kube-api-access-vdkrl\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.044058 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.044025 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ca525bf-5363-48b2-92ec-a4046da15baa-crio-socket\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.044215 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.044159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ca525bf-5363-48b2-92ec-a4046da15baa-data-volume\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.046708 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.046543 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" event={"ID":"506f5f2f-f1e5-4211-943a-a81fb5904abb","Type":"ContainerStarted","Data":"1903e43860050c3efaf07abe412c8549115fc1a1b0893f6df40bce3058338339"} Jun 02 01:12:33.046708 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.046609 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:33.050816 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.050789 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:33.136766 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.136734 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d64bb5885-krsdr"] Jun 02 01:12:33.141263 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.141241 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.144780 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.144755 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-bound-sa-token\") pod \"4f0f6b3c-260f-4d95-bf68-5b78af196660\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " Jun 02 01:12:33.144894 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.144796 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-installation-pull-secrets\") pod \"4f0f6b3c-260f-4d95-bf68-5b78af196660\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " Jun 02 01:12:33.144894 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.144827 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms855\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-kube-api-access-ms855\") pod \"4f0f6b3c-260f-4d95-bf68-5b78af196660\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " Jun 02 01:12:33.144894 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.144869 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-trusted-ca\") pod \"4f0f6b3c-260f-4d95-bf68-5b78af196660\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " Jun 02 01:12:33.145079 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.144918 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-image-registry-private-configuration\") pod \"4f0f6b3c-260f-4d95-bf68-5b78af196660\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " Jun 02 01:12:33.145079 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.144947 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-certificates\") pod \"4f0f6b3c-260f-4d95-bf68-5b78af196660\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " Jun 02 01:12:33.145079 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.144975 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f0f6b3c-260f-4d95-bf68-5b78af196660-ca-trust-extracted\") pod \"4f0f6b3c-260f-4d95-bf68-5b78af196660\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " Jun 02 01:12:33.145227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b7be1c5-0162-4b8b-863c-4a10e89710a2-image-registry-private-configuration\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.145227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145129 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ca525bf-5363-48b2-92ec-a4046da15baa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.145227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b7be1c5-0162-4b8b-863c-4a10e89710a2-trusted-ca\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.145227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145195 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ca525bf-5363-48b2-92ec-a4046da15baa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.145227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145225 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdkrl\" (UniqueName: \"kubernetes.io/projected/3ca525bf-5363-48b2-92ec-a4046da15baa-kube-api-access-vdkrl\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.145461 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145260 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ca525bf-5363-48b2-92ec-a4046da15baa-crio-socket\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.145461 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-registry-tls\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.145461 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b7be1c5-0162-4b8b-863c-4a10e89710a2-installation-pull-secrets\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.145461 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145383 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ca525bf-5363-48b2-92ec-a4046da15baa-data-volume\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.145461 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-bound-sa-token\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.145461 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145450 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4f0f6b3c-260f-4d95-bf68-5b78af196660" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:12:33.145742 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145477 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b7be1c5-0162-4b8b-863c-4a10e89710a2-ca-trust-extracted\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.145742 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkbqq\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-kube-api-access-rkbqq\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.145742 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ca525bf-5363-48b2-92ec-a4046da15baa-crio-socket\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.145742 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.145551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b7be1c5-0162-4b8b-863c-4a10e89710a2-registry-certificates\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.146199 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.146171 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4f0f6b3c-260f-4d95-bf68-5b78af196660" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:12:33.146285 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.146222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ca525bf-5363-48b2-92ec-a4046da15baa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.146420 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.146395 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f0f6b3c-260f-4d95-bf68-5b78af196660-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4f0f6b3c-260f-4d95-bf68-5b78af196660" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:12:33.146500 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.146478 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ca525bf-5363-48b2-92ec-a4046da15baa-data-volume\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.146627 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.146607 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-trusted-ca\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:12:33.147557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.147512 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4f0f6b3c-260f-4d95-bf68-5b78af196660" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:12:33.147666 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.147588 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4f0f6b3c-260f-4d95-bf68-5b78af196660" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:12:33.148729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.148681 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-kube-api-access-ms855" (OuterVolumeSpecName: "kube-api-access-ms855") pod "4f0f6b3c-260f-4d95-bf68-5b78af196660" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660"). InnerVolumeSpecName "kube-api-access-ms855". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:12:33.148729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.148698 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ca525bf-5363-48b2-92ec-a4046da15baa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.149138 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.149097 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4f0f6b3c-260f-4d95-bf68-5b78af196660" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:12:33.152733 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.152712 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d64bb5885-krsdr"] Jun 02 01:12:33.155592 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.155564 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdkrl\" (UniqueName: \"kubernetes.io/projected/3ca525bf-5363-48b2-92ec-a4046da15baa-kube-api-access-vdkrl\") pod \"insights-runtime-extractor-zmng2\" (UID: \"3ca525bf-5363-48b2-92ec-a4046da15baa\") " pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.185487 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.185458 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl"] Jun 02 01:12:33.247857 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.247816 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b7be1c5-0162-4b8b-863c-4a10e89710a2-installation-pull-secrets\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.247857 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.247861 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-bound-sa-token\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.248080 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.247893 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b7be1c5-0162-4b8b-863c-4a10e89710a2-ca-trust-extracted\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.248138 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248085 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkbqq\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-kube-api-access-rkbqq\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.248138 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248122 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b7be1c5-0162-4b8b-863c-4a10e89710a2-registry-certificates\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.248241 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248178 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b7be1c5-0162-4b8b-863c-4a10e89710a2-image-registry-private-configuration\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.248241 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248217 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b7be1c5-0162-4b8b-863c-4a10e89710a2-trusted-ca\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.248340 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248263 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b7be1c5-0162-4b8b-863c-4a10e89710a2-ca-trust-extracted\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.248340 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248281 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-registry-tls\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.248340 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248323 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-bound-sa-token\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:12:33.248340 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248337 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-installation-pull-secrets\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:12:33.248585 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248351 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms855\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-kube-api-access-ms855\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:12:33.248585 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248369 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4f0f6b3c-260f-4d95-bf68-5b78af196660-image-registry-private-configuration\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:12:33.248585 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248390 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-certificates\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:12:33.248585 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248406 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4f0f6b3c-260f-4d95-bf68-5b78af196660-ca-trust-extracted\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:12:33.249023 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.248998 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b7be1c5-0162-4b8b-863c-4a10e89710a2-registry-certificates\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.249248 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.249229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b7be1c5-0162-4b8b-863c-4a10e89710a2-trusted-ca\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.250397 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.250369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b7be1c5-0162-4b8b-863c-4a10e89710a2-installation-pull-secrets\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.250635 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.250616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b7be1c5-0162-4b8b-863c-4a10e89710a2-image-registry-private-configuration\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.250763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.250744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-registry-tls\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.255435 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.255410 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-bound-sa-token\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.255809 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.255794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkbqq\" (UniqueName: \"kubernetes.io/projected/7b7be1c5-0162-4b8b-863c-4a10e89710a2-kube-api-access-rkbqq\") pod \"image-registry-5d64bb5885-krsdr\" (UID: \"7b7be1c5-0162-4b8b-863c-4a10e89710a2\") " pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.335095 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.335002 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zmng2" Jun 02 01:12:33.454681 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.454641 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:33.461378 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.461354 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zmng2"] Jun 02 01:12:33.465962 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:33.465930 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca525bf_5363_48b2_92ec_a4046da15baa.slice/crio-581a719f04d443694141046d85da40afb6b95276129c87109757ee14711f71ec WatchSource:0}: Error finding container 581a719f04d443694141046d85da40afb6b95276129c87109757ee14711f71ec: Status 404 returned error can't find the container with id 581a719f04d443694141046d85da40afb6b95276129c87109757ee14711f71ec Jun 02 01:12:33.491002 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.490211 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-744ccdcc94-57p2f"] Jun 02 01:12:33.494761 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.494283 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.497720 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.497491 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:12:33.497720 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.497594 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:12:33.497871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.497733 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-45c4f\"" Jun 02 01:12:33.497871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.497781 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:12:33.498178 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.497865 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:12:33.498178 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.497903 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:12:33.498178 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.497865 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:12:33.498178 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.498068 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:12:33.503751 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.503646 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744ccdcc94-57p2f"] Jun 02 01:12:33.551947 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.551704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-service-ca\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.551947 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.551763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-serving-cert\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.551947 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.551794 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-oauth-serving-cert\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.551947 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.551836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-config\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.551947 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.551875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-oauth-config\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.552522 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.551989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb8nj\" (UniqueName: \"kubernetes.io/projected/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-kube-api-access-fb8nj\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.603282 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.603210 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d64bb5885-krsdr"] Jun 02 01:12:33.606685 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:33.606654 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b7be1c5_0162_4b8b_863c_4a10e89710a2.slice/crio-9a6209d3f5cc66753d8e9f0a4c6ecec6a1b18d406a598e61f3b3627125b92d0e WatchSource:0}: Error finding container 9a6209d3f5cc66753d8e9f0a4c6ecec6a1b18d406a598e61f3b3627125b92d0e: Status 404 returned error can't find the container with id 9a6209d3f5cc66753d8e9f0a4c6ecec6a1b18d406a598e61f3b3627125b92d0e Jun 02 01:12:33.653014 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.652970 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-service-ca\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.653155 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.653049 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-serving-cert\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.653155 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.653107 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-oauth-serving-cert\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.654182 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.653383 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-config\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.654182 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.653712 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-oauth-config\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.654182 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.653769 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fb8nj\" (UniqueName: \"kubernetes.io/projected/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-kube-api-access-fb8nj\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.654182 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.653895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-service-ca\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.654182 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.654061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-oauth-serving-cert\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.656140 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.654260 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-config\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.658234 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.658215 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-oauth-config\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.658601 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.658555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-serving-cert\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.662183 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.662162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb8nj\" (UniqueName: \"kubernetes.io/projected/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-kube-api-access-fb8nj\") pod \"console-744ccdcc94-57p2f\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.808597 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.808484 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:33.956992 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.956944 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:33.959970 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.959901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"image-registry-6b8f64669c-xnx6s\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:33.964214 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:33.964185 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-744ccdcc94-57p2f"] Jun 02 01:12:33.968893 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:33.968864 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf456cea8_659e_4d4b_bdfb_8bcfee5ceba6.slice/crio-21706ada22c2c795c1d10f3b1165e57c80a316a054d9cff6fa0e2d91b7022395 WatchSource:0}: Error finding container 21706ada22c2c795c1d10f3b1165e57c80a316a054d9cff6fa0e2d91b7022395: Status 404 returned error can't find the container with id 21706ada22c2c795c1d10f3b1165e57c80a316a054d9cff6fa0e2d91b7022395 Jun 02 01:12:34.052324 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.052221 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" event={"ID":"7b7be1c5-0162-4b8b-863c-4a10e89710a2","Type":"ContainerStarted","Data":"9dba46fd9a88fa93ff98747ea58e1403b38728359715bba3d83b5587696b9788"} Jun 02 01:12:34.052324 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.052270 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" event={"ID":"7b7be1c5-0162-4b8b-863c-4a10e89710a2","Type":"ContainerStarted","Data":"9a6209d3f5cc66753d8e9f0a4c6ecec6a1b18d406a598e61f3b3627125b92d0e"} Jun 02 01:12:34.052584 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.052386 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:34.053830 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.053800 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" event={"ID":"e8037f60-1de8-4e23-b47e-e0a912cf7723","Type":"ContainerStarted","Data":"57536b4e793234948a20d35e5ad641a33a3e2566f47ecc03a524307a019b8b48"} Jun 02 01:12:34.055810 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.055772 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744ccdcc94-57p2f" event={"ID":"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6","Type":"ContainerStarted","Data":"21706ada22c2c795c1d10f3b1165e57c80a316a054d9cff6fa0e2d91b7022395"} Jun 02 01:12:34.057463 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.057439 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") pod \"4f0f6b3c-260f-4d95-bf68-5b78af196660\" (UID: \"4f0f6b3c-260f-4d95-bf68-5b78af196660\") " Jun 02 01:12:34.059094 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.059072 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b8f64669c-xnx6s" Jun 02 01:12:34.059219 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.059069 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmng2" event={"ID":"3ca525bf-5363-48b2-92ec-a4046da15baa","Type":"ContainerStarted","Data":"89c4583bcc86975a4abdcaa70ab2d080ac2f7fd659e5e0d120eaa015a18ac1f2"} Jun 02 01:12:34.059295 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.059228 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmng2" event={"ID":"3ca525bf-5363-48b2-92ec-a4046da15baa","Type":"ContainerStarted","Data":"581a719f04d443694141046d85da40afb6b95276129c87109757ee14711f71ec"} Jun 02 01:12:34.061501 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.061461 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4f0f6b3c-260f-4d95-bf68-5b78af196660" (UID: "4f0f6b3c-260f-4d95-bf68-5b78af196660"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:12:34.070188 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.069387 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" podStartSLOduration=1.069371792 podStartE2EDuration="1.069371792s" podCreationTimestamp="2026-06-02 01:12:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:12:34.068697788 +0000 UTC m=+112.849616829" watchObservedRunningTime="2026-06-02 01:12:34.069371792 +0000 UTC m=+112.850290832" Jun 02 01:12:34.159255 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.158931 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4f0f6b3c-260f-4d95-bf68-5b78af196660-registry-tls\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:12:34.387563 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.387531 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b8f64669c-xnx6s"] Jun 02 01:12:34.391728 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:34.391701 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b8f64669c-xnx6s"] Jun 02 01:12:35.695340 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:35.695260 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f0f6b3c-260f-4d95-bf68-5b78af196660" path="/var/lib/kubelet/pods/4f0f6b3c-260f-4d95-bf68-5b78af196660/volumes" Jun 02 01:12:36.068369 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:36.068291 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" event={"ID":"e8037f60-1de8-4e23-b47e-e0a912cf7723","Type":"ContainerStarted","Data":"ff6c912ff02295a1b19c70dfce5b709c8725f8d1be59bfd24a433878e690701a"} Jun 02 01:12:36.068369 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:36.068331 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" event={"ID":"e8037f60-1de8-4e23-b47e-e0a912cf7723","Type":"ContainerStarted","Data":"5ce18ed21b56a1efb964d729414b0ebecb5f482903401fb8c75de8ab148567cf"} Jun 02 01:12:36.069809 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:36.069769 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" event={"ID":"506f5f2f-f1e5-4211-943a-a81fb5904abb","Type":"ContainerStarted","Data":"0ee8223d1b7fcf3f7327d94e26ef08988c3ade1a7c8107dddbada97861be7c56"} Jun 02 01:12:36.072948 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:36.072882 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmng2" event={"ID":"3ca525bf-5363-48b2-92ec-a4046da15baa","Type":"ContainerStarted","Data":"6db4f79a0d2f1a50563d465488025363eebf81819079345bffd83f4f6931a6e5"} Jun 02 01:12:36.084803 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:36.084389 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-4ggrl" podStartSLOduration=34.092658334 podStartE2EDuration="36.08437194s" podCreationTimestamp="2026-06-02 01:12:00 +0000 UTC" firstStartedPulling="2026-06-02 01:12:33.220278806 +0000 UTC m=+112.001197826" lastFinishedPulling="2026-06-02 01:12:35.211992406 +0000 UTC m=+113.992911432" observedRunningTime="2026-06-02 01:12:36.083727407 +0000 UTC m=+114.864646446" watchObservedRunningTime="2026-06-02 01:12:36.08437194 +0000 UTC m=+114.865290983" Jun 02 01:12:36.099510 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:36.099453 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-lg6fp" podStartSLOduration=33.838506542 podStartE2EDuration="36.099437306s" podCreationTimestamp="2026-06-02 01:12:00 +0000 UTC" firstStartedPulling="2026-06-02 01:12:32.949188901 +0000 UTC m=+111.730107925" lastFinishedPulling="2026-06-02 01:12:35.210119671 +0000 UTC m=+113.991038689" observedRunningTime="2026-06-02 01:12:36.09875838 +0000 UTC m=+114.879677420" watchObservedRunningTime="2026-06-02 01:12:36.099437306 +0000 UTC m=+114.880356374" Jun 02 01:12:39.085646 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:39.085605 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744ccdcc94-57p2f" event={"ID":"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6","Type":"ContainerStarted","Data":"91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3"} Jun 02 01:12:39.087342 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:39.087309 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmng2" event={"ID":"3ca525bf-5363-48b2-92ec-a4046da15baa","Type":"ContainerStarted","Data":"8fb35f1dd32c38441f72c9c22b9d1bb15c582a2152741c2519761b5ead83e552"} Jun 02 01:12:39.104255 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:39.104214 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-744ccdcc94-57p2f" podStartSLOduration=1.857366917 podStartE2EDuration="6.104200576s" podCreationTimestamp="2026-06-02 01:12:33 +0000 UTC" firstStartedPulling="2026-06-02 01:12:33.970728513 +0000 UTC m=+112.751647531" lastFinishedPulling="2026-06-02 01:12:38.217562169 +0000 UTC m=+116.998481190" observedRunningTime="2026-06-02 01:12:39.103609729 +0000 UTC m=+117.884528768" watchObservedRunningTime="2026-06-02 01:12:39.104200576 +0000 UTC m=+117.885119665" Jun 02 01:12:39.118888 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:39.118844 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zmng2" podStartSLOduration=2.443585832 podStartE2EDuration="7.118830733s" podCreationTimestamp="2026-06-02 01:12:32 +0000 UTC" firstStartedPulling="2026-06-02 01:12:33.536467273 +0000 UTC m=+112.317386297" lastFinishedPulling="2026-06-02 01:12:38.211712166 +0000 UTC m=+116.992631198" observedRunningTime="2026-06-02 01:12:39.118021841 +0000 UTC m=+117.898940905" watchObservedRunningTime="2026-06-02 01:12:39.118830733 +0000 UTC m=+117.899749817" Jun 02 01:12:43.809512 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:43.809477 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:43.809995 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:43.809757 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:43.810812 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:43.810787 2578 patch_prober.go:28] interesting pod/console-744ccdcc94-57p2f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jun 02 01:12:43.810891 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:43.810849 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-744ccdcc94-57p2f" podUID="f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jun 02 01:12:45.117185 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.117154 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-nf9pq"] Jun 02 01:12:45.120285 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.120260 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.120492 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.120473 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pgflg"] Jun 02 01:12:45.122467 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.122445 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 01:12:45.122783 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.122768 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.124114 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.124093 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 01:12:45.124226 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.124108 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:12:45.124294 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.124141 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bvg44\"" Jun 02 01:12:45.125062 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.125045 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:12:45.125333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.125158 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:12:45.125333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.125061 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:12:45.125333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.125138 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mpn8j\"" Jun 02 01:12:45.131364 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.131347 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-nf9pq"] Jun 02 01:12:45.159221 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-sys\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159385 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52678558-0c90-4046-a735-3ebde58594e0-metrics-client-ca\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159385 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-wtmp\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159385 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btxb5\" (UniqueName: \"kubernetes.io/projected/52678558-0c90-4046-a735-3ebde58594e0-kube-api-access-btxb5\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159502 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.159502 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.159580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159656 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-tls\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159656 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsrtc\" (UniqueName: \"kubernetes.io/projected/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-kube-api-access-rsrtc\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.159656 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-textfile\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159765 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159715 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-root\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.159809 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.159772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.260928 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.260873 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261130 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.260956 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261130 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.260987 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-tls\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261130 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261022 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsrtc\" (UniqueName: \"kubernetes.io/projected/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-kube-api-access-rsrtc\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.261130 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261051 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-textfile\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261130 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261121 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-root\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261388 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261152 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.261388 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261187 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-sys\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261388 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261221 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52678558-0c90-4046-a735-3ebde58594e0-metrics-client-ca\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261388 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261250 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-wtmp\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261388 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261279 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btxb5\" (UniqueName: \"kubernetes.io/projected/52678558-0c90-4046-a735-3ebde58594e0-kube-api-access-btxb5\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261388 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261334 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.261388 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261362 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.261715 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:45.261482 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 01:12:45.261715 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:45.261551 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-tls podName:a083563b-48a0-4d4f-a2f6-6b494b8fdb72 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:45.761531317 +0000 UTC m=+124.542450342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-nf9pq" (UID: "a083563b-48a0-4d4f-a2f6-6b494b8fdb72") : secret "openshift-state-metrics-tls" not found Jun 02 01:12:45.261715 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261652 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261906 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261802 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-root\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.261906 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:45.261886 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 01:12:45.261906 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.261890 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-textfile\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.262123 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:12:45.261953 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-tls podName:52678558-0c90-4046-a735-3ebde58594e0 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:45.76193908 +0000 UTC m=+124.542858104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-tls") pod "node-exporter-pgflg" (UID: "52678558-0c90-4046-a735-3ebde58594e0") : secret "node-exporter-tls" not found Jun 02 01:12:45.262123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.262075 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-wtmp\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.262123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.262119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52678558-0c90-4046-a735-3ebde58594e0-sys\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.262308 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.262143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.262577 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.262555 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52678558-0c90-4046-a735-3ebde58594e0-metrics-client-ca\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.264516 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.264460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.264846 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.264824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.271600 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.271575 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsrtc\" (UniqueName: \"kubernetes.io/projected/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-kube-api-access-rsrtc\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.272102 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.272080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btxb5\" (UniqueName: \"kubernetes.io/projected/52678558-0c90-4046-a735-3ebde58594e0-kube-api-access-btxb5\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.765960 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.765890 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-tls\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.766171 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.765997 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:45.768339 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.768317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52678558-0c90-4046-a735-3ebde58594e0-node-exporter-tls\") pod \"node-exporter-pgflg\" (UID: \"52678558-0c90-4046-a735-3ebde58594e0\") " pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:45.768417 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:45.768379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a083563b-48a0-4d4f-a2f6-6b494b8fdb72-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-nf9pq\" (UID: \"a083563b-48a0-4d4f-a2f6-6b494b8fdb72\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:46.035601 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:46.035522 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" Jun 02 01:12:46.042368 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:46.042341 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pgflg" Jun 02 01:12:46.051151 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:46.051125 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52678558_0c90_4046_a735_3ebde58594e0.slice/crio-763329457a1d8dee4062313a406b8ddd5e63c10650a64cb29703e289b07ab881 WatchSource:0}: Error finding container 763329457a1d8dee4062313a406b8ddd5e63c10650a64cb29703e289b07ab881: Status 404 returned error can't find the container with id 763329457a1d8dee4062313a406b8ddd5e63c10650a64cb29703e289b07ab881 Jun 02 01:12:46.108230 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:46.108195 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pgflg" event={"ID":"52678558-0c90-4046-a735-3ebde58594e0","Type":"ContainerStarted","Data":"763329457a1d8dee4062313a406b8ddd5e63c10650a64cb29703e289b07ab881"} Jun 02 01:12:46.165590 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:46.165561 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-nf9pq"] Jun 02 01:12:46.168326 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:46.168300 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda083563b_48a0_4d4f_a2f6_6b494b8fdb72.slice/crio-0c74eef69cba1fe8369304fdd485be2e10b5fca3cd2ac4bd5d5054586b2f73a9 WatchSource:0}: Error finding container 0c74eef69cba1fe8369304fdd485be2e10b5fca3cd2ac4bd5d5054586b2f73a9: Status 404 returned error can't find the container with id 0c74eef69cba1fe8369304fdd485be2e10b5fca3cd2ac4bd5d5054586b2f73a9 Jun 02 01:12:47.112818 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.112778 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" event={"ID":"a083563b-48a0-4d4f-a2f6-6b494b8fdb72","Type":"ContainerStarted","Data":"8240e7a61e83ff4bc4967af23b5b7433f94177ea4d73564ec995eac95d2cfee2"} Jun 02 01:12:47.112999 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.112824 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" event={"ID":"a083563b-48a0-4d4f-a2f6-6b494b8fdb72","Type":"ContainerStarted","Data":"2d8a79769ffa9d40051cb6ad37065e380541c1d4a10fc24c5350e4cf3ea04d3e"} Jun 02 01:12:47.112999 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.112837 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" event={"ID":"a083563b-48a0-4d4f-a2f6-6b494b8fdb72","Type":"ContainerStarted","Data":"0c74eef69cba1fe8369304fdd485be2e10b5fca3cd2ac4bd5d5054586b2f73a9"} Jun 02 01:12:47.211067 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.211041 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79cdc8b-m8v9x"] Jun 02 01:12:47.213424 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.213405 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.215820 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.215796 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 01:12:47.216156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.215966 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t5b26\"" Jun 02 01:12:47.216156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.216052 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 01:12:47.216156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.216068 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 01:12:47.216156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.216086 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 01:12:47.216156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.216106 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7q0ec8l854i86\"" Jun 02 01:12:47.216587 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.216571 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 01:12:47.225528 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.225506 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79cdc8b-m8v9x"] Jun 02 01:12:47.278095 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.278065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c72v9\" (UniqueName: \"kubernetes.io/projected/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-kube-api-access-c72v9\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.278208 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.278103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-grpc-tls\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.278208 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.278164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-metrics-client-ca\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.278299 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.278206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.278299 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.278233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.278393 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.278316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-tls\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.278477 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.278455 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.278534 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.278497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.379306 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.379272 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.379306 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.379307 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.379538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.379331 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c72v9\" (UniqueName: \"kubernetes.io/projected/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-kube-api-access-c72v9\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.379538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.379360 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-grpc-tls\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.379538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.379392 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-metrics-client-ca\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.379538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.379431 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.379538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.379463 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.379538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.379512 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-tls\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.380334 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.380304 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-metrics-client-ca\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.382134 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.382105 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.382354 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.382330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.382436 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.382405 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.382497 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.382466 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-tls\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.382550 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.382523 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.382596 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.382542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-secret-grpc-tls\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.386500 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.386481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c72v9\" (UniqueName: \"kubernetes.io/projected/7438cb1b-3a84-4f67-ab88-414c1ae1a1e1-kube-api-access-c72v9\") pod \"thanos-querier-79cdc8b-m8v9x\" (UID: \"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1\") " pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.523422 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.523335 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:47.650729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:47.650701 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79cdc8b-m8v9x"] Jun 02 01:12:47.654573 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:47.654544 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7438cb1b_3a84_4f67_ab88_414c1ae1a1e1.slice/crio-59b00d9099a17ec8fa8e61bf671a96f7f6b6be7c3d5ecf150d63bacbdbb0d2a3 WatchSource:0}: Error finding container 59b00d9099a17ec8fa8e61bf671a96f7f6b6be7c3d5ecf150d63bacbdbb0d2a3: Status 404 returned error can't find the container with id 59b00d9099a17ec8fa8e61bf671a96f7f6b6be7c3d5ecf150d63bacbdbb0d2a3 Jun 02 01:12:48.117531 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:48.117492 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" event={"ID":"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1","Type":"ContainerStarted","Data":"59b00d9099a17ec8fa8e61bf671a96f7f6b6be7c3d5ecf150d63bacbdbb0d2a3"} Jun 02 01:12:48.119079 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:48.119048 2578 generic.go:358] "Generic (PLEG): container finished" podID="52678558-0c90-4046-a735-3ebde58594e0" containerID="bc67d4731c12b65bcdada50a13059228ca13c5fbbd44021c9cdf3ef5ae80cda1" exitCode=0 Jun 02 01:12:48.119225 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:48.119136 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pgflg" event={"ID":"52678558-0c90-4046-a735-3ebde58594e0","Type":"ContainerDied","Data":"bc67d4731c12b65bcdada50a13059228ca13c5fbbd44021c9cdf3ef5ae80cda1"} Jun 02 01:12:48.121871 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:48.121844 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" event={"ID":"a083563b-48a0-4d4f-a2f6-6b494b8fdb72","Type":"ContainerStarted","Data":"62de1fad092d621da008b6fab9d570119e877d4736960cbf219d814b10b8559b"} Jun 02 01:12:48.151117 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:48.151058 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-nf9pq" podStartSLOduration=2.286468487 podStartE2EDuration="3.151039138s" podCreationTimestamp="2026-06-02 01:12:45 +0000 UTC" firstStartedPulling="2026-06-02 01:12:46.300040663 +0000 UTC m=+125.080959684" lastFinishedPulling="2026-06-02 01:12:47.164611318 +0000 UTC m=+125.945530335" observedRunningTime="2026-06-02 01:12:48.148841326 +0000 UTC m=+126.929760366" watchObservedRunningTime="2026-06-02 01:12:48.151039138 +0000 UTC m=+126.931958178" Jun 02 01:12:49.129475 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.129431 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pgflg" event={"ID":"52678558-0c90-4046-a735-3ebde58594e0","Type":"ContainerStarted","Data":"3a5fb17fe63d382e1c78b323916fd27d7e6f6d212006d119fa54fa4a1cde371c"} Jun 02 01:12:49.129475 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.129483 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pgflg" event={"ID":"52678558-0c90-4046-a735-3ebde58594e0","Type":"ContainerStarted","Data":"ecbcf15cbced224c11fbcb2c77da863b8644a4b925e7355dda7e97b1e1e1a4b1"} Jun 02 01:12:49.147968 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.147926 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pgflg" podStartSLOduration=3.271087575 podStartE2EDuration="4.147892938s" podCreationTimestamp="2026-06-02 01:12:45 +0000 UTC" firstStartedPulling="2026-06-02 01:12:46.05309335 +0000 UTC m=+124.834012367" lastFinishedPulling="2026-06-02 01:12:46.929898713 +0000 UTC m=+125.710817730" observedRunningTime="2026-06-02 01:12:49.147170256 +0000 UTC m=+127.928089329" watchObservedRunningTime="2026-06-02 01:12:49.147892938 +0000 UTC m=+127.928811970" Jun 02 01:12:49.537361 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.536994 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b4f8b76fd-mhv76"] Jun 02 01:12:49.539020 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.539003 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.541630 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.541607 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 01:12:49.541630 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.541612 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8un5u5ejnndvb\"" Jun 02 01:12:49.542076 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.542046 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 01:12:49.542174 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.542078 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 01:12:49.542174 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.542125 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-757zs\"" Jun 02 01:12:49.542516 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.542494 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 01:12:49.557097 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.557071 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b4f8b76fd-mhv76"] Jun 02 01:12:49.599169 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.599137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-secret-metrics-server-client-certs\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.599169 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.599178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-client-ca-bundle\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.599415 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.599211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0395-2723-40ce-bb5e-da7652727338-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.599415 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.599270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9ef0395-2723-40ce-bb5e-da7652727338-audit-log\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.599415 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.599297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9ef0395-2723-40ce-bb5e-da7652727338-metrics-server-audit-profiles\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.599562 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.599419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-secret-metrics-server-tls\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.599562 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.599522 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdkps\" (UniqueName: \"kubernetes.io/projected/b9ef0395-2723-40ce-bb5e-da7652727338-kube-api-access-cdkps\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.700763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.700679 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdkps\" (UniqueName: \"kubernetes.io/projected/b9ef0395-2723-40ce-bb5e-da7652727338-kube-api-access-cdkps\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.700763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.700718 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-secret-metrics-server-client-certs\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.701016 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.700843 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-client-ca-bundle\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.701016 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.700900 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0395-2723-40ce-bb5e-da7652727338-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.701016 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.700947 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9ef0395-2723-40ce-bb5e-da7652727338-audit-log\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.701016 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.700973 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9ef0395-2723-40ce-bb5e-da7652727338-metrics-server-audit-profiles\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.701227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.701023 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-secret-metrics-server-tls\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.701360 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.701337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9ef0395-2723-40ce-bb5e-da7652727338-audit-log\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.701673 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.701651 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9ef0395-2723-40ce-bb5e-da7652727338-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.701960 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.701942 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9ef0395-2723-40ce-bb5e-da7652727338-metrics-server-audit-profiles\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.703248 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.703227 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-client-ca-bundle\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.703367 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.703350 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-secret-metrics-server-tls\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.703419 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.703407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9ef0395-2723-40ce-bb5e-da7652727338-secret-metrics-server-client-certs\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.708191 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.708175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdkps\" (UniqueName: \"kubernetes.io/projected/b9ef0395-2723-40ce-bb5e-da7652727338-kube-api-access-cdkps\") pod \"metrics-server-5b4f8b76fd-mhv76\" (UID: \"b9ef0395-2723-40ce-bb5e-da7652727338\") " pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.850611 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.850572 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:12:49.979365 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:49.979302 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b4f8b76fd-mhv76"] Jun 02 01:12:49.981367 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:49.981342 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9ef0395_2723_40ce_bb5e_da7652727338.slice/crio-28da71782b80b31b2f8bee4017af30562c89c6e619ff552bc2b95e2cc1859aff WatchSource:0}: Error finding container 28da71782b80b31b2f8bee4017af30562c89c6e619ff552bc2b95e2cc1859aff: Status 404 returned error can't find the container with id 28da71782b80b31b2f8bee4017af30562c89c6e619ff552bc2b95e2cc1859aff Jun 02 01:12:50.134801 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.134769 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" event={"ID":"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1","Type":"ContainerStarted","Data":"b5de483c8c345ab415a8a75d6462d16e3ca2f4afed333297e92931311edd3026"} Jun 02 01:12:50.135212 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.134810 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" event={"ID":"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1","Type":"ContainerStarted","Data":"ef79b1d29be0bdffb9692b7ed2dac8543a9ca8fb21af9ed46211093c8b75ebcc"} Jun 02 01:12:50.135212 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.134825 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" event={"ID":"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1","Type":"ContainerStarted","Data":"83db1250a0b5630e998a70434f46bb0737d0961a78028954b73a70853d354d65"} Jun 02 01:12:50.136133 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.136108 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" event={"ID":"b9ef0395-2723-40ce-bb5e-da7652727338","Type":"ContainerStarted","Data":"28da71782b80b31b2f8bee4017af30562c89c6e619ff552bc2b95e2cc1859aff"} Jun 02 01:12:50.319895 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.319867 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k"] Jun 02 01:12:50.322557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.322536 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.324632 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.324611 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 01:12:50.324724 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.324706 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 01:12:50.324953 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.324760 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 01:12:50.324953 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.324874 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tk48w\"" Jun 02 01:12:50.325148 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.325133 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 01:12:50.325316 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.325256 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 01:12:50.334453 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.334427 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 01:12:50.337501 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.337093 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k"] Jun 02 01:12:50.407180 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.407145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjsjq\" (UniqueName: \"kubernetes.io/projected/08073dc3-9be8-4449-9355-43506953c1b7-kube-api-access-zjsjq\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.407313 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.407287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-serving-certs-ca-bundle\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.407366 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.407334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-secret-telemeter-client\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.407422 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.407373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.407422 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.407404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.407577 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.407447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-federate-client-tls\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.407577 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.407474 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-telemeter-client-tls\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.407577 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.407531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-metrics-client-ca\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.508879 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.508796 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-serving-certs-ca-bundle\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.508879 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.508842 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-secret-telemeter-client\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.509119 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.508987 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.509119 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.509034 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.509119 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.509087 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-federate-client-tls\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.509279 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.509118 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-telemeter-client-tls\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.509279 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.509143 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-metrics-client-ca\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.509279 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.509232 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjsjq\" (UniqueName: \"kubernetes.io/projected/08073dc3-9be8-4449-9355-43506953c1b7-kube-api-access-zjsjq\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.509688 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.509625 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-serving-certs-ca-bundle\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.510273 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.510223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.510273 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.510245 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08073dc3-9be8-4449-9355-43506953c1b7-metrics-client-ca\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.512327 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.512303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-secret-telemeter-client\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.512864 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.512590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.512997 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.512903 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-federate-client-tls\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.513503 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.513467 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/08073dc3-9be8-4449-9355-43506953c1b7-telemeter-client-tls\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.516957 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.516932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjsjq\" (UniqueName: \"kubernetes.io/projected/08073dc3-9be8-4449-9355-43506953c1b7-kube-api-access-zjsjq\") pod \"telemeter-client-5bcbc5c5b5-bvx8k\" (UID: \"08073dc3-9be8-4449-9355-43506953c1b7\") " pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.640558 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.640516 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" Jun 02 01:12:50.782678 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:50.782589 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k"] Jun 02 01:12:50.787125 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:50.787096 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08073dc3_9be8_4449_9355_43506953c1b7.slice/crio-4852fcff03fccd09da80705163201240b21009db53e9c57cc3e60710b68d7c77 WatchSource:0}: Error finding container 4852fcff03fccd09da80705163201240b21009db53e9c57cc3e60710b68d7c77: Status 404 returned error can't find the container with id 4852fcff03fccd09da80705163201240b21009db53e9c57cc3e60710b68d7c77 Jun 02 01:12:51.140216 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.140177 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" event={"ID":"08073dc3-9be8-4449-9355-43506953c1b7","Type":"ContainerStarted","Data":"4852fcff03fccd09da80705163201240b21009db53e9c57cc3e60710b68d7c77"} Jun 02 01:12:51.143101 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.143065 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" event={"ID":"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1","Type":"ContainerStarted","Data":"c46906050b022cce900aae7aa8c89534bd0df39f22d97da41ea92463b42f0e0d"} Jun 02 01:12:51.143101 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.143095 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" event={"ID":"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1","Type":"ContainerStarted","Data":"e15f0d91d618a03b95c51d9e1a7af8b76853dab527ca0efa4590d294da7f7be5"} Jun 02 01:12:51.143294 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.143107 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" event={"ID":"7438cb1b-3a84-4f67-ab88-414c1ae1a1e1","Type":"ContainerStarted","Data":"2674fa4eb42cc39fa947a3a2116a6506c6cd67895514579794ad0c709423b87a"} Jun 02 01:12:51.143294 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.143272 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:51.162611 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.162555 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" podStartSLOduration=1.563758257 podStartE2EDuration="4.162539865s" podCreationTimestamp="2026-06-02 01:12:47 +0000 UTC" firstStartedPulling="2026-06-02 01:12:47.656446898 +0000 UTC m=+126.437365915" lastFinishedPulling="2026-06-02 01:12:50.255228502 +0000 UTC m=+129.036147523" observedRunningTime="2026-06-02 01:12:51.16103277 +0000 UTC m=+129.941951822" watchObservedRunningTime="2026-06-02 01:12:51.162539865 +0000 UTC m=+129.943458904" Jun 02 01:12:51.420227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.420156 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:12:51.422368 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.422343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/501af48d-d29b-428f-a029-9a0a83619b0b-metrics-certs\") pod \"network-metrics-daemon-gtv6j\" (UID: \"501af48d-d29b-428f-a029-9a0a83619b0b\") " pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:12:51.503519 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.503499 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5956\"" Jun 02 01:12:51.511728 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.511703 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gtv6j" Jun 02 01:12:51.695542 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:51.695455 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gtv6j"] Jun 02 01:12:51.698662 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:51.698637 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501af48d_d29b_428f_a029_9a0a83619b0b.slice/crio-db6388882d7f9a952e3cdf4779800867fd7a3b07cde2b54324cda4c5c8918903 WatchSource:0}: Error finding container db6388882d7f9a952e3cdf4779800867fd7a3b07cde2b54324cda4c5c8918903: Status 404 returned error can't find the container with id db6388882d7f9a952e3cdf4779800867fd7a3b07cde2b54324cda4c5c8918903 Jun 02 01:12:52.151655 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:52.151610 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtv6j" event={"ID":"501af48d-d29b-428f-a029-9a0a83619b0b","Type":"ContainerStarted","Data":"db6388882d7f9a952e3cdf4779800867fd7a3b07cde2b54324cda4c5c8918903"} Jun 02 01:12:52.152946 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:52.152903 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" event={"ID":"b9ef0395-2723-40ce-bb5e-da7652727338","Type":"ContainerStarted","Data":"573f48f69d548c0e444db96420bf0b4ba2861549affd709c7b85fd862cf5d610"} Jun 02 01:12:52.171629 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:52.171587 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" podStartSLOduration=1.7219258530000001 podStartE2EDuration="3.171574232s" podCreationTimestamp="2026-06-02 01:12:49 +0000 UTC" firstStartedPulling="2026-06-02 01:12:49.983241363 +0000 UTC m=+128.764160388" lastFinishedPulling="2026-06-02 01:12:51.432889739 +0000 UTC m=+130.213808767" observedRunningTime="2026-06-02 01:12:52.1706149 +0000 UTC m=+130.951533940" watchObservedRunningTime="2026-06-02 01:12:52.171574232 +0000 UTC m=+130.952493270" Jun 02 01:12:53.458752 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.458718 2578 patch_prober.go:28] interesting pod/image-registry-5d64bb5885-krsdr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 01:12:53.459106 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.458768 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" podUID="7b7be1c5-0162-4b8b-863c-4a10e89710a2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:12:53.814652 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.814620 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:53.819975 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.819944 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:12:53.888433 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.888401 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-744ccdcc94-57p2f"] Jun 02 01:12:53.915281 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.915251 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb97874d8-j82sl"] Jun 02 01:12:53.919681 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.919658 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:53.925750 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.925727 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:12:53.928710 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:53.928691 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb97874d8-j82sl"] Jun 02 01:12:54.043829 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.043782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-oauth-config\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.043829 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.043826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-oauth-serving-cert\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.044091 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.043957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-config\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.044091 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.044002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chfsg\" (UniqueName: \"kubernetes.io/projected/b48a1350-f5ff-46e2-9686-6125c753cf7d-kube-api-access-chfsg\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.044247 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.044137 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-serving-cert\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.044247 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.044169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-service-ca\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.044247 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.044202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-trusted-ca-bundle\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.145007 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.144970 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-trusted-ca-bundle\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.145236 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.145020 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-oauth-config\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.145236 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.145038 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-oauth-serving-cert\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.145236 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.145084 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-config\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.145236 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.145110 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chfsg\" (UniqueName: \"kubernetes.io/projected/b48a1350-f5ff-46e2-9686-6125c753cf7d-kube-api-access-chfsg\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.145236 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.145176 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-serving-cert\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.145236 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.145199 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-service-ca\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.145821 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.145788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-oauth-serving-cert\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.146022 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.146002 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-trusted-ca-bundle\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.146116 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.146095 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-service-ca\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.146173 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.146160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-config\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.147399 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.147378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-oauth-config\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.147705 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.147684 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-serving-cert\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.152860 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.152840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chfsg\" (UniqueName: \"kubernetes.io/projected/b48a1350-f5ff-46e2-9686-6125c753cf7d-kube-api-access-chfsg\") pod \"console-fb97874d8-j82sl\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.160512 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.160478 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" event={"ID":"08073dc3-9be8-4449-9355-43506953c1b7","Type":"ContainerStarted","Data":"c1de97d8c52c7327aafe0a8947b964142ab9fbad182f0774997727e8cf9d7d2d"} Jun 02 01:12:54.161850 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.161830 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtv6j" event={"ID":"501af48d-d29b-428f-a029-9a0a83619b0b","Type":"ContainerStarted","Data":"39c586a109e92ac10eb8752cf9bb5c07fffc7ac36872e735c4d361ca9bdb54f8"} Jun 02 01:12:54.161952 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.161854 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gtv6j" event={"ID":"501af48d-d29b-428f-a029-9a0a83619b0b","Type":"ContainerStarted","Data":"04d66fb455b50d568d5f7b942a6d9d82a282de13b42a6b63b8f334a20e38c08b"} Jun 02 01:12:54.177196 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.177150 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gtv6j" podStartSLOduration=131.660761606 podStartE2EDuration="2m13.177135901s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:12:51.70043996 +0000 UTC m=+130.481358976" lastFinishedPulling="2026-06-02 01:12:53.216814249 +0000 UTC m=+131.997733271" observedRunningTime="2026-06-02 01:12:54.175939551 +0000 UTC m=+132.956858591" watchObservedRunningTime="2026-06-02 01:12:54.177135901 +0000 UTC m=+132.958054942" Jun 02 01:12:54.231378 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.231355 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:12:54.372128 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:54.371980 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb97874d8-j82sl"] Jun 02 01:12:54.374546 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:54.374517 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48a1350_f5ff_46e2_9686_6125c753cf7d.slice/crio-550ffcd5004f1c5b63ee1b7fce9a109df6b0cacab07edfdd8810ad20818f4c64 WatchSource:0}: Error finding container 550ffcd5004f1c5b63ee1b7fce9a109df6b0cacab07edfdd8810ad20818f4c64: Status 404 returned error can't find the container with id 550ffcd5004f1c5b63ee1b7fce9a109df6b0cacab07edfdd8810ad20818f4c64 Jun 02 01:12:55.067331 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.067306 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d64bb5885-krsdr" Jun 02 01:12:55.168449 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.168416 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" event={"ID":"08073dc3-9be8-4449-9355-43506953c1b7","Type":"ContainerStarted","Data":"b8f348c173dcfcc0fdadfa5e6b76db74ba919ddef0a284d07c41f9212afbb952"} Jun 02 01:12:55.168449 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.168453 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" event={"ID":"08073dc3-9be8-4449-9355-43506953c1b7","Type":"ContainerStarted","Data":"39a57a2793b956323ef69514689a48f0a0c331316f138d2caec6aeacb4e5bc06"} Jun 02 01:12:55.169903 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.169872 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb97874d8-j82sl" event={"ID":"b48a1350-f5ff-46e2-9686-6125c753cf7d","Type":"ContainerStarted","Data":"031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5"} Jun 02 01:12:55.170037 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.169933 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb97874d8-j82sl" event={"ID":"b48a1350-f5ff-46e2-9686-6125c753cf7d","Type":"ContainerStarted","Data":"550ffcd5004f1c5b63ee1b7fce9a109df6b0cacab07edfdd8810ad20818f4c64"} Jun 02 01:12:55.187187 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.187102 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5bcbc5c5b5-bvx8k" podStartSLOduration=1.803092544 podStartE2EDuration="5.18708985s" podCreationTimestamp="2026-06-02 01:12:50 +0000 UTC" firstStartedPulling="2026-06-02 01:12:50.789643503 +0000 UTC m=+129.570562533" lastFinishedPulling="2026-06-02 01:12:54.173640816 +0000 UTC m=+132.954559839" observedRunningTime="2026-06-02 01:12:55.185527067 +0000 UTC m=+133.966446103" watchObservedRunningTime="2026-06-02 01:12:55.18708985 +0000 UTC m=+133.968008921" Jun 02 01:12:55.201874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.201825 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-fb97874d8-j82sl" podStartSLOduration=2.201805828 podStartE2EDuration="2.201805828s" podCreationTimestamp="2026-06-02 01:12:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:12:55.200977502 +0000 UTC m=+133.981896541" watchObservedRunningTime="2026-06-02 01:12:55.201805828 +0000 UTC m=+133.982724868" Jun 02 01:12:55.943124 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.943091 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb97874d8-j82sl"] Jun 02 01:12:55.972850 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.972819 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc6cbf849-crkjh"] Jun 02 01:12:55.976057 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.976030 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:55.984522 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:55.984499 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc6cbf849-crkjh"] Jun 02 01:12:56.065041 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.065003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8nm\" (UniqueName: \"kubernetes.io/projected/4eee21e9-2271-4849-aa98-11d29dff3612-kube-api-access-rc8nm\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.065041 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.065045 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-serving-cert\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.065041 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.065061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-oauth-serving-cert\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.065287 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.065128 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-service-ca\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.065287 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.065170 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-trusted-ca-bundle\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.065287 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.065204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-console-config\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.065287 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.065226 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-oauth-config\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.166507 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.166470 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8nm\" (UniqueName: \"kubernetes.io/projected/4eee21e9-2271-4849-aa98-11d29dff3612-kube-api-access-rc8nm\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.166507 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.166507 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-serving-cert\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.167057 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.166528 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-oauth-serving-cert\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.167057 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.166557 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-service-ca\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.167057 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.166599 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-trusted-ca-bundle\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.167057 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.166632 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-console-config\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.167057 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.166663 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-oauth-config\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.167495 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.167473 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-oauth-serving-cert\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.167579 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.167533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-service-ca\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.167579 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.167542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-trusted-ca-bundle\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.168811 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.168791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-console-config\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.169089 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.169067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-oauth-config\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.169200 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.169183 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-serving-cert\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.174699 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.174679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8nm\" (UniqueName: \"kubernetes.io/projected/4eee21e9-2271-4849-aa98-11d29dff3612-kube-api-access-rc8nm\") pod \"console-dc6cbf849-crkjh\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.285186 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.285106 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:12:56.412446 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:56.412417 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc6cbf849-crkjh"] Jun 02 01:12:56.415271 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:12:56.415244 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eee21e9_2271_4849_aa98_11d29dff3612.slice/crio-b488edd5ec939871559ad8e9bfe05adf60b949b6d7fdd888459f203a0e4d975a WatchSource:0}: Error finding container b488edd5ec939871559ad8e9bfe05adf60b949b6d7fdd888459f203a0e4d975a: Status 404 returned error can't find the container with id b488edd5ec939871559ad8e9bfe05adf60b949b6d7fdd888459f203a0e4d975a Jun 02 01:12:57.158836 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:57.158805 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79cdc8b-m8v9x" Jun 02 01:12:57.177954 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:57.177900 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc6cbf849-crkjh" event={"ID":"4eee21e9-2271-4849-aa98-11d29dff3612","Type":"ContainerStarted","Data":"c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b"} Jun 02 01:12:57.178313 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:57.177959 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc6cbf849-crkjh" event={"ID":"4eee21e9-2271-4849-aa98-11d29dff3612","Type":"ContainerStarted","Data":"b488edd5ec939871559ad8e9bfe05adf60b949b6d7fdd888459f203a0e4d975a"} Jun 02 01:12:57.198360 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:12:57.198291 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-dc6cbf849-crkjh" podStartSLOduration=2.19827198 podStartE2EDuration="2.19827198s" podCreationTimestamp="2026-06-02 01:12:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:12:57.197399781 +0000 UTC m=+135.978318822" watchObservedRunningTime="2026-06-02 01:12:57.19827198 +0000 UTC m=+135.979191022" Jun 02 01:13:04.231829 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:04.231791 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:13:06.286071 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:06.286031 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:13:06.286484 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:06.286107 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:13:06.290861 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:06.290836 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:13:07.208905 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:07.208873 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:13:09.850724 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:09.850688 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:13:09.850724 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:09.850734 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:13:18.171500 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:13:18.171453 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-j4c5m" podUID="eb73dfb9-e19a-4a9e-9d70-24a508ba0031" Jun 02 01:13:18.182628 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:13:18.182597 2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fhkr2" podUID="a6d4f294-bdec-4d4b-893c-c9694026c804" Jun 02 01:13:18.235833 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:18.235799 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j4c5m" Jun 02 01:13:20.189717 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.189655 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-744ccdcc94-57p2f" podUID="f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" containerName="console" containerID="cri-o://91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3" gracePeriod=15 Jun 02 01:13:20.429420 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.429399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-744ccdcc94-57p2f_f456cea8-659e-4d4b-bdfb-8bcfee5ceba6/console/0.log" Jun 02 01:13:20.429531 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.429456 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:13:20.485547 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.485465 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-oauth-serving-cert\") pod \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " Jun 02 01:13:20.485547 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.485521 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-serving-cert\") pod \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " Jun 02 01:13:20.485547 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.485542 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-config\") pod \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " Jun 02 01:13:20.485808 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.485590 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-service-ca\") pod \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " Jun 02 01:13:20.485808 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.485611 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-oauth-config\") pod \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " Jun 02 01:13:20.485808 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.485689 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fb8nj\" (UniqueName: \"kubernetes.io/projected/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-kube-api-access-fb8nj\") pod \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\" (UID: \"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6\") " Jun 02 01:13:20.486100 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.486075 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-config" (OuterVolumeSpecName: "console-config") pod "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" (UID: "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:20.486164 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.486100 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" (UID: "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:20.486164 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.486070 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-service-ca" (OuterVolumeSpecName: "service-ca") pod "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" (UID: "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:20.487830 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.487805 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" (UID: "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:13:20.487968 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.487842 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" (UID: "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:13:20.487968 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.487854 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-kube-api-access-fb8nj" (OuterVolumeSpecName: "kube-api-access-fb8nj") pod "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" (UID: "f456cea8-659e-4d4b-bdfb-8bcfee5ceba6"). InnerVolumeSpecName "kube-api-access-fb8nj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:13:20.586401 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.586360 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fb8nj\" (UniqueName: \"kubernetes.io/projected/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-kube-api-access-fb8nj\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:20.586401 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.586392 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-oauth-serving-cert\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:20.586401 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.586408 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-serving-cert\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:20.586638 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.586422 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-config\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:20.586638 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.586434 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-service-ca\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:20.586638 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:20.586445 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6-console-oauth-config\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:21.245956 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.245928 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-744ccdcc94-57p2f_f456cea8-659e-4d4b-bdfb-8bcfee5ceba6/console/0.log" Jun 02 01:13:21.246341 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.245971 2578 generic.go:358] "Generic (PLEG): container finished" podID="f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" containerID="91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3" exitCode=2 Jun 02 01:13:21.246341 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.246058 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744ccdcc94-57p2f" event={"ID":"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6","Type":"ContainerDied","Data":"91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3"} Jun 02 01:13:21.246341 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.246104 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-744ccdcc94-57p2f" event={"ID":"f456cea8-659e-4d4b-bdfb-8bcfee5ceba6","Type":"ContainerDied","Data":"21706ada22c2c795c1d10f3b1165e57c80a316a054d9cff6fa0e2d91b7022395"} Jun 02 01:13:21.246341 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.246119 2578 scope.go:117] "RemoveContainer" containerID="91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3" Jun 02 01:13:21.246341 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.246073 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-744ccdcc94-57p2f" Jun 02 01:13:21.253850 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.253823 2578 scope.go:117] "RemoveContainer" containerID="91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3" Jun 02 01:13:21.254140 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:13:21.254123 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3\": container with ID starting with 91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3 not found: ID does not exist" containerID="91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3" Jun 02 01:13:21.254215 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.254149 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3"} err="failed to get container status \"91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3\": rpc error: code = NotFound desc = could not find container \"91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3\": container with ID starting with 91e6839304f818716f8fc4e8a4637851678ecf87c2ac1718e438c67b4289f9e3 not found: ID does not exist" Jun 02 01:13:21.265858 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.265836 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-744ccdcc94-57p2f"] Jun 02 01:13:21.269442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.269421 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-744ccdcc94-57p2f"] Jun 02 01:13:21.693484 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:21.693451 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" path="/var/lib/kubelet/pods/f456cea8-659e-4d4b-bdfb-8bcfee5ceba6/volumes" Jun 02 01:13:22.203123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.203071 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-fb97874d8-j82sl" podUID="b48a1350-f5ff-46e2-9686-6125c753cf7d" containerName="console" containerID="cri-o://031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5" gracePeriod=15 Jun 02 01:13:22.444362 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.444342 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fb97874d8-j82sl_b48a1350-f5ff-46e2-9686-6125c753cf7d/console/0.log" Jun 02 01:13:22.444664 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.444398 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:13:22.506492 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.506416 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-oauth-config\") pod \"b48a1350-f5ff-46e2-9686-6125c753cf7d\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " Jun 02 01:13:22.506492 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.506478 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-config\") pod \"b48a1350-f5ff-46e2-9686-6125c753cf7d\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " Jun 02 01:13:22.506697 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.506510 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chfsg\" (UniqueName: \"kubernetes.io/projected/b48a1350-f5ff-46e2-9686-6125c753cf7d-kube-api-access-chfsg\") pod \"b48a1350-f5ff-46e2-9686-6125c753cf7d\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " Jun 02 01:13:22.506697 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.506540 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-service-ca\") pod \"b48a1350-f5ff-46e2-9686-6125c753cf7d\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " Jun 02 01:13:22.506697 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.506591 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-serving-cert\") pod \"b48a1350-f5ff-46e2-9686-6125c753cf7d\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " Jun 02 01:13:22.506697 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.506609 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-oauth-serving-cert\") pod \"b48a1350-f5ff-46e2-9686-6125c753cf7d\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " Jun 02 01:13:22.506697 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.506625 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-trusted-ca-bundle\") pod \"b48a1350-f5ff-46e2-9686-6125c753cf7d\" (UID: \"b48a1350-f5ff-46e2-9686-6125c753cf7d\") " Jun 02 01:13:22.507023 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.506996 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-config" (OuterVolumeSpecName: "console-config") pod "b48a1350-f5ff-46e2-9686-6125c753cf7d" (UID: "b48a1350-f5ff-46e2-9686-6125c753cf7d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:22.507090 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.507016 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b48a1350-f5ff-46e2-9686-6125c753cf7d" (UID: "b48a1350-f5ff-46e2-9686-6125c753cf7d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:22.507090 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.507066 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-service-ca" (OuterVolumeSpecName: "service-ca") pod "b48a1350-f5ff-46e2-9686-6125c753cf7d" (UID: "b48a1350-f5ff-46e2-9686-6125c753cf7d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:22.507181 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.507161 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-config\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:22.507227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.507191 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-service-ca\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:22.507227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.507205 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-oauth-serving-cert\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:22.507452 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.507431 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b48a1350-f5ff-46e2-9686-6125c753cf7d" (UID: "b48a1350-f5ff-46e2-9686-6125c753cf7d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:22.508748 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.508713 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b48a1350-f5ff-46e2-9686-6125c753cf7d" (UID: "b48a1350-f5ff-46e2-9686-6125c753cf7d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:13:22.508841 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.508755 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b48a1350-f5ff-46e2-9686-6125c753cf7d" (UID: "b48a1350-f5ff-46e2-9686-6125c753cf7d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:13:22.508841 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.508818 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48a1350-f5ff-46e2-9686-6125c753cf7d-kube-api-access-chfsg" (OuterVolumeSpecName: "kube-api-access-chfsg") pod "b48a1350-f5ff-46e2-9686-6125c753cf7d" (UID: "b48a1350-f5ff-46e2-9686-6125c753cf7d"). InnerVolumeSpecName "kube-api-access-chfsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:13:22.608291 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.608255 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-serving-cert\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:22.608291 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.608284 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b48a1350-f5ff-46e2-9686-6125c753cf7d-trusted-ca-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:22.608291 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.608293 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b48a1350-f5ff-46e2-9686-6125c753cf7d-console-oauth-config\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:22.608291 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:22.608303 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chfsg\" (UniqueName: \"kubernetes.io/projected/b48a1350-f5ff-46e2-9686-6125c753cf7d-kube-api-access-chfsg\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:13:23.113391 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.113352 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:13:23.113545 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.113396 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:13:23.115702 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.115669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb73dfb9-e19a-4a9e-9d70-24a508ba0031-metrics-tls\") pod \"dns-default-j4c5m\" (UID: \"eb73dfb9-e19a-4a9e-9d70-24a508ba0031\") " pod="openshift-dns/dns-default-j4c5m" Jun 02 01:13:23.115801 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.115731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6d4f294-bdec-4d4b-893c-c9694026c804-cert\") pod \"ingress-canary-fhkr2\" (UID: \"a6d4f294-bdec-4d4b-893c-c9694026c804\") " pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:13:23.254006 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.253978 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fb97874d8-j82sl_b48a1350-f5ff-46e2-9686-6125c753cf7d/console/0.log" Jun 02 01:13:23.254156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.254020 2578 generic.go:358] "Generic (PLEG): container finished" podID="b48a1350-f5ff-46e2-9686-6125c753cf7d" containerID="031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5" exitCode=2 Jun 02 01:13:23.254156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.254053 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb97874d8-j82sl" event={"ID":"b48a1350-f5ff-46e2-9686-6125c753cf7d","Type":"ContainerDied","Data":"031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5"} Jun 02 01:13:23.254156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.254083 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb97874d8-j82sl" event={"ID":"b48a1350-f5ff-46e2-9686-6125c753cf7d","Type":"ContainerDied","Data":"550ffcd5004f1c5b63ee1b7fce9a109df6b0cacab07edfdd8810ad20818f4c64"} Jun 02 01:13:23.254156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.254101 2578 scope.go:117] "RemoveContainer" containerID="031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5" Jun 02 01:13:23.254156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.254103 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb97874d8-j82sl" Jun 02 01:13:23.262866 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.262848 2578 scope.go:117] "RemoveContainer" containerID="031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5" Jun 02 01:13:23.263406 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:13:23.263383 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5\": container with ID starting with 031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5 not found: ID does not exist" containerID="031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5" Jun 02 01:13:23.263984 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.263904 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5"} err="failed to get container status \"031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5\": rpc error: code = NotFound desc = could not find container \"031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5\": container with ID starting with 031c460f83271ef80d521434c7a44db1d8317b5804cae67381721552e607bbe5 not found: ID does not exist" Jun 02 01:13:23.276043 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.276024 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb97874d8-j82sl"] Jun 02 01:13:23.279376 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.279359 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb97874d8-j82sl"] Jun 02 01:13:23.338609 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.338588 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n98qz\"" Jun 02 01:13:23.346690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.346671 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j4c5m" Jun 02 01:13:23.476303 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.476274 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j4c5m"] Jun 02 01:13:23.479362 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:13:23.479337 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb73dfb9_e19a_4a9e_9d70_24a508ba0031.slice/crio-4a7031a7366a086faa89210a66252a5bf3ad93117806362c8b18bedf3846fbe2 WatchSource:0}: Error finding container 4a7031a7366a086faa89210a66252a5bf3ad93117806362c8b18bedf3846fbe2: Status 404 returned error can't find the container with id 4a7031a7366a086faa89210a66252a5bf3ad93117806362c8b18bedf3846fbe2 Jun 02 01:13:23.696932 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:23.693855 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b48a1350-f5ff-46e2-9686-6125c753cf7d" path="/var/lib/kubelet/pods/b48a1350-f5ff-46e2-9686-6125c753cf7d/volumes" Jun 02 01:13:24.258205 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:24.258161 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j4c5m" event={"ID":"eb73dfb9-e19a-4a9e-9d70-24a508ba0031","Type":"ContainerStarted","Data":"4a7031a7366a086faa89210a66252a5bf3ad93117806362c8b18bedf3846fbe2"} Jun 02 01:13:25.263987 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:25.263947 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j4c5m" event={"ID":"eb73dfb9-e19a-4a9e-9d70-24a508ba0031","Type":"ContainerStarted","Data":"32956491d2fdd32c31e8d73e0897ba1a15a7973502928fa1dfda8d645a7d7b73"} Jun 02 01:13:25.675752 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:25.675678 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pvvrj_a7db0dfa-6fe7-42e4-92a8-ebb431d579ee/dns-node-resolver/0.log" Jun 02 01:13:26.268555 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:26.268522 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j4c5m" event={"ID":"eb73dfb9-e19a-4a9e-9d70-24a508ba0031","Type":"ContainerStarted","Data":"bfa9acdbf682c13e81a014ad0cd259a050f4fe492ec73a77c24d201eb4fb1992"} Jun 02 01:13:26.268949 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:26.268675 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j4c5m" Jun 02 01:13:26.285216 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:26.285168 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-j4c5m" podStartSLOduration=129.637819294 podStartE2EDuration="2m11.285157006s" podCreationTimestamp="2026-06-02 01:11:15 +0000 UTC" firstStartedPulling="2026-06-02 01:13:23.481016701 +0000 UTC m=+162.261935717" lastFinishedPulling="2026-06-02 01:13:25.128354395 +0000 UTC m=+163.909273429" observedRunningTime="2026-06-02 01:13:26.283502448 +0000 UTC m=+165.064421487" watchObservedRunningTime="2026-06-02 01:13:26.285157006 +0000 UTC m=+165.066076044" Jun 02 01:13:29.856594 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:29.856507 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:13:29.860432 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:29.860406 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b4f8b76fd-mhv76" Jun 02 01:13:30.689670 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:30.689634 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:13:30.692123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:30.692105 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9tnxm\"" Jun 02 01:13:30.700790 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:30.700774 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fhkr2" Jun 02 01:13:30.819885 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:30.819851 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fhkr2"] Jun 02 01:13:30.824975 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:13:30.824944 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d4f294_bdec_4d4b_893c_c9694026c804.slice/crio-823a9204978790d2048df52f728cb377776d4f2d70b544bde1988a106f0f1404 WatchSource:0}: Error finding container 823a9204978790d2048df52f728cb377776d4f2d70b544bde1988a106f0f1404: Status 404 returned error can't find the container with id 823a9204978790d2048df52f728cb377776d4f2d70b544bde1988a106f0f1404 Jun 02 01:13:31.283651 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:31.283616 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fhkr2" event={"ID":"a6d4f294-bdec-4d4b-893c-c9694026c804","Type":"ContainerStarted","Data":"823a9204978790d2048df52f728cb377776d4f2d70b544bde1988a106f0f1404"} Jun 02 01:13:33.290877 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:33.290838 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fhkr2" event={"ID":"a6d4f294-bdec-4d4b-893c-c9694026c804","Type":"ContainerStarted","Data":"c73f411419fc4926a586b00360d749138af4d1d97a22367d2e6a15aa7d2a9c2a"} Jun 02 01:13:33.305572 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:33.305525 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fhkr2" podStartSLOduration=136.540912727 podStartE2EDuration="2m18.305510838s" podCreationTimestamp="2026-06-02 01:11:15 +0000 UTC" firstStartedPulling="2026-06-02 01:13:30.827733413 +0000 UTC m=+169.608652430" lastFinishedPulling="2026-06-02 01:13:32.592331524 +0000 UTC m=+171.373250541" observedRunningTime="2026-06-02 01:13:33.304137469 +0000 UTC m=+172.085056508" watchObservedRunningTime="2026-06-02 01:13:33.305510838 +0000 UTC m=+172.086429876" Jun 02 01:13:36.273268 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:13:36.273233 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j4c5m" Jun 02 01:14:12.089055 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:12.089015 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc6cbf849-crkjh"] Jun 02 01:14:37.109318 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.109276 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-dc6cbf849-crkjh" podUID="4eee21e9-2271-4849-aa98-11d29dff3612" containerName="console" containerID="cri-o://c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b" gracePeriod=15 Jun 02 01:14:37.206058 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.206024 2578 patch_prober.go:28] interesting pod/console-dc6cbf849-crkjh container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:14:37.206220 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.206097 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-dc6cbf849-crkjh" podUID="4eee21e9-2271-4849-aa98-11d29dff3612" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 02 01:14:37.349091 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.349069 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dc6cbf849-crkjh_4eee21e9-2271-4849-aa98-11d29dff3612/console/0.log" Jun 02 01:14:37.349210 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.349130 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:14:37.419333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419235 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-trusted-ca-bundle\") pod \"4eee21e9-2271-4849-aa98-11d29dff3612\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " Jun 02 01:14:37.419333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419290 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-oauth-serving-cert\") pod \"4eee21e9-2271-4849-aa98-11d29dff3612\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " Jun 02 01:14:37.419557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419336 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc8nm\" (UniqueName: \"kubernetes.io/projected/4eee21e9-2271-4849-aa98-11d29dff3612-kube-api-access-rc8nm\") pod \"4eee21e9-2271-4849-aa98-11d29dff3612\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " Jun 02 01:14:37.419557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419382 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-oauth-config\") pod \"4eee21e9-2271-4849-aa98-11d29dff3612\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " Jun 02 01:14:37.419557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419415 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-console-config\") pod \"4eee21e9-2271-4849-aa98-11d29dff3612\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " Jun 02 01:14:37.419557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419520 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-serving-cert\") pod \"4eee21e9-2271-4849-aa98-11d29dff3612\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " Jun 02 01:14:37.419557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419545 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-service-ca\") pod \"4eee21e9-2271-4849-aa98-11d29dff3612\" (UID: \"4eee21e9-2271-4849-aa98-11d29dff3612\") " Jun 02 01:14:37.419805 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419685 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4eee21e9-2271-4849-aa98-11d29dff3612" (UID: "4eee21e9-2271-4849-aa98-11d29dff3612"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:14:37.419805 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419696 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4eee21e9-2271-4849-aa98-11d29dff3612" (UID: "4eee21e9-2271-4849-aa98-11d29dff3612"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:14:37.419898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419886 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-trusted-ca-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:14:37.419966 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.419937 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-oauth-serving-cert\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:14:37.420026 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.420004 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-console-config" (OuterVolumeSpecName: "console-config") pod "4eee21e9-2271-4849-aa98-11d29dff3612" (UID: "4eee21e9-2271-4849-aa98-11d29dff3612"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:14:37.420075 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.420052 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-service-ca" (OuterVolumeSpecName: "service-ca") pod "4eee21e9-2271-4849-aa98-11d29dff3612" (UID: "4eee21e9-2271-4849-aa98-11d29dff3612"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:14:37.421770 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.421743 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4eee21e9-2271-4849-aa98-11d29dff3612" (UID: "4eee21e9-2271-4849-aa98-11d29dff3612"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:14:37.422050 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.422023 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4eee21e9-2271-4849-aa98-11d29dff3612" (UID: "4eee21e9-2271-4849-aa98-11d29dff3612"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:14:37.422148 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.422046 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4eee21e9-2271-4849-aa98-11d29dff3612-kube-api-access-rc8nm" (OuterVolumeSpecName: "kube-api-access-rc8nm") pod "4eee21e9-2271-4849-aa98-11d29dff3612" (UID: "4eee21e9-2271-4849-aa98-11d29dff3612"). InnerVolumeSpecName "kube-api-access-rc8nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:14:37.487460 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.487432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dc6cbf849-crkjh_4eee21e9-2271-4849-aa98-11d29dff3612/console/0.log" Jun 02 01:14:37.487650 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.487471 2578 generic.go:358] "Generic (PLEG): container finished" podID="4eee21e9-2271-4849-aa98-11d29dff3612" containerID="c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b" exitCode=2 Jun 02 01:14:37.487650 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.487545 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc6cbf849-crkjh" Jun 02 01:14:37.487650 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.487556 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc6cbf849-crkjh" event={"ID":"4eee21e9-2271-4849-aa98-11d29dff3612","Type":"ContainerDied","Data":"c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b"} Jun 02 01:14:37.487650 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.487596 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc6cbf849-crkjh" event={"ID":"4eee21e9-2271-4849-aa98-11d29dff3612","Type":"ContainerDied","Data":"b488edd5ec939871559ad8e9bfe05adf60b949b6d7fdd888459f203a0e4d975a"} Jun 02 01:14:37.487650 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.487611 2578 scope.go:117] "RemoveContainer" containerID="c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b" Jun 02 01:14:37.497353 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.495812 2578 scope.go:117] "RemoveContainer" containerID="c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b" Jun 02 01:14:37.497353 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:14:37.496169 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b\": container with ID starting with c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b not found: ID does not exist" containerID="c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b" Jun 02 01:14:37.497353 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.496203 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b"} err="failed to get container status \"c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b\": rpc error: code = NotFound desc = could not find container \"c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b\": container with ID starting with c5b767bfd838b7dabf821afb950825bfb96cda8d4dffa70eb77c45dbbd935d6b not found: ID does not exist" Jun 02 01:14:37.509757 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.509729 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dc6cbf849-crkjh"] Jun 02 01:14:37.513730 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.513711 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dc6cbf849-crkjh"] Jun 02 01:14:37.520959 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.520937 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-serving-cert\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:14:37.521050 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.520965 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-service-ca\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:14:37.521050 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.520981 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc8nm\" (UniqueName: \"kubernetes.io/projected/4eee21e9-2271-4849-aa98-11d29dff3612-kube-api-access-rc8nm\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:14:37.521050 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.520994 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4eee21e9-2271-4849-aa98-11d29dff3612-console-oauth-config\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:14:37.521050 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.521008 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4eee21e9-2271-4849-aa98-11d29dff3612-console-config\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:14:37.693212 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:14:37.693137 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4eee21e9-2271-4849-aa98-11d29dff3612" path="/var/lib/kubelet/pods/4eee21e9-2271-4849-aa98-11d29dff3612/volumes" Jun 02 01:15:26.969077 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969042 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp"] Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969329 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b48a1350-f5ff-46e2-9686-6125c753cf7d" containerName="console" Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969339 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b48a1350-f5ff-46e2-9686-6125c753cf7d" containerName="console" Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969352 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4eee21e9-2271-4849-aa98-11d29dff3612" containerName="console" Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969357 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4eee21e9-2271-4849-aa98-11d29dff3612" containerName="console" Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969371 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" containerName="console" Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969377 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" containerName="console" Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969422 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="f456cea8-659e-4d4b-bdfb-8bcfee5ceba6" containerName="console" Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969431 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="4eee21e9-2271-4849-aa98-11d29dff3612" containerName="console" Jun 02 01:15:26.969526 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.969439 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="b48a1350-f5ff-46e2-9686-6125c753cf7d" containerName="console" Jun 02 01:15:26.972460 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.972440 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:26.974847 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.974821 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:15:26.975007 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.974875 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wfvvs\"" Jun 02 01:15:26.975007 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.974951 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:15:26.979717 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:26.979693 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp"] Jun 02 01:15:27.019473 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.019428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfx8t\" (UniqueName: \"kubernetes.io/projected/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-kube-api-access-gfx8t\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.019641 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.019484 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.019641 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.019558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.120510 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.120473 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfx8t\" (UniqueName: \"kubernetes.io/projected/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-kube-api-access-gfx8t\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.120667 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.120521 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.120667 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.120552 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.120874 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.120858 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.120967 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.120948 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.128579 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.128561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfx8t\" (UniqueName: \"kubernetes.io/projected/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-kube-api-access-gfx8t\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.282173 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.282096 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:27.405433 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.405400 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp"] Jun 02 01:15:27.409395 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:15:27.409363 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c9c04c_20b8_4ba7_8a34_28d4270bbe19.slice/crio-307cb350f980d5919184a1cbbacc660df557c7fe46cf1a05ed356b76eda0610d WatchSource:0}: Error finding container 307cb350f980d5919184a1cbbacc660df557c7fe46cf1a05ed356b76eda0610d: Status 404 returned error can't find the container with id 307cb350f980d5919184a1cbbacc660df557c7fe46cf1a05ed356b76eda0610d Jun 02 01:15:27.622808 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:27.622774 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" event={"ID":"93c9c04c-20b8-4ba7-8a34-28d4270bbe19","Type":"ContainerStarted","Data":"307cb350f980d5919184a1cbbacc660df557c7fe46cf1a05ed356b76eda0610d"} Jun 02 01:15:34.645038 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:34.645005 2578 generic.go:358] "Generic (PLEG): container finished" podID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerID="0c1b314d67b0668510364601c1e4ed558fafa0047869e311cb814951c32ec98c" exitCode=0 Jun 02 01:15:34.645511 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:34.645070 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" event={"ID":"93c9c04c-20b8-4ba7-8a34-28d4270bbe19","Type":"ContainerDied","Data":"0c1b314d67b0668510364601c1e4ed558fafa0047869e311cb814951c32ec98c"} Jun 02 01:15:38.658538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:38.658504 2578 generic.go:358] "Generic (PLEG): container finished" podID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerID="531f4747cae8b3899f88ebd2f5df0d447eaf3241d3b0719709fea8a3bd236ca1" exitCode=0 Jun 02 01:15:38.659001 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:38.658592 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" event={"ID":"93c9c04c-20b8-4ba7-8a34-28d4270bbe19","Type":"ContainerDied","Data":"531f4747cae8b3899f88ebd2f5df0d447eaf3241d3b0719709fea8a3bd236ca1"} Jun 02 01:15:41.593593 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:41.593567 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:15:41.594017 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:41.593745 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:15:41.596569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:41.596546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:15:41.596999 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:41.596980 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:15:41.602453 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:41.602434 2578 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 01:15:48.689866 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:48.689835 2578 generic.go:358] "Generic (PLEG): container finished" podID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerID="af5bed049467a182acea2adecd50d25d6d39a656d11d06d5858b13eaa8b81f0a" exitCode=0 Jun 02 01:15:48.690293 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:48.689889 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" event={"ID":"93c9c04c-20b8-4ba7-8a34-28d4270bbe19","Type":"ContainerDied","Data":"af5bed049467a182acea2adecd50d25d6d39a656d11d06d5858b13eaa8b81f0a"} Jun 02 01:15:49.817335 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:49.817312 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:49.923343 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:49.923302 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-util\") pod \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " Jun 02 01:15:49.923507 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:49.923392 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfx8t\" (UniqueName: \"kubernetes.io/projected/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-kube-api-access-gfx8t\") pod \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " Jun 02 01:15:49.923507 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:49.923463 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-bundle\") pod \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\" (UID: \"93c9c04c-20b8-4ba7-8a34-28d4270bbe19\") " Jun 02 01:15:49.924169 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:49.924130 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-bundle" (OuterVolumeSpecName: "bundle") pod "93c9c04c-20b8-4ba7-8a34-28d4270bbe19" (UID: "93c9c04c-20b8-4ba7-8a34-28d4270bbe19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:15:49.925676 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:49.925639 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-kube-api-access-gfx8t" (OuterVolumeSpecName: "kube-api-access-gfx8t") pod "93c9c04c-20b8-4ba7-8a34-28d4270bbe19" (UID: "93c9c04c-20b8-4ba7-8a34-28d4270bbe19"). InnerVolumeSpecName "kube-api-access-gfx8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:15:49.927411 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:49.927385 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-util" (OuterVolumeSpecName: "util") pod "93c9c04c-20b8-4ba7-8a34-28d4270bbe19" (UID: "93c9c04c-20b8-4ba7-8a34-28d4270bbe19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:15:50.024214 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:50.024119 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfx8t\" (UniqueName: \"kubernetes.io/projected/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-kube-api-access-gfx8t\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:15:50.024214 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:50.024153 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:15:50.024214 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:50.024162 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c9c04c-20b8-4ba7-8a34-28d4270bbe19-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:15:50.697188 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:50.697152 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" event={"ID":"93c9c04c-20b8-4ba7-8a34-28d4270bbe19","Type":"ContainerDied","Data":"307cb350f980d5919184a1cbbacc660df557c7fe46cf1a05ed356b76eda0610d"} Jun 02 01:15:50.697188 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:50.697185 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="307cb350f980d5919184a1cbbacc660df557c7fe46cf1a05ed356b76eda0610d" Jun 02 01:15:50.697437 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:50.697239 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlr9tp" Jun 02 01:15:58.605716 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.605681 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm"] Jun 02 01:15:58.606202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.605987 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerName="extract" Jun 02 01:15:58.606202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.605999 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerName="extract" Jun 02 01:15:58.606202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.606016 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerName="util" Jun 02 01:15:58.606202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.606022 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerName="util" Jun 02 01:15:58.606202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.606031 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerName="pull" Jun 02 01:15:58.606202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.606038 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerName="pull" Jun 02 01:15:58.606202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.606093 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="93c9c04c-20b8-4ba7-8a34-28d4270bbe19" containerName="extract" Jun 02 01:15:58.609065 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.609049 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.611203 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.611179 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:15:58.611203 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.611180 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:15:58.611373 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.611218 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wfvvs\"" Jun 02 01:15:58.615273 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.615253 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm"] Jun 02 01:15:58.797387 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.797350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmlwf\" (UniqueName: \"kubernetes.io/projected/9000f05a-3646-4e4a-bb59-0036e7fb7350-kube-api-access-vmlwf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.797387 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.797392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.797608 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.797419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.898320 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.898230 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmlwf\" (UniqueName: \"kubernetes.io/projected/9000f05a-3646-4e4a-bb59-0036e7fb7350-kube-api-access-vmlwf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.898320 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.898278 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.898320 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.898314 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.898671 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.898649 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.898740 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.898691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.905823 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.905791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmlwf\" (UniqueName: \"kubernetes.io/projected/9000f05a-3646-4e4a-bb59-0036e7fb7350-kube-api-access-vmlwf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:58.918518 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:58.918493 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:15:59.042025 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:59.042000 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm"] Jun 02 01:15:59.044240 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:15:59.044215 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9000f05a_3646_4e4a_bb59_0036e7fb7350.slice/crio-a15a415d94b63c8458d278e8ead4cdbbb02ba29a8019351dec953b276057e356 WatchSource:0}: Error finding container a15a415d94b63c8458d278e8ead4cdbbb02ba29a8019351dec953b276057e356: Status 404 returned error can't find the container with id a15a415d94b63c8458d278e8ead4cdbbb02ba29a8019351dec953b276057e356 Jun 02 01:15:59.045977 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:59.045958 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:15:59.724670 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:59.724634 2578 generic.go:358] "Generic (PLEG): container finished" podID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerID="f5c6b8b0af04f7db232a08e976e732a379f696e897c14311aec3c6f3fdad643e" exitCode=0 Jun 02 01:15:59.724670 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:59.724671 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" event={"ID":"9000f05a-3646-4e4a-bb59-0036e7fb7350","Type":"ContainerDied","Data":"f5c6b8b0af04f7db232a08e976e732a379f696e897c14311aec3c6f3fdad643e"} Jun 02 01:15:59.725169 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:15:59.724693 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" event={"ID":"9000f05a-3646-4e4a-bb59-0036e7fb7350","Type":"ContainerStarted","Data":"a15a415d94b63c8458d278e8ead4cdbbb02ba29a8019351dec953b276057e356"} Jun 02 01:16:00.681629 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.681591 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-m94dg"] Jun 02 01:16:00.685258 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.685230 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:00.687594 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.687568 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 01:16:00.687594 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.687588 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 01:16:00.688325 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.688301 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-v4dm4\"" Jun 02 01:16:00.692628 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.692596 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-m94dg"] Jun 02 01:16:00.813962 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.813879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63c4eeaf-ac07-4aa9-83ca-e284a6533dcd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-m94dg\" (UID: \"63c4eeaf-ac07-4aa9-83ca-e284a6533dcd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:00.814420 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.813968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w4sb\" (UniqueName: \"kubernetes.io/projected/63c4eeaf-ac07-4aa9-83ca-e284a6533dcd-kube-api-access-8w4sb\") pod \"cert-manager-webhook-587ccfb98-m94dg\" (UID: \"63c4eeaf-ac07-4aa9-83ca-e284a6533dcd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:00.915335 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.915272 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63c4eeaf-ac07-4aa9-83ca-e284a6533dcd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-m94dg\" (UID: \"63c4eeaf-ac07-4aa9-83ca-e284a6533dcd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:00.915524 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.915352 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8w4sb\" (UniqueName: \"kubernetes.io/projected/63c4eeaf-ac07-4aa9-83ca-e284a6533dcd-kube-api-access-8w4sb\") pod \"cert-manager-webhook-587ccfb98-m94dg\" (UID: \"63c4eeaf-ac07-4aa9-83ca-e284a6533dcd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:00.922830 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.922797 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/63c4eeaf-ac07-4aa9-83ca-e284a6533dcd-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-m94dg\" (UID: \"63c4eeaf-ac07-4aa9-83ca-e284a6533dcd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:00.923152 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:00.923123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w4sb\" (UniqueName: \"kubernetes.io/projected/63c4eeaf-ac07-4aa9-83ca-e284a6533dcd-kube-api-access-8w4sb\") pod \"cert-manager-webhook-587ccfb98-m94dg\" (UID: \"63c4eeaf-ac07-4aa9-83ca-e284a6533dcd\") " pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:01.009100 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:01.009003 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:01.145298 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:01.145105 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-m94dg"] Jun 02 01:16:01.742806 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:16:01.742758 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63c4eeaf_ac07_4aa9_83ca_e284a6533dcd.slice/crio-1cc3d3d97a9f69dccbcce07ce1b67c125838d43da1449ca41f3b66981632d84a WatchSource:0}: Error finding container 1cc3d3d97a9f69dccbcce07ce1b67c125838d43da1449ca41f3b66981632d84a: Status 404 returned error can't find the container with id 1cc3d3d97a9f69dccbcce07ce1b67c125838d43da1449ca41f3b66981632d84a Jun 02 01:16:02.735428 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:02.735394 2578 generic.go:358] "Generic (PLEG): container finished" podID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerID="f803caf09ca57cd04e95ae64c0ceb5e4c38d4302168f47d4f79690ad942caf59" exitCode=0 Jun 02 01:16:02.735860 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:02.735482 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" event={"ID":"9000f05a-3646-4e4a-bb59-0036e7fb7350","Type":"ContainerDied","Data":"f803caf09ca57cd04e95ae64c0ceb5e4c38d4302168f47d4f79690ad942caf59"} Jun 02 01:16:02.736655 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:02.736635 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" event={"ID":"63c4eeaf-ac07-4aa9-83ca-e284a6533dcd","Type":"ContainerStarted","Data":"1cc3d3d97a9f69dccbcce07ce1b67c125838d43da1449ca41f3b66981632d84a"} Jun 02 01:16:03.742355 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:03.742316 2578 generic.go:358] "Generic (PLEG): container finished" podID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerID="580aa3bafaa5533f7c2930d1cd28dae2c61137914354e93ad193f3832b151647" exitCode=0 Jun 02 01:16:03.742777 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:03.742367 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" event={"ID":"9000f05a-3646-4e4a-bb59-0036e7fb7350","Type":"ContainerDied","Data":"580aa3bafaa5533f7c2930d1cd28dae2c61137914354e93ad193f3832b151647"} Jun 02 01:16:05.149180 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.149159 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:16:05.246605 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.246576 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-util\") pod \"9000f05a-3646-4e4a-bb59-0036e7fb7350\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " Jun 02 01:16:05.246727 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.246711 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmlwf\" (UniqueName: \"kubernetes.io/projected/9000f05a-3646-4e4a-bb59-0036e7fb7350-kube-api-access-vmlwf\") pod \"9000f05a-3646-4e4a-bb59-0036e7fb7350\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " Jun 02 01:16:05.246801 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.246765 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-bundle\") pod \"9000f05a-3646-4e4a-bb59-0036e7fb7350\" (UID: \"9000f05a-3646-4e4a-bb59-0036e7fb7350\") " Jun 02 01:16:05.247275 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.247251 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-bundle" (OuterVolumeSpecName: "bundle") pod "9000f05a-3646-4e4a-bb59-0036e7fb7350" (UID: "9000f05a-3646-4e4a-bb59-0036e7fb7350"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:16:05.249040 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.249012 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9000f05a-3646-4e4a-bb59-0036e7fb7350-kube-api-access-vmlwf" (OuterVolumeSpecName: "kube-api-access-vmlwf") pod "9000f05a-3646-4e4a-bb59-0036e7fb7350" (UID: "9000f05a-3646-4e4a-bb59-0036e7fb7350"). InnerVolumeSpecName "kube-api-access-vmlwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:16:05.251285 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.251259 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-util" (OuterVolumeSpecName: "util") pod "9000f05a-3646-4e4a-bb59-0036e7fb7350" (UID: "9000f05a-3646-4e4a-bb59-0036e7fb7350"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:16:05.347539 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.347500 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmlwf\" (UniqueName: \"kubernetes.io/projected/9000f05a-3646-4e4a-bb59-0036e7fb7350-kube-api-access-vmlwf\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:05.347539 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.347532 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:05.347539 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.347542 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9000f05a-3646-4e4a-bb59-0036e7fb7350-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:05.749653 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.749618 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" event={"ID":"9000f05a-3646-4e4a-bb59-0036e7fb7350","Type":"ContainerDied","Data":"a15a415d94b63c8458d278e8ead4cdbbb02ba29a8019351dec953b276057e356"} Jun 02 01:16:05.749653 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.749636 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fg7ppm" Jun 02 01:16:05.749653 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.749654 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a15a415d94b63c8458d278e8ead4cdbbb02ba29a8019351dec953b276057e356" Jun 02 01:16:05.751058 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.751033 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" event={"ID":"63c4eeaf-ac07-4aa9-83ca-e284a6533dcd","Type":"ContainerStarted","Data":"46b5778869fa9bec9b16cacb74bdfc3ddbbbe96783536d7fd180a2569acdca01"} Jun 02 01:16:05.751193 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.751162 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:05.766605 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:05.766556 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" podStartSLOduration=2.302823797 podStartE2EDuration="5.766542671s" podCreationTimestamp="2026-06-02 01:16:00 +0000 UTC" firstStartedPulling="2026-06-02 01:16:01.74486067 +0000 UTC m=+320.525779686" lastFinishedPulling="2026-06-02 01:16:05.208579532 +0000 UTC m=+323.989498560" observedRunningTime="2026-06-02 01:16:05.765257075 +0000 UTC m=+324.546176114" watchObservedRunningTime="2026-06-02 01:16:05.766542671 +0000 UTC m=+324.547461710" Jun 02 01:16:09.267097 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.267064 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-kv8wv"] Jun 02 01:16:09.267569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.267356 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerName="pull" Jun 02 01:16:09.267569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.267367 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerName="pull" Jun 02 01:16:09.267569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.267384 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerName="util" Jun 02 01:16:09.267569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.267390 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerName="util" Jun 02 01:16:09.267569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.267396 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerName="extract" Jun 02 01:16:09.267569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.267402 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerName="extract" Jun 02 01:16:09.267569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.267445 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="9000f05a-3646-4e4a-bb59-0036e7fb7350" containerName="extract" Jun 02 01:16:09.271591 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.271575 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-kv8wv" Jun 02 01:16:09.273792 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.273773 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-d4czj\"" Jun 02 01:16:09.278270 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.278240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6pjj\" (UniqueName: \"kubernetes.io/projected/88974eff-f10c-489e-b07d-83a7e4749dd1-kube-api-access-t6pjj\") pod \"cert-manager-79c8d999ff-kv8wv\" (UID: \"88974eff-f10c-489e-b07d-83a7e4749dd1\") " pod="cert-manager/cert-manager-79c8d999ff-kv8wv" Jun 02 01:16:09.278407 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.278364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88974eff-f10c-489e-b07d-83a7e4749dd1-bound-sa-token\") pod \"cert-manager-79c8d999ff-kv8wv\" (UID: \"88974eff-f10c-489e-b07d-83a7e4749dd1\") " pod="cert-manager/cert-manager-79c8d999ff-kv8wv" Jun 02 01:16:09.279021 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.279002 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-kv8wv"] Jun 02 01:16:09.379476 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.379441 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6pjj\" (UniqueName: \"kubernetes.io/projected/88974eff-f10c-489e-b07d-83a7e4749dd1-kube-api-access-t6pjj\") pod \"cert-manager-79c8d999ff-kv8wv\" (UID: \"88974eff-f10c-489e-b07d-83a7e4749dd1\") " pod="cert-manager/cert-manager-79c8d999ff-kv8wv" Jun 02 01:16:09.379668 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.379523 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88974eff-f10c-489e-b07d-83a7e4749dd1-bound-sa-token\") pod \"cert-manager-79c8d999ff-kv8wv\" (UID: \"88974eff-f10c-489e-b07d-83a7e4749dd1\") " pod="cert-manager/cert-manager-79c8d999ff-kv8wv" Jun 02 01:16:09.386930 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.386894 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6pjj\" (UniqueName: \"kubernetes.io/projected/88974eff-f10c-489e-b07d-83a7e4749dd1-kube-api-access-t6pjj\") pod \"cert-manager-79c8d999ff-kv8wv\" (UID: \"88974eff-f10c-489e-b07d-83a7e4749dd1\") " pod="cert-manager/cert-manager-79c8d999ff-kv8wv" Jun 02 01:16:09.387221 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.387200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88974eff-f10c-489e-b07d-83a7e4749dd1-bound-sa-token\") pod \"cert-manager-79c8d999ff-kv8wv\" (UID: \"88974eff-f10c-489e-b07d-83a7e4749dd1\") " pod="cert-manager/cert-manager-79c8d999ff-kv8wv" Jun 02 01:16:09.581598 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.581566 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-kv8wv" Jun 02 01:16:09.727493 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.727449 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-kv8wv"] Jun 02 01:16:09.730276 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:16:09.730241 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88974eff_f10c_489e_b07d_83a7e4749dd1.slice/crio-69bf9c7308ea099a3900688a096e1b75617c5838242736b1e7fe593a304d16af WatchSource:0}: Error finding container 69bf9c7308ea099a3900688a096e1b75617c5838242736b1e7fe593a304d16af: Status 404 returned error can't find the container with id 69bf9c7308ea099a3900688a096e1b75617c5838242736b1e7fe593a304d16af Jun 02 01:16:09.764059 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:09.764031 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-kv8wv" event={"ID":"88974eff-f10c-489e-b07d-83a7e4749dd1","Type":"ContainerStarted","Data":"69bf9c7308ea099a3900688a096e1b75617c5838242736b1e7fe593a304d16af"} Jun 02 01:16:10.768663 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:10.768624 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-kv8wv" event={"ID":"88974eff-f10c-489e-b07d-83a7e4749dd1","Type":"ContainerStarted","Data":"90ac502b4f0df3b261076bcb7f014f0c444fa2b2943a705042cf50811b68b156"} Jun 02 01:16:10.783395 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:10.783345 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-kv8wv" podStartSLOduration=1.783330463 podStartE2EDuration="1.783330463s" podCreationTimestamp="2026-06-02 01:16:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:16:10.781749166 +0000 UTC m=+329.562668217" watchObservedRunningTime="2026-06-02 01:16:10.783330463 +0000 UTC m=+329.564249502" Jun 02 01:16:11.756889 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.756859 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-m94dg" Jun 02 01:16:11.825217 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.825187 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z"] Jun 02 01:16:11.828774 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.828758 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" Jun 02 01:16:11.831206 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.831180 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:16:11.831206 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.831194 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bgs9n\"" Jun 02 01:16:11.831387 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.831230 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 01:16:11.835797 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.835772 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z"] Jun 02 01:16:11.896723 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.896684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kjdg\" (UniqueName: \"kubernetes.io/projected/e85d14f9-9d15-4365-97f4-c56c62bff003-kube-api-access-4kjdg\") pod \"openshift-lws-operator-bfc7f696d-hvg8z\" (UID: \"e85d14f9-9d15-4365-97f4-c56c62bff003\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" Jun 02 01:16:11.896903 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.896734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85d14f9-9d15-4365-97f4-c56c62bff003-tmp\") pod \"openshift-lws-operator-bfc7f696d-hvg8z\" (UID: \"e85d14f9-9d15-4365-97f4-c56c62bff003\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" Jun 02 01:16:11.998005 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.997958 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kjdg\" (UniqueName: \"kubernetes.io/projected/e85d14f9-9d15-4365-97f4-c56c62bff003-kube-api-access-4kjdg\") pod \"openshift-lws-operator-bfc7f696d-hvg8z\" (UID: \"e85d14f9-9d15-4365-97f4-c56c62bff003\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" Jun 02 01:16:11.998161 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.998018 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85d14f9-9d15-4365-97f4-c56c62bff003-tmp\") pod \"openshift-lws-operator-bfc7f696d-hvg8z\" (UID: \"e85d14f9-9d15-4365-97f4-c56c62bff003\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" Jun 02 01:16:11.998373 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:11.998354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e85d14f9-9d15-4365-97f4-c56c62bff003-tmp\") pod \"openshift-lws-operator-bfc7f696d-hvg8z\" (UID: \"e85d14f9-9d15-4365-97f4-c56c62bff003\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" Jun 02 01:16:12.005991 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:12.005970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kjdg\" (UniqueName: \"kubernetes.io/projected/e85d14f9-9d15-4365-97f4-c56c62bff003-kube-api-access-4kjdg\") pod \"openshift-lws-operator-bfc7f696d-hvg8z\" (UID: \"e85d14f9-9d15-4365-97f4-c56c62bff003\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" Jun 02 01:16:12.138391 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:12.138358 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" Jun 02 01:16:12.261373 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:12.261350 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z"] Jun 02 01:16:12.263705 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:16:12.263674 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode85d14f9_9d15_4365_97f4_c56c62bff003.slice/crio-d7e44ca295d72290a24699080733bff7c7124b7cf7094b7ca4c19c4aabe2affa WatchSource:0}: Error finding container d7e44ca295d72290a24699080733bff7c7124b7cf7094b7ca4c19c4aabe2affa: Status 404 returned error can't find the container with id d7e44ca295d72290a24699080733bff7c7124b7cf7094b7ca4c19c4aabe2affa Jun 02 01:16:12.775168 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:12.775133 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" event={"ID":"e85d14f9-9d15-4365-97f4-c56c62bff003","Type":"ContainerStarted","Data":"d7e44ca295d72290a24699080733bff7c7124b7cf7094b7ca4c19c4aabe2affa"} Jun 02 01:16:15.785887 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:15.785850 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" event={"ID":"e85d14f9-9d15-4365-97f4-c56c62bff003","Type":"ContainerStarted","Data":"3c6463e17a8dfb952a2aa750f53689328b7cc2ae4e25f5d820f660472a79812d"} Jun 02 01:16:15.802821 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:15.802765 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-hvg8z" podStartSLOduration=1.930105995 podStartE2EDuration="4.80274756s" podCreationTimestamp="2026-06-02 01:16:11 +0000 UTC" firstStartedPulling="2026-06-02 01:16:12.265156261 +0000 UTC m=+331.046075281" lastFinishedPulling="2026-06-02 01:16:15.137797827 +0000 UTC m=+333.918716846" observedRunningTime="2026-06-02 01:16:15.800672579 +0000 UTC m=+334.581591618" watchObservedRunningTime="2026-06-02 01:16:15.80274756 +0000 UTC m=+334.583666601" Jun 02 01:16:19.035889 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.035808 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5"] Jun 02 01:16:19.038321 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.038303 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.040633 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.040609 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wfvvs\"" Jun 02 01:16:19.040745 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.040632 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:16:19.041488 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.041473 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:16:19.047356 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.047332 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5"] Jun 02 01:16:19.163738 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.163707 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5px2\" (UniqueName: \"kubernetes.io/projected/76391e20-20d8-4857-9b25-106a65bd991b-kube-api-access-w5px2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.163738 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.163742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.163984 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.163766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.264927 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.264888 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.265126 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.265006 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5px2\" (UniqueName: \"kubernetes.io/projected/76391e20-20d8-4857-9b25-106a65bd991b-kube-api-access-w5px2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.265126 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.265030 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.265362 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.265342 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.265436 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.265345 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.277174 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.277152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5px2\" (UniqueName: \"kubernetes.io/projected/76391e20-20d8-4857-9b25-106a65bd991b-kube-api-access-w5px2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.348778 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.348729 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:19.477652 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.477626 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5"] Jun 02 01:16:19.479560 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:16:19.479533 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76391e20_20d8_4857_9b25_106a65bd991b.slice/crio-539bd34f21d74626b5ab3e856924e39f3402bc4e3e52713e8df76a806688c944 WatchSource:0}: Error finding container 539bd34f21d74626b5ab3e856924e39f3402bc4e3e52713e8df76a806688c944: Status 404 returned error can't find the container with id 539bd34f21d74626b5ab3e856924e39f3402bc4e3e52713e8df76a806688c944 Jun 02 01:16:19.799535 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.799443 2578 generic.go:358] "Generic (PLEG): container finished" podID="76391e20-20d8-4857-9b25-106a65bd991b" containerID="5d1e27498f9a2e4890dba1c51c54f7958623c9935d54517b05b97335d7a5b561" exitCode=0 Jun 02 01:16:19.799535 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.799506 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" event={"ID":"76391e20-20d8-4857-9b25-106a65bd991b","Type":"ContainerDied","Data":"5d1e27498f9a2e4890dba1c51c54f7958623c9935d54517b05b97335d7a5b561"} Jun 02 01:16:19.799535 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:19.799531 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" event={"ID":"76391e20-20d8-4857-9b25-106a65bd991b","Type":"ContainerStarted","Data":"539bd34f21d74626b5ab3e856924e39f3402bc4e3e52713e8df76a806688c944"} Jun 02 01:16:20.803999 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:20.803963 2578 generic.go:358] "Generic (PLEG): container finished" podID="76391e20-20d8-4857-9b25-106a65bd991b" containerID="9d3634b5006e2a4c32b7ebb9c92ddc816be0000b83b18fbeac6e1632e8d48462" exitCode=0 Jun 02 01:16:20.804373 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:20.804035 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" event={"ID":"76391e20-20d8-4857-9b25-106a65bd991b","Type":"ContainerDied","Data":"9d3634b5006e2a4c32b7ebb9c92ddc816be0000b83b18fbeac6e1632e8d48462"} Jun 02 01:16:21.809190 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:21.809153 2578 generic.go:358] "Generic (PLEG): container finished" podID="76391e20-20d8-4857-9b25-106a65bd991b" containerID="18a335a33cdd64a15c5f3de1eb2aeb1ccbe3ae130fb68e297d4acef97ae1f0d9" exitCode=0 Jun 02 01:16:21.809626 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:21.809238 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" event={"ID":"76391e20-20d8-4857-9b25-106a65bd991b","Type":"ContainerDied","Data":"18a335a33cdd64a15c5f3de1eb2aeb1ccbe3ae130fb68e297d4acef97ae1f0d9"} Jun 02 01:16:22.942563 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:22.942541 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:22.998541 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:22.998511 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-bundle\") pod \"76391e20-20d8-4857-9b25-106a65bd991b\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " Jun 02 01:16:22.998706 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:22.998572 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-util\") pod \"76391e20-20d8-4857-9b25-106a65bd991b\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " Jun 02 01:16:22.998706 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:22.998609 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5px2\" (UniqueName: \"kubernetes.io/projected/76391e20-20d8-4857-9b25-106a65bd991b-kube-api-access-w5px2\") pod \"76391e20-20d8-4857-9b25-106a65bd991b\" (UID: \"76391e20-20d8-4857-9b25-106a65bd991b\") " Jun 02 01:16:22.999422 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:22.999391 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-bundle" (OuterVolumeSpecName: "bundle") pod "76391e20-20d8-4857-9b25-106a65bd991b" (UID: "76391e20-20d8-4857-9b25-106a65bd991b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:16:23.000667 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:23.000643 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76391e20-20d8-4857-9b25-106a65bd991b-kube-api-access-w5px2" (OuterVolumeSpecName: "kube-api-access-w5px2") pod "76391e20-20d8-4857-9b25-106a65bd991b" (UID: "76391e20-20d8-4857-9b25-106a65bd991b"). InnerVolumeSpecName "kube-api-access-w5px2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:16:23.004475 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:23.004456 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-util" (OuterVolumeSpecName: "util") pod "76391e20-20d8-4857-9b25-106a65bd991b" (UID: "76391e20-20d8-4857-9b25-106a65bd991b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:16:23.099430 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:23.099395 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5px2\" (UniqueName: \"kubernetes.io/projected/76391e20-20d8-4857-9b25-106a65bd991b-kube-api-access-w5px2\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:23.099430 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:23.099428 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:23.099430 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:23.099438 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76391e20-20d8-4857-9b25-106a65bd991b-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:23.816796 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:23.816761 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" event={"ID":"76391e20-20d8-4857-9b25-106a65bd991b","Type":"ContainerDied","Data":"539bd34f21d74626b5ab3e856924e39f3402bc4e3e52713e8df76a806688c944"} Jun 02 01:16:23.816796 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:23.816781 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk46h5" Jun 02 01:16:23.816796 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:23.816791 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="539bd34f21d74626b5ab3e856924e39f3402bc4e3e52713e8df76a806688c944" Jun 02 01:16:31.180291 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.180207 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h"] Jun 02 01:16:31.180691 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.180491 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76391e20-20d8-4857-9b25-106a65bd991b" containerName="util" Jun 02 01:16:31.180691 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.180502 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="76391e20-20d8-4857-9b25-106a65bd991b" containerName="util" Jun 02 01:16:31.180691 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.180518 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76391e20-20d8-4857-9b25-106a65bd991b" containerName="pull" Jun 02 01:16:31.180691 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.180524 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="76391e20-20d8-4857-9b25-106a65bd991b" containerName="pull" Jun 02 01:16:31.180691 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.180531 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76391e20-20d8-4857-9b25-106a65bd991b" containerName="extract" Jun 02 01:16:31.180691 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.180536 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="76391e20-20d8-4857-9b25-106a65bd991b" containerName="extract" Jun 02 01:16:31.180691 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.180596 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="76391e20-20d8-4857-9b25-106a65bd991b" containerName="extract" Jun 02 01:16:31.183560 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.183543 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.187102 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.187080 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 01:16:31.187243 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.187156 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 01:16:31.187575 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.187558 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 01:16:31.187688 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.187672 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 01:16:31.187766 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.187752 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cgjh5\"" Jun 02 01:16:31.210861 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.210832 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h"] Jun 02 01:16:31.263212 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.263178 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8d0672d-f659-45b6-a196-19fe05ffbca7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.263212 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.263213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e8d0672d-f659-45b6-a196-19fe05ffbca7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.263402 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.263246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg2fc\" (UniqueName: \"kubernetes.io/projected/e8d0672d-f659-45b6-a196-19fe05ffbca7-kube-api-access-lg2fc\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.263402 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.263304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8d0672d-f659-45b6-a196-19fe05ffbca7-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.263402 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.263364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e8d0672d-f659-45b6-a196-19fe05ffbca7-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.364530 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.364493 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8d0672d-f659-45b6-a196-19fe05ffbca7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.364530 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.364530 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e8d0672d-f659-45b6-a196-19fe05ffbca7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.364743 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.364563 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lg2fc\" (UniqueName: \"kubernetes.io/projected/e8d0672d-f659-45b6-a196-19fe05ffbca7-kube-api-access-lg2fc\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.364743 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.364586 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8d0672d-f659-45b6-a196-19fe05ffbca7-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.364743 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.364621 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e8d0672d-f659-45b6-a196-19fe05ffbca7-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.365129 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.365106 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e8d0672d-f659-45b6-a196-19fe05ffbca7-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.366834 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.366807 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8d0672d-f659-45b6-a196-19fe05ffbca7-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.366983 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.366940 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8d0672d-f659-45b6-a196-19fe05ffbca7-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.367177 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.367158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e8d0672d-f659-45b6-a196-19fe05ffbca7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.373133 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.373111 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg2fc\" (UniqueName: \"kubernetes.io/projected/e8d0672d-f659-45b6-a196-19fe05ffbca7-kube-api-access-lg2fc\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-cp29h\" (UID: \"e8d0672d-f659-45b6-a196-19fe05ffbca7\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.493084 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.492985 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:31.642882 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.642855 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h"] Jun 02 01:16:31.646660 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:16:31.646631 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d0672d_f659_45b6_a196_19fe05ffbca7.slice/crio-e61cb515d964cd7a4d3dd54cea98b11860829507ebd5c9d881bc7e83fd03f0c4 WatchSource:0}: Error finding container e61cb515d964cd7a4d3dd54cea98b11860829507ebd5c9d881bc7e83fd03f0c4: Status 404 returned error can't find the container with id e61cb515d964cd7a4d3dd54cea98b11860829507ebd5c9d881bc7e83fd03f0c4 Jun 02 01:16:31.847962 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:31.847901 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" event={"ID":"e8d0672d-f659-45b6-a196-19fe05ffbca7","Type":"ContainerStarted","Data":"e61cb515d964cd7a4d3dd54cea98b11860829507ebd5c9d881bc7e83fd03f0c4"} Jun 02 01:16:34.860021 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:34.859980 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" event={"ID":"e8d0672d-f659-45b6-a196-19fe05ffbca7","Type":"ContainerStarted","Data":"942c27a40ae364246ebbd36f1ab8af70684bbf6d6cb513d393fe18a54ae7b146"} Jun 02 01:16:35.864479 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:35.864436 2578 generic.go:358] "Generic (PLEG): container finished" podID="e8d0672d-f659-45b6-a196-19fe05ffbca7" containerID="942c27a40ae364246ebbd36f1ab8af70684bbf6d6cb513d393fe18a54ae7b146" exitCode=0 Jun 02 01:16:35.864866 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:35.864522 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" event={"ID":"e8d0672d-f659-45b6-a196-19fe05ffbca7","Type":"ContainerDied","Data":"942c27a40ae364246ebbd36f1ab8af70684bbf6d6cb513d393fe18a54ae7b146"} Jun 02 01:16:36.869378 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:36.869342 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" event={"ID":"e8d0672d-f659-45b6-a196-19fe05ffbca7","Type":"ContainerStarted","Data":"3833ddb78d8065aa239a3b14855b0fc112ca1c782e81ef9e25e5bc8042aa5d8f"} Jun 02 01:16:36.869732 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:36.869483 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:47.874227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:47.874199 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" Jun 02 01:16:47.895501 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:47.895445 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-cp29h" podStartSLOduration=12.363798117 podStartE2EDuration="16.895430203s" podCreationTimestamp="2026-06-02 01:16:31 +0000 UTC" firstStartedPulling="2026-06-02 01:16:31.649012816 +0000 UTC m=+350.429931838" lastFinishedPulling="2026-06-02 01:16:36.180644904 +0000 UTC m=+354.961563924" observedRunningTime="2026-06-02 01:16:36.894232495 +0000 UTC m=+355.675151534" watchObservedRunningTime="2026-06-02 01:16:47.895430203 +0000 UTC m=+366.676349242" Jun 02 01:16:50.304317 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.304280 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-549c788894-g5njn"] Jun 02 01:16:50.414314 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.414277 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-549c788894-g5njn"] Jun 02 01:16:50.414484 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.414402 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.417868 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.417843 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:16:50.417868 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.417863 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 01:16:50.418083 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.417864 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 01:16:50.418083 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.417946 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8g79f\"" Jun 02 01:16:50.418083 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.417946 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:16:50.527943 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.527894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e52b34c-a753-407a-9e46-96f3e9b29935-tls-certs\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.528098 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.527960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e52b34c-a753-407a-9e46-96f3e9b29935-tmp\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.528098 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.528042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rthb\" (UniqueName: \"kubernetes.io/projected/4e52b34c-a753-407a-9e46-96f3e9b29935-kube-api-access-5rthb\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.629544 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.629511 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e52b34c-a753-407a-9e46-96f3e9b29935-tls-certs\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.629723 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.629570 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e52b34c-a753-407a-9e46-96f3e9b29935-tmp\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.629723 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.629601 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rthb\" (UniqueName: \"kubernetes.io/projected/4e52b34c-a753-407a-9e46-96f3e9b29935-kube-api-access-5rthb\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.631807 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.631774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e52b34c-a753-407a-9e46-96f3e9b29935-tmp\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.632015 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.631995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e52b34c-a753-407a-9e46-96f3e9b29935-tls-certs\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.636790 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.636767 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rthb\" (UniqueName: \"kubernetes.io/projected/4e52b34c-a753-407a-9e46-96f3e9b29935-kube-api-access-5rthb\") pod \"kube-auth-proxy-549c788894-g5njn\" (UID: \"4e52b34c-a753-407a-9e46-96f3e9b29935\") " pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.728968 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.728933 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" Jun 02 01:16:50.866834 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.866810 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-549c788894-g5njn"] Jun 02 01:16:50.868430 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:16:50.868401 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e52b34c_a753_407a_9e46_96f3e9b29935.slice/crio-721be0fcc5884ccf1f271ad3101845a430367ef179e14b5a5f4d340b533e96af WatchSource:0}: Error finding container 721be0fcc5884ccf1f271ad3101845a430367ef179e14b5a5f4d340b533e96af: Status 404 returned error can't find the container with id 721be0fcc5884ccf1f271ad3101845a430367ef179e14b5a5f4d340b533e96af Jun 02 01:16:50.914569 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:50.914486 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" event={"ID":"4e52b34c-a753-407a-9e46-96f3e9b29935","Type":"ContainerStarted","Data":"721be0fcc5884ccf1f271ad3101845a430367ef179e14b5a5f4d340b533e96af"} Jun 02 01:16:51.168492 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.168414 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-zqfjg"] Jun 02 01:16:51.172586 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.172562 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:51.175020 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.175002 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 01:16:51.184791 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.184770 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-zqfjg"] Jun 02 01:16:51.337719 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.337678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l8rr\" (UniqueName: \"kubernetes.io/projected/392b844e-0cc7-4b19-8407-62a4e8910715-kube-api-access-8l8rr\") pod \"model-serving-api-6577596cd5-zqfjg\" (UID: \"392b844e-0cc7-4b19-8407-62a4e8910715\") " pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:51.338204 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.337779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/392b844e-0cc7-4b19-8407-62a4e8910715-tls-certs\") pod \"model-serving-api-6577596cd5-zqfjg\" (UID: \"392b844e-0cc7-4b19-8407-62a4e8910715\") " pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:51.438999 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.438899 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/392b844e-0cc7-4b19-8407-62a4e8910715-tls-certs\") pod \"model-serving-api-6577596cd5-zqfjg\" (UID: \"392b844e-0cc7-4b19-8407-62a4e8910715\") " pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:51.439204 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.439010 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8l8rr\" (UniqueName: \"kubernetes.io/projected/392b844e-0cc7-4b19-8407-62a4e8910715-kube-api-access-8l8rr\") pod \"model-serving-api-6577596cd5-zqfjg\" (UID: \"392b844e-0cc7-4b19-8407-62a4e8910715\") " pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:51.439204 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:16:51.439069 2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 01:16:51.439204 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:16:51.439158 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/392b844e-0cc7-4b19-8407-62a4e8910715-tls-certs podName:392b844e-0cc7-4b19-8407-62a4e8910715 nodeName:}" failed. No retries permitted until 2026-06-02 01:16:51.939132356 +0000 UTC m=+370.720051394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/392b844e-0cc7-4b19-8407-62a4e8910715-tls-certs") pod "model-serving-api-6577596cd5-zqfjg" (UID: "392b844e-0cc7-4b19-8407-62a4e8910715") : secret "model-serving-api-tls" not found Jun 02 01:16:51.448135 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.448069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l8rr\" (UniqueName: \"kubernetes.io/projected/392b844e-0cc7-4b19-8407-62a4e8910715-kube-api-access-8l8rr\") pod \"model-serving-api-6577596cd5-zqfjg\" (UID: \"392b844e-0cc7-4b19-8407-62a4e8910715\") " pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:51.943529 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.943487 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/392b844e-0cc7-4b19-8407-62a4e8910715-tls-certs\") pod \"model-serving-api-6577596cd5-zqfjg\" (UID: \"392b844e-0cc7-4b19-8407-62a4e8910715\") " pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:51.946271 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:51.946246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/392b844e-0cc7-4b19-8407-62a4e8910715-tls-certs\") pod \"model-serving-api-6577596cd5-zqfjg\" (UID: \"392b844e-0cc7-4b19-8407-62a4e8910715\") " pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:52.086267 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.086229 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:52.197949 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.197844 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9"] Jun 02 01:16:52.204573 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.204546 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.207053 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.207019 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wfvvs\"" Jun 02 01:16:52.207053 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.207047 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:16:52.207242 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.207118 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:16:52.207741 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.207710 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9"] Jun 02 01:16:52.347945 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.347895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.348351 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.347970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.348351 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.348023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6npfn\" (UniqueName: \"kubernetes.io/projected/16636b6a-604d-4876-9c18-2ebd9d82eb83-kube-api-access-6npfn\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.449154 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.449066 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.449154 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.449114 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.449361 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.449161 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6npfn\" (UniqueName: \"kubernetes.io/projected/16636b6a-604d-4876-9c18-2ebd9d82eb83-kube-api-access-6npfn\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.449543 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.449515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.449669 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.449585 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.456886 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.456864 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6npfn\" (UniqueName: \"kubernetes.io/projected/16636b6a-604d-4876-9c18-2ebd9d82eb83-kube-api-access-6npfn\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:52.515731 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:52.515692 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:53.520864 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:53.520827 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-zqfjg"] Jun 02 01:16:53.524232 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:16:53.524202 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392b844e_0cc7_4b19_8407_62a4e8910715.slice/crio-772e373c2b86b1858b0642b4eea45704074d5bdc5fbf7e58ec7098b94012d92e WatchSource:0}: Error finding container 772e373c2b86b1858b0642b4eea45704074d5bdc5fbf7e58ec7098b94012d92e: Status 404 returned error can't find the container with id 772e373c2b86b1858b0642b4eea45704074d5bdc5fbf7e58ec7098b94012d92e Jun 02 01:16:53.542816 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:53.542791 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9"] Jun 02 01:16:53.545654 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:16:53.545632 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16636b6a_604d_4876_9c18_2ebd9d82eb83.slice/crio-10948f6497fa40d7059e96795431f64c80238b6915e0232847a3f67e7a38a453 WatchSource:0}: Error finding container 10948f6497fa40d7059e96795431f64c80238b6915e0232847a3f67e7a38a453: Status 404 returned error can't find the container with id 10948f6497fa40d7059e96795431f64c80238b6915e0232847a3f67e7a38a453 Jun 02 01:16:53.927073 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:53.926977 2578 generic.go:358] "Generic (PLEG): container finished" podID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerID="c5f35e27e6889ab7a27325247d06108aa85a04c2193cdbc973af12f7bf4b15d1" exitCode=0 Jun 02 01:16:53.927227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:53.927083 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" event={"ID":"16636b6a-604d-4876-9c18-2ebd9d82eb83","Type":"ContainerDied","Data":"c5f35e27e6889ab7a27325247d06108aa85a04c2193cdbc973af12f7bf4b15d1"} Jun 02 01:16:53.927227 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:53.927114 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" event={"ID":"16636b6a-604d-4876-9c18-2ebd9d82eb83","Type":"ContainerStarted","Data":"10948f6497fa40d7059e96795431f64c80238b6915e0232847a3f67e7a38a453"} Jun 02 01:16:53.928806 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:53.928771 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" event={"ID":"4e52b34c-a753-407a-9e46-96f3e9b29935","Type":"ContainerStarted","Data":"fb97fc28998137ef3bd655c10394052f1b96b4aa428a168ffe56ef26846c4cc6"} Jun 02 01:16:53.930208 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:53.930171 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-zqfjg" event={"ID":"392b844e-0cc7-4b19-8407-62a4e8910715","Type":"ContainerStarted","Data":"772e373c2b86b1858b0642b4eea45704074d5bdc5fbf7e58ec7098b94012d92e"} Jun 02 01:16:53.995343 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:53.995157 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-549c788894-g5njn" podStartSLOduration=1.433465274 podStartE2EDuration="3.995139163s" podCreationTimestamp="2026-06-02 01:16:50 +0000 UTC" firstStartedPulling="2026-06-02 01:16:50.870370542 +0000 UTC m=+369.651289560" lastFinishedPulling="2026-06-02 01:16:53.432044414 +0000 UTC m=+372.212963449" observedRunningTime="2026-06-02 01:16:53.994870569 +0000 UTC m=+372.775789610" watchObservedRunningTime="2026-06-02 01:16:53.995139163 +0000 UTC m=+372.776058203" Jun 02 01:16:54.936065 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:54.935969 2578 generic.go:358] "Generic (PLEG): container finished" podID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerID="250f83a0eaf6207c65f9a98cef19e82299dc3dbbcea02517b6db44e0da0ed8db" exitCode=0 Jun 02 01:16:54.936496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:54.936054 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" event={"ID":"16636b6a-604d-4876-9c18-2ebd9d82eb83","Type":"ContainerDied","Data":"250f83a0eaf6207c65f9a98cef19e82299dc3dbbcea02517b6db44e0da0ed8db"} Jun 02 01:16:55.940964 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:55.940927 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-zqfjg" event={"ID":"392b844e-0cc7-4b19-8407-62a4e8910715","Type":"ContainerStarted","Data":"066ed199bc32b94a1ba496d8b5ff59235500a3eb7feca3cf9a5eeff93d22fdb5"} Jun 02 01:16:55.941425 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:55.940976 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:16:55.942690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:55.942667 2578 generic.go:358] "Generic (PLEG): container finished" podID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerID="4769a5d70534922e21edead33f348c4c76e78e76a3c7e7dc740b21b9ea8956e9" exitCode=0 Jun 02 01:16:55.942780 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:55.942719 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" event={"ID":"16636b6a-604d-4876-9c18-2ebd9d82eb83","Type":"ContainerDied","Data":"4769a5d70534922e21edead33f348c4c76e78e76a3c7e7dc740b21b9ea8956e9"} Jun 02 01:16:55.958111 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:55.958068 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-zqfjg" podStartSLOduration=3.212474486 podStartE2EDuration="4.958055405s" podCreationTimestamp="2026-06-02 01:16:51 +0000 UTC" firstStartedPulling="2026-06-02 01:16:53.526379188 +0000 UTC m=+372.307298205" lastFinishedPulling="2026-06-02 01:16:55.271960107 +0000 UTC m=+374.052879124" observedRunningTime="2026-06-02 01:16:55.956238827 +0000 UTC m=+374.737157865" watchObservedRunningTime="2026-06-02 01:16:55.958055405 +0000 UTC m=+374.738974444" Jun 02 01:16:57.076097 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.076073 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:16:57.085792 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.085771 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-util\") pod \"16636b6a-604d-4876-9c18-2ebd9d82eb83\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " Jun 02 01:16:57.085937 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.085804 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6npfn\" (UniqueName: \"kubernetes.io/projected/16636b6a-604d-4876-9c18-2ebd9d82eb83-kube-api-access-6npfn\") pod \"16636b6a-604d-4876-9c18-2ebd9d82eb83\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " Jun 02 01:16:57.085937 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.085824 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-bundle\") pod \"16636b6a-604d-4876-9c18-2ebd9d82eb83\" (UID: \"16636b6a-604d-4876-9c18-2ebd9d82eb83\") " Jun 02 01:16:57.086690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.086664 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-bundle" (OuterVolumeSpecName: "bundle") pod "16636b6a-604d-4876-9c18-2ebd9d82eb83" (UID: "16636b6a-604d-4876-9c18-2ebd9d82eb83"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:16:57.087930 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.087888 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16636b6a-604d-4876-9c18-2ebd9d82eb83-kube-api-access-6npfn" (OuterVolumeSpecName: "kube-api-access-6npfn") pod "16636b6a-604d-4876-9c18-2ebd9d82eb83" (UID: "16636b6a-604d-4876-9c18-2ebd9d82eb83"). InnerVolumeSpecName "kube-api-access-6npfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:16:57.090625 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.090605 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-util" (OuterVolumeSpecName: "util") pod "16636b6a-604d-4876-9c18-2ebd9d82eb83" (UID: "16636b6a-604d-4876-9c18-2ebd9d82eb83"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:16:57.186944 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.186895 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:57.186944 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.186940 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6npfn\" (UniqueName: \"kubernetes.io/projected/16636b6a-604d-4876-9c18-2ebd9d82eb83-kube-api-access-6npfn\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:57.187143 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.186960 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16636b6a-604d-4876-9c18-2ebd9d82eb83-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:16:57.951246 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.951211 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" event={"ID":"16636b6a-604d-4876-9c18-2ebd9d82eb83","Type":"ContainerDied","Data":"10948f6497fa40d7059e96795431f64c80238b6915e0232847a3f67e7a38a453"} Jun 02 01:16:57.951246 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.951243 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10948f6497fa40d7059e96795431f64c80238b6915e0232847a3f67e7a38a453" Jun 02 01:16:57.951449 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:16:57.951261 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ldwn9" Jun 02 01:17:01.154325 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.154292 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w"] Jun 02 01:17:01.154684 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.154613 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerName="extract" Jun 02 01:17:01.154684 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.154623 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerName="extract" Jun 02 01:17:01.154684 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.154639 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerName="util" Jun 02 01:17:01.154684 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.154644 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerName="util" Jun 02 01:17:01.154684 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.154661 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerName="pull" Jun 02 01:17:01.154684 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.154666 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerName="pull" Jun 02 01:17:01.154865 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.154712 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="16636b6a-604d-4876-9c18-2ebd9d82eb83" containerName="extract" Jun 02 01:17:01.157677 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.157659 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:01.160151 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.160127 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 01:17:01.160272 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.160185 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8wp48\"" Jun 02 01:17:01.170187 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.170164 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-99frn"] Jun 02 01:17:01.173867 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.173848 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w"] Jun 02 01:17:01.173988 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.173967 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:01.176401 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.176289 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 01:17:01.176882 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.176867 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bbg8g\"" Jun 02 01:17:01.190199 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.190175 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-99frn"] Jun 02 01:17:01.214497 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.214466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-cert\") pod \"llmisvc-controller-manager-c6b9847d7-99frn\" (UID: \"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:01.214674 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.214545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c2q9\" (UniqueName: \"kubernetes.io/projected/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-kube-api-access-7c2q9\") pod \"llmisvc-controller-manager-c6b9847d7-99frn\" (UID: \"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:01.315945 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.315885 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-cert\") pod \"llmisvc-controller-manager-c6b9847d7-99frn\" (UID: \"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:01.316147 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.315965 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7c2q9\" (UniqueName: \"kubernetes.io/projected/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-kube-api-access-7c2q9\") pod \"llmisvc-controller-manager-c6b9847d7-99frn\" (UID: \"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:01.316147 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.316036 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7455b30a-8151-4784-affa-d4fcecf301cd-cert\") pod \"kserve-controller-manager-7c99ffcdcd-jcn7w\" (UID: \"7455b30a-8151-4784-affa-d4fcecf301cd\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:01.316147 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:17:01.316045 2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 02 01:17:01.316147 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.316065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9hb\" (UniqueName: \"kubernetes.io/projected/7455b30a-8151-4784-affa-d4fcecf301cd-kube-api-access-7w9hb\") pod \"kserve-controller-manager-7c99ffcdcd-jcn7w\" (UID: \"7455b30a-8151-4784-affa-d4fcecf301cd\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:01.316147 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:17:01.316117 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-cert podName:1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721 nodeName:}" failed. No retries permitted until 2026-06-02 01:17:01.816093889 +0000 UTC m=+380.597012921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-cert") pod "llmisvc-controller-manager-c6b9847d7-99frn" (UID: "1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721") : secret "llmisvc-webhook-server-cert" not found Jun 02 01:17:01.338432 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.338396 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c2q9\" (UniqueName: \"kubernetes.io/projected/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-kube-api-access-7c2q9\") pod \"llmisvc-controller-manager-c6b9847d7-99frn\" (UID: \"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:01.416819 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.416732 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7455b30a-8151-4784-affa-d4fcecf301cd-cert\") pod \"kserve-controller-manager-7c99ffcdcd-jcn7w\" (UID: \"7455b30a-8151-4784-affa-d4fcecf301cd\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:01.416819 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.416781 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9hb\" (UniqueName: \"kubernetes.io/projected/7455b30a-8151-4784-affa-d4fcecf301cd-kube-api-access-7w9hb\") pod \"kserve-controller-manager-7c99ffcdcd-jcn7w\" (UID: \"7455b30a-8151-4784-affa-d4fcecf301cd\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:01.417081 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:17:01.416868 2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 01:17:01.417081 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:17:01.416960 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7455b30a-8151-4784-affa-d4fcecf301cd-cert podName:7455b30a-8151-4784-affa-d4fcecf301cd nodeName:}" failed. No retries permitted until 2026-06-02 01:17:01.916941051 +0000 UTC m=+380.697860068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7455b30a-8151-4784-affa-d4fcecf301cd-cert") pod "kserve-controller-manager-7c99ffcdcd-jcn7w" (UID: "7455b30a-8151-4784-affa-d4fcecf301cd") : secret "kserve-webhook-server-cert" not found Jun 02 01:17:01.432127 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.432097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9hb\" (UniqueName: \"kubernetes.io/projected/7455b30a-8151-4784-affa-d4fcecf301cd-kube-api-access-7w9hb\") pod \"kserve-controller-manager-7c99ffcdcd-jcn7w\" (UID: \"7455b30a-8151-4784-affa-d4fcecf301cd\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:01.819382 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.819353 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-cert\") pod \"llmisvc-controller-manager-c6b9847d7-99frn\" (UID: \"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:01.821766 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.821739 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721-cert\") pod \"llmisvc-controller-manager-c6b9847d7-99frn\" (UID: \"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:01.920039 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.920002 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7455b30a-8151-4784-affa-d4fcecf301cd-cert\") pod \"kserve-controller-manager-7c99ffcdcd-jcn7w\" (UID: \"7455b30a-8151-4784-affa-d4fcecf301cd\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:01.922467 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:01.922442 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7455b30a-8151-4784-affa-d4fcecf301cd-cert\") pod \"kserve-controller-manager-7c99ffcdcd-jcn7w\" (UID: \"7455b30a-8151-4784-affa-d4fcecf301cd\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:02.068954 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:02.068881 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:02.083716 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:02.083681 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:02.221970 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:02.221943 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w"] Jun 02 01:17:02.223359 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:17:02.223337 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7455b30a_8151_4784_affa_d4fcecf301cd.slice/crio-95746f2975e01e98d1015da37bff27560f940cfbe3504146468f0543995c23d1 WatchSource:0}: Error finding container 95746f2975e01e98d1015da37bff27560f940cfbe3504146468f0543995c23d1: Status 404 returned error can't find the container with id 95746f2975e01e98d1015da37bff27560f940cfbe3504146468f0543995c23d1 Jun 02 01:17:02.261565 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:02.261490 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-99frn"] Jun 02 01:17:02.263554 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:17:02.263529 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1e3f4b4f_0f98_4956_8dd7_3e2ba0acb721.slice/crio-060e1e76c6fe6297cca9c9e2dfce9ef660a31fe1ee821f71448106564aff4fb6 WatchSource:0}: Error finding container 060e1e76c6fe6297cca9c9e2dfce9ef660a31fe1ee821f71448106564aff4fb6: Status 404 returned error can't find the container with id 060e1e76c6fe6297cca9c9e2dfce9ef660a31fe1ee821f71448106564aff4fb6 Jun 02 01:17:02.971008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:02.970939 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" event={"ID":"7455b30a-8151-4784-affa-d4fcecf301cd","Type":"ContainerStarted","Data":"95746f2975e01e98d1015da37bff27560f940cfbe3504146468f0543995c23d1"} Jun 02 01:17:02.972211 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:02.972181 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" event={"ID":"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721","Type":"ContainerStarted","Data":"060e1e76c6fe6297cca9c9e2dfce9ef660a31fe1ee821f71448106564aff4fb6"} Jun 02 01:17:04.981329 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:04.981289 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" event={"ID":"7455b30a-8151-4784-affa-d4fcecf301cd","Type":"ContainerStarted","Data":"7ac322d00ee0395bcb88f8c02e1bc3091b95ef805a27225d758fb1281771923f"} Jun 02 01:17:04.981856 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:04.981545 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:04.989327 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:04.989297 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc"] Jun 02 01:17:04.992537 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:04.992518 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:04.997176 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:04.997155 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:17:04.997284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:04.997256 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:17:04.997343 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:04.997285 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wfvvs\"" Jun 02 01:17:05.006726 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.006662 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc"] Jun 02 01:17:05.024610 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.024553 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" podStartSLOduration=1.493823201 podStartE2EDuration="4.024535053s" podCreationTimestamp="2026-06-02 01:17:01 +0000 UTC" firstStartedPulling="2026-06-02 01:17:02.224570822 +0000 UTC m=+381.005489842" lastFinishedPulling="2026-06-02 01:17:04.755282676 +0000 UTC m=+383.536201694" observedRunningTime="2026-06-02 01:17:05.024253719 +0000 UTC m=+383.805172759" watchObservedRunningTime="2026-06-02 01:17:05.024535053 +0000 UTC m=+383.805454094" Jun 02 01:17:05.053177 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.053138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xztcl\" (UniqueName: \"kubernetes.io/projected/350f7667-192e-4fc2-95e9-e6d019c8c0fa-kube-api-access-xztcl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.053336 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.053234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.053336 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.053298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.154173 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.154137 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xztcl\" (UniqueName: \"kubernetes.io/projected/350f7667-192e-4fc2-95e9-e6d019c8c0fa-kube-api-access-xztcl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.154352 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.154210 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.154352 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.154255 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.154630 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.154610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.154705 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.154648 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.165850 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.165818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xztcl\" (UniqueName: \"kubernetes.io/projected/350f7667-192e-4fc2-95e9-e6d019c8c0fa-kube-api-access-xztcl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.304294 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.304191 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:05.570459 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.570428 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc"] Jun 02 01:17:05.572629 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:17:05.572609 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350f7667_192e_4fc2_95e9_e6d019c8c0fa.slice/crio-41a815194f871a106a63ba52bfe963182f8de62073345e54e7fcbf1504d61528 WatchSource:0}: Error finding container 41a815194f871a106a63ba52bfe963182f8de62073345e54e7fcbf1504d61528: Status 404 returned error can't find the container with id 41a815194f871a106a63ba52bfe963182f8de62073345e54e7fcbf1504d61528 Jun 02 01:17:05.978403 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.978370 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-78fffc7cf9-pd45t"] Jun 02 01:17:05.982176 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.982150 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" Jun 02 01:17:05.985342 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.985322 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fcj8c\"" Jun 02 01:17:05.985535 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.985516 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 01:17:05.986861 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.986832 2578 generic.go:358] "Generic (PLEG): container finished" podID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerID="ea9834e3fc43df93c517ff2f920e25d4193ce3384d0f3ad25989de79e50b1cbd" exitCode=0 Jun 02 01:17:05.986986 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.986930 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" event={"ID":"350f7667-192e-4fc2-95e9-e6d019c8c0fa","Type":"ContainerDied","Data":"ea9834e3fc43df93c517ff2f920e25d4193ce3384d0f3ad25989de79e50b1cbd"} Jun 02 01:17:05.986986 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.986964 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" event={"ID":"350f7667-192e-4fc2-95e9-e6d019c8c0fa","Type":"ContainerStarted","Data":"41a815194f871a106a63ba52bfe963182f8de62073345e54e7fcbf1504d61528"} Jun 02 01:17:05.988808 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.988786 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" event={"ID":"1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721","Type":"ContainerStarted","Data":"80dc3abcb247fcd1eae0fdf15cdda0c5e4fa36e754612ee42d370d1bbaf50f3e"} Jun 02 01:17:05.997721 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:05.997698 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78fffc7cf9-pd45t"] Jun 02 01:17:06.037206 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.037147 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" podStartSLOduration=1.835277163 podStartE2EDuration="5.037128503s" podCreationTimestamp="2026-06-02 01:17:01 +0000 UTC" firstStartedPulling="2026-06-02 01:17:02.264955519 +0000 UTC m=+381.045874539" lastFinishedPulling="2026-06-02 01:17:05.466806862 +0000 UTC m=+384.247725879" observedRunningTime="2026-06-02 01:17:06.035348704 +0000 UTC m=+384.816267750" watchObservedRunningTime="2026-06-02 01:17:06.037128503 +0000 UTC m=+384.818047543" Jun 02 01:17:06.064394 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.064352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6417204b-862f-4916-8df2-e9b7859bac16-redirect-config\") pod \"dashboard-redirect-78fffc7cf9-pd45t\" (UID: \"6417204b-862f-4916-8df2-e9b7859bac16\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" Jun 02 01:17:06.064561 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.064401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bz7m\" (UniqueName: \"kubernetes.io/projected/6417204b-862f-4916-8df2-e9b7859bac16-kube-api-access-9bz7m\") pod \"dashboard-redirect-78fffc7cf9-pd45t\" (UID: \"6417204b-862f-4916-8df2-e9b7859bac16\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" Jun 02 01:17:06.165620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.165584 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6417204b-862f-4916-8df2-e9b7859bac16-redirect-config\") pod \"dashboard-redirect-78fffc7cf9-pd45t\" (UID: \"6417204b-862f-4916-8df2-e9b7859bac16\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" Jun 02 01:17:06.165620 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.165623 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bz7m\" (UniqueName: \"kubernetes.io/projected/6417204b-862f-4916-8df2-e9b7859bac16-kube-api-access-9bz7m\") pod \"dashboard-redirect-78fffc7cf9-pd45t\" (UID: \"6417204b-862f-4916-8df2-e9b7859bac16\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" Jun 02 01:17:06.166299 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.166281 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6417204b-862f-4916-8df2-e9b7859bac16-redirect-config\") pod \"dashboard-redirect-78fffc7cf9-pd45t\" (UID: \"6417204b-862f-4916-8df2-e9b7859bac16\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" Jun 02 01:17:06.173973 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.173950 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bz7m\" (UniqueName: \"kubernetes.io/projected/6417204b-862f-4916-8df2-e9b7859bac16-kube-api-access-9bz7m\") pod \"dashboard-redirect-78fffc7cf9-pd45t\" (UID: \"6417204b-862f-4916-8df2-e9b7859bac16\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" Jun 02 01:17:06.296002 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.295905 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" Jun 02 01:17:06.384038 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.384007 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq"] Jun 02 01:17:06.388854 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.388833 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:06.393313 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.393285 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 01:17:06.394683 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.394648 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 01:17:06.397961 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.397936 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-rd9ps\"" Jun 02 01:17:06.406367 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.406311 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq"] Jun 02 01:17:06.444618 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.444597 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78fffc7cf9-pd45t"] Jun 02 01:17:06.446700 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:17:06.446661 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6417204b_862f_4916_8df2_e9b7859bac16.slice/crio-e5cdd63b371aa6818cec3817faa20450c8eaecaba6d03aa41b2636e4af64c9be WatchSource:0}: Error finding container e5cdd63b371aa6818cec3817faa20450c8eaecaba6d03aa41b2636e4af64c9be: Status 404 returned error can't find the container with id e5cdd63b371aa6818cec3817faa20450c8eaecaba6d03aa41b2636e4af64c9be Jun 02 01:17:06.469165 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.469141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wcq2\" (UniqueName: \"kubernetes.io/projected/b3662acc-a31e-4cdc-bf92-0831336cb3b0-kube-api-access-2wcq2\") pod \"servicemesh-operator3-55f49c5f94-zfzxq\" (UID: \"b3662acc-a31e-4cdc-bf92-0831336cb3b0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:06.469271 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.469204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b3662acc-a31e-4cdc-bf92-0831336cb3b0-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zfzxq\" (UID: \"b3662acc-a31e-4cdc-bf92-0831336cb3b0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:06.570112 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.570080 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b3662acc-a31e-4cdc-bf92-0831336cb3b0-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zfzxq\" (UID: \"b3662acc-a31e-4cdc-bf92-0831336cb3b0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:06.570256 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.570205 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wcq2\" (UniqueName: \"kubernetes.io/projected/b3662acc-a31e-4cdc-bf92-0831336cb3b0-kube-api-access-2wcq2\") pod \"servicemesh-operator3-55f49c5f94-zfzxq\" (UID: \"b3662acc-a31e-4cdc-bf92-0831336cb3b0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:06.572872 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.572845 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b3662acc-a31e-4cdc-bf92-0831336cb3b0-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zfzxq\" (UID: \"b3662acc-a31e-4cdc-bf92-0831336cb3b0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:06.580560 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.580536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wcq2\" (UniqueName: \"kubernetes.io/projected/b3662acc-a31e-4cdc-bf92-0831336cb3b0-kube-api-access-2wcq2\") pod \"servicemesh-operator3-55f49c5f94-zfzxq\" (UID: \"b3662acc-a31e-4cdc-bf92-0831336cb3b0\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:06.700049 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.700016 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:06.840516 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.840490 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq"] Jun 02 01:17:06.842774 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:17:06.842749 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3662acc_a31e_4cdc_bf92_0831336cb3b0.slice/crio-127dd6b2a141a49a5c39fe995720a40f2af658ad56f4d7d13cf0e0a494f6c812 WatchSource:0}: Error finding container 127dd6b2a141a49a5c39fe995720a40f2af658ad56f4d7d13cf0e0a494f6c812: Status 404 returned error can't find the container with id 127dd6b2a141a49a5c39fe995720a40f2af658ad56f4d7d13cf0e0a494f6c812 Jun 02 01:17:06.950476 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.950449 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-zqfjg" Jun 02 01:17:06.994883 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.994838 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" event={"ID":"6417204b-862f-4916-8df2-e9b7859bac16","Type":"ContainerStarted","Data":"e5cdd63b371aa6818cec3817faa20450c8eaecaba6d03aa41b2636e4af64c9be"} Jun 02 01:17:06.996876 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.996836 2578 generic.go:358] "Generic (PLEG): container finished" podID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerID="3559f9d3e23050d4f2b1f7a1a7ca50c4290ae2ff438f5d7f09b9972365e3da10" exitCode=0 Jun 02 01:17:06.997006 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.996900 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" event={"ID":"350f7667-192e-4fc2-95e9-e6d019c8c0fa","Type":"ContainerDied","Data":"3559f9d3e23050d4f2b1f7a1a7ca50c4290ae2ff438f5d7f09b9972365e3da10"} Jun 02 01:17:06.998252 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.998222 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" event={"ID":"b3662acc-a31e-4cdc-bf92-0831336cb3b0","Type":"ContainerStarted","Data":"127dd6b2a141a49a5c39fe995720a40f2af658ad56f4d7d13cf0e0a494f6c812"} Jun 02 01:17:06.998369 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:06.998348 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:08.004693 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:08.004664 2578 generic.go:358] "Generic (PLEG): container finished" podID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerID="6199b4fab7e6a83d768ad6a8569743247180f12d35920ff14dde6d3b92e74487" exitCode=0 Jun 02 01:17:08.005136 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:08.004756 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" event={"ID":"350f7667-192e-4fc2-95e9-e6d019c8c0fa","Type":"ContainerDied","Data":"6199b4fab7e6a83d768ad6a8569743247180f12d35920ff14dde6d3b92e74487"} Jun 02 01:17:09.015395 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.015337 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" event={"ID":"6417204b-862f-4916-8df2-e9b7859bac16","Type":"ContainerStarted","Data":"4213252ad13e848cb3c5eb1d299d1deeef35fc1e03a4a205e601212e46423fb3"} Jun 02 01:17:09.034360 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.034200 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-78fffc7cf9-pd45t" podStartSLOduration=2.260786293 podStartE2EDuration="4.034182592s" podCreationTimestamp="2026-06-02 01:17:05 +0000 UTC" firstStartedPulling="2026-06-02 01:17:06.448045495 +0000 UTC m=+385.228964516" lastFinishedPulling="2026-06-02 01:17:08.221441794 +0000 UTC m=+387.002360815" observedRunningTime="2026-06-02 01:17:09.032227808 +0000 UTC m=+387.813146839" watchObservedRunningTime="2026-06-02 01:17:09.034182592 +0000 UTC m=+387.815101634" Jun 02 01:17:09.162213 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.162183 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:09.197476 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.197445 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-bundle\") pod \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " Jun 02 01:17:09.197641 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.197508 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xztcl\" (UniqueName: \"kubernetes.io/projected/350f7667-192e-4fc2-95e9-e6d019c8c0fa-kube-api-access-xztcl\") pod \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " Jun 02 01:17:09.197641 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.197546 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-util\") pod \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\" (UID: \"350f7667-192e-4fc2-95e9-e6d019c8c0fa\") " Jun 02 01:17:09.198421 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.198391 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-bundle" (OuterVolumeSpecName: "bundle") pod "350f7667-192e-4fc2-95e9-e6d019c8c0fa" (UID: "350f7667-192e-4fc2-95e9-e6d019c8c0fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:17:09.200252 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.200220 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/350f7667-192e-4fc2-95e9-e6d019c8c0fa-kube-api-access-xztcl" (OuterVolumeSpecName: "kube-api-access-xztcl") pod "350f7667-192e-4fc2-95e9-e6d019c8c0fa" (UID: "350f7667-192e-4fc2-95e9-e6d019c8c0fa"). InnerVolumeSpecName "kube-api-access-xztcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:17:09.203488 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.203458 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-util" (OuterVolumeSpecName: "util") pod "350f7667-192e-4fc2-95e9-e6d019c8c0fa" (UID: "350f7667-192e-4fc2-95e9-e6d019c8c0fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:17:09.298455 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.298383 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:17:09.298455 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.298413 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xztcl\" (UniqueName: \"kubernetes.io/projected/350f7667-192e-4fc2-95e9-e6d019c8c0fa-kube-api-access-xztcl\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:17:09.298455 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:09.298424 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/350f7667-192e-4fc2-95e9-e6d019c8c0fa-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:17:10.020715 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:10.020646 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" Jun 02 01:17:10.021109 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:10.020646 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a72nhc" event={"ID":"350f7667-192e-4fc2-95e9-e6d019c8c0fa","Type":"ContainerDied","Data":"41a815194f871a106a63ba52bfe963182f8de62073345e54e7fcbf1504d61528"} Jun 02 01:17:10.021109 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:10.020756 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41a815194f871a106a63ba52bfe963182f8de62073345e54e7fcbf1504d61528" Jun 02 01:17:11.028485 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:11.028453 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" event={"ID":"b3662acc-a31e-4cdc-bf92-0831336cb3b0","Type":"ContainerStarted","Data":"89d82076b9983b582aabe15d3d3ffd6c2d5dc9e10d0d6439b10e1c32a5ee84fd"} Jun 02 01:17:11.028887 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:11.028576 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:11.049184 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:11.049133 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" podStartSLOduration=1.7236963520000002 podStartE2EDuration="5.049119028s" podCreationTimestamp="2026-06-02 01:17:06 +0000 UTC" firstStartedPulling="2026-06-02 01:17:06.845360543 +0000 UTC m=+385.626279574" lastFinishedPulling="2026-06-02 01:17:10.170783221 +0000 UTC m=+388.951702250" observedRunningTime="2026-06-02 01:17:11.045966452 +0000 UTC m=+389.826885488" watchObservedRunningTime="2026-06-02 01:17:11.049119028 +0000 UTC m=+389.830038066" Jun 02 01:17:21.534312 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.534276 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv"] Jun 02 01:17:21.534782 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.534747 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerName="extract" Jun 02 01:17:21.534782 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.534762 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerName="extract" Jun 02 01:17:21.534851 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.534786 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerName="pull" Jun 02 01:17:21.534851 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.534794 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerName="pull" Jun 02 01:17:21.534851 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.534817 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerName="util" Jun 02 01:17:21.534851 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.534825 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerName="util" Jun 02 01:17:21.535010 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.534946 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="350f7667-192e-4fc2-95e9-e6d019c8c0fa" containerName="extract" Jun 02 01:17:21.541618 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.541596 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.543974 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.543952 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 01:17:21.544088 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.544032 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nbkbk\"" Jun 02 01:17:21.544162 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.544149 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 01:17:21.544345 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.544326 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 01:17:21.544435 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.544346 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 01:17:21.548621 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.548601 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv"] Jun 02 01:17:21.610293 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.610259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.610293 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.610302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.610546 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.610380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.610546 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.610463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.610546 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.610500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/962303fa-47d3-44c3-abc9-bde86b23fc61-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.610546 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.610525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.610735 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.610627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7h5f\" (UniqueName: \"kubernetes.io/projected/962303fa-47d3-44c3-abc9-bde86b23fc61-kube-api-access-m7h5f\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.711764 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.711728 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.712008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.711780 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/962303fa-47d3-44c3-abc9-bde86b23fc61-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.712008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.711812 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.712008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.711873 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7h5f\" (UniqueName: \"kubernetes.io/projected/962303fa-47d3-44c3-abc9-bde86b23fc61-kube-api-access-m7h5f\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.712008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.711942 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.712008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.711973 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.712261 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.712014 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.712797 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.712763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.714698 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.714666 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/962303fa-47d3-44c3-abc9-bde86b23fc61-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.714810 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.714707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.714875 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.714820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.714945 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.714905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.719590 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.719568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/962303fa-47d3-44c3-abc9-bde86b23fc61-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.719881 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.719859 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7h5f\" (UniqueName: \"kubernetes.io/projected/962303fa-47d3-44c3-abc9-bde86b23fc61-kube-api-access-m7h5f\") pod \"istiod-openshift-gateway-798958bb55-gslkv\" (UID: \"962303fa-47d3-44c3-abc9-bde86b23fc61\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.852540 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.852502 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:21.997493 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:21.997444 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv"] Jun 02 01:17:22.000090 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:17:22.000051 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962303fa_47d3_44c3_abc9_bde86b23fc61.slice/crio-02be3d2e56afdeab35157d30faf3826a70c59f2e306ef3f0eb4d596fad8d87d1 WatchSource:0}: Error finding container 02be3d2e56afdeab35157d30faf3826a70c59f2e306ef3f0eb4d596fad8d87d1: Status 404 returned error can't find the container with id 02be3d2e56afdeab35157d30faf3826a70c59f2e306ef3f0eb4d596fad8d87d1 Jun 02 01:17:22.034635 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:22.034610 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zfzxq" Jun 02 01:17:22.071155 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:22.071118 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" event={"ID":"962303fa-47d3-44c3-abc9-bde86b23fc61","Type":"ContainerStarted","Data":"02be3d2e56afdeab35157d30faf3826a70c59f2e306ef3f0eb4d596fad8d87d1"} Jun 02 01:17:24.972819 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:24.972780 2578 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 01:17:24.973116 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:24.972848 2578 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 01:17:25.086613 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:25.086574 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" event={"ID":"962303fa-47d3-44c3-abc9-bde86b23fc61","Type":"ContainerStarted","Data":"e90e8881ab9daf493818adc56a4f50d6ac9a113e9eb085b8e340f3da3f1224f4"} Jun 02 01:17:25.086794 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:25.086644 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:25.107926 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:25.107865 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" podStartSLOduration=1.137340744 podStartE2EDuration="4.107850137s" podCreationTimestamp="2026-06-02 01:17:21 +0000 UTC" firstStartedPulling="2026-06-02 01:17:22.002036289 +0000 UTC m=+400.782955306" lastFinishedPulling="2026-06-02 01:17:24.972545678 +0000 UTC m=+403.753464699" observedRunningTime="2026-06-02 01:17:25.106228719 +0000 UTC m=+403.887147782" watchObservedRunningTime="2026-06-02 01:17:25.107850137 +0000 UTC m=+403.888769175" Jun 02 01:17:26.098898 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:26.098863 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-gslkv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 01:17:26.099275 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:26.098956 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" podUID="962303fa-47d3-44c3-abc9-bde86b23fc61" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:17:29.097772 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:29.097740 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gslkv" Jun 02 01:17:35.994327 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:35.994293 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-jcn7w" Jun 02 01:17:38.007176 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:38.007143 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-99frn" Jun 02 01:17:57.259428 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.259383 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84d56c9c97-274zk"] Jun 02 01:17:57.272617 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.272585 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84d56c9c97-274zk"] Jun 02 01:17:57.272768 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.272728 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.275071 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.275045 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:17:57.275206 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.275068 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:17:57.275324 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.275308 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:17:57.275377 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.275334 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-45c4f\"" Jun 02 01:17:57.276015 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.275934 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:17:57.276225 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.276162 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:17:57.276225 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.276169 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:17:57.276590 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.276572 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:17:57.280193 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.280154 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:17:57.316422 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.316381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjr87\" (UniqueName: \"kubernetes.io/projected/796ac906-d804-4451-996a-8a8b83004c37-kube-api-access-mjr87\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.316580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.316460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-service-ca\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.316580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.316519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-console-config\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.316580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.316543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-oauth-serving-cert\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.316719 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.316696 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/796ac906-d804-4451-996a-8a8b83004c37-console-serving-cert\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.316762 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.316729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-trusted-ca-bundle\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.316762 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.316760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/796ac906-d804-4451-996a-8a8b83004c37-console-oauth-config\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.417506 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.417469 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/796ac906-d804-4451-996a-8a8b83004c37-console-serving-cert\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.417506 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.417508 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-trusted-ca-bundle\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.417763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.417533 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/796ac906-d804-4451-996a-8a8b83004c37-console-oauth-config\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.417763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.417591 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mjr87\" (UniqueName: \"kubernetes.io/projected/796ac906-d804-4451-996a-8a8b83004c37-kube-api-access-mjr87\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.417763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.417638 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-service-ca\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.417763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.417667 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-console-config\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.417763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.417688 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-oauth-serving-cert\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.418422 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.418401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-oauth-serving-cert\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.418520 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.418456 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-service-ca\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.418563 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.418544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-console-config\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.418651 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.418635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/796ac906-d804-4451-996a-8a8b83004c37-trusted-ca-bundle\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.420007 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.419988 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/796ac906-d804-4451-996a-8a8b83004c37-console-oauth-config\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.420116 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.420097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/796ac906-d804-4451-996a-8a8b83004c37-console-serving-cert\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.427977 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.427957 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjr87\" (UniqueName: \"kubernetes.io/projected/796ac906-d804-4451-996a-8a8b83004c37-kube-api-access-mjr87\") pod \"console-84d56c9c97-274zk\" (UID: \"796ac906-d804-4451-996a-8a8b83004c37\") " pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.584104 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.584063 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:17:57.713296 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:57.713269 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84d56c9c97-274zk"] Jun 02 01:17:57.721533 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:17:57.721506 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod796ac906_d804_4451_996a_8a8b83004c37.slice/crio-fd8592e257d8354dadbe564808588be6d42721050c594774623e09a1f3f218b2 WatchSource:0}: Error finding container fd8592e257d8354dadbe564808588be6d42721050c594774623e09a1f3f218b2: Status 404 returned error can't find the container with id fd8592e257d8354dadbe564808588be6d42721050c594774623e09a1f3f218b2 Jun 02 01:17:58.209882 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:58.209840 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d56c9c97-274zk" event={"ID":"796ac906-d804-4451-996a-8a8b83004c37","Type":"ContainerStarted","Data":"a30d01cbfcde7a6f27b985ee42e34f409fcd366354318bc2c60858a4976980f4"} Jun 02 01:17:58.209882 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:58.209888 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84d56c9c97-274zk" event={"ID":"796ac906-d804-4451-996a-8a8b83004c37","Type":"ContainerStarted","Data":"fd8592e257d8354dadbe564808588be6d42721050c594774623e09a1f3f218b2"} Jun 02 01:17:58.226557 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:17:58.226502 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84d56c9c97-274zk" podStartSLOduration=1.226487552 podStartE2EDuration="1.226487552s" podCreationTimestamp="2026-06-02 01:17:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:17:58.224579863 +0000 UTC m=+437.005498917" watchObservedRunningTime="2026-06-02 01:17:58.226487552 +0000 UTC m=+437.007406590" Jun 02 01:18:06.585264 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.585228 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv"] Jun 02 01:18:06.594268 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.594245 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.594394 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.594349 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv"] Jun 02 01:18:06.596287 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.596268 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zd7mt\"" Jun 02 01:18:06.597128 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.597109 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 01:18:06.597202 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.597114 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 01:18:06.701248 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.701211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.701415 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.701288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.701415 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.701334 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kjls\" (UniqueName: \"kubernetes.io/projected/26e31b3c-5079-4a51-b2b7-6e252b173b11-kube-api-access-4kjls\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.802426 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.802387 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.802577 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.802445 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.802647 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.802621 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kjls\" (UniqueName: \"kubernetes.io/projected/26e31b3c-5079-4a51-b2b7-6e252b173b11-kube-api-access-4kjls\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.802787 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.802772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.802828 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.802811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.809991 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.809962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kjls\" (UniqueName: \"kubernetes.io/projected/26e31b3c-5079-4a51-b2b7-6e252b173b11-kube-api-access-4kjls\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:06.904240 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:06.904163 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:07.032573 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.032545 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv"] Jun 02 01:18:07.034717 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:18:07.034691 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e31b3c_5079_4a51_b2b7_6e252b173b11.slice/crio-666576dbdba6dc732a82c6a18467651794ab949001efd375bcf38c7fcb0fdc12 WatchSource:0}: Error finding container 666576dbdba6dc732a82c6a18467651794ab949001efd375bcf38c7fcb0fdc12: Status 404 returned error can't find the container with id 666576dbdba6dc732a82c6a18467651794ab949001efd375bcf38c7fcb0fdc12 Jun 02 01:18:07.183389 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.183313 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz"] Jun 02 01:18:07.187086 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.187069 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.193791 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.193767 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz"] Jun 02 01:18:07.245964 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.245898 2578 generic.go:358] "Generic (PLEG): container finished" podID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerID="9fb44945a4d17509ac1a21a4ae12d4afa3ec275b14bd89baffd85bbe1e4b76bc" exitCode=0 Jun 02 01:18:07.246115 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.245984 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" event={"ID":"26e31b3c-5079-4a51-b2b7-6e252b173b11","Type":"ContainerDied","Data":"9fb44945a4d17509ac1a21a4ae12d4afa3ec275b14bd89baffd85bbe1e4b76bc"} Jun 02 01:18:07.246115 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.246022 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" event={"ID":"26e31b3c-5079-4a51-b2b7-6e252b173b11","Type":"ContainerStarted","Data":"666576dbdba6dc732a82c6a18467651794ab949001efd375bcf38c7fcb0fdc12"} Jun 02 01:18:07.308160 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.308125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.308318 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.308169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9hth\" (UniqueName: \"kubernetes.io/projected/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-kube-api-access-k9hth\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.308318 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.308248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.411713 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.411670 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.411929 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.411789 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.411929 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.411837 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9hth\" (UniqueName: \"kubernetes.io/projected/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-kube-api-access-k9hth\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.412468 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.412436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.412570 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.412443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.419190 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.419170 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9hth\" (UniqueName: \"kubernetes.io/projected/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-kube-api-access-k9hth\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.510236 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.510137 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:07.584902 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.584866 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:18:07.585064 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.584928 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:18:07.590974 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.590948 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:18:07.640650 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.640621 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz"] Jun 02 01:18:07.642896 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:18:07.642859 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c342fc3_3cbd_4014_8836_85e1dbbdc5eb.slice/crio-714fcf1756c3f04d5e70cec63dfa0227d2f223f3a8ab50a61991085da6cba750 WatchSource:0}: Error finding container 714fcf1756c3f04d5e70cec63dfa0227d2f223f3a8ab50a61991085da6cba750: Status 404 returned error can't find the container with id 714fcf1756c3f04d5e70cec63dfa0227d2f223f3a8ab50a61991085da6cba750 Jun 02 01:18:07.780973 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.780947 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6"] Jun 02 01:18:07.784773 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.784756 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.790313 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.790287 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6"] Jun 02 01:18:07.815924 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.815888 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.816055 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.815944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvhz7\" (UniqueName: \"kubernetes.io/projected/bead123a-5c0f-44b2-b361-40ccbf76f089-kube-api-access-rvhz7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.816119 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.816061 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.917228 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.917201 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.917375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.917288 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.917375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.917331 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvhz7\" (UniqueName: \"kubernetes.io/projected/bead123a-5c0f-44b2-b361-40ccbf76f089-kube-api-access-rvhz7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.917542 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.917519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.917604 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.917558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:07.925495 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:07.925471 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvhz7\" (UniqueName: \"kubernetes.io/projected/bead123a-5c0f-44b2-b361-40ccbf76f089-kube-api-access-rvhz7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:08.144955 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.144891 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:08.186769 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.186739 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs"] Jun 02 01:18:08.192154 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.191857 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.197829 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.197796 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs"] Jun 02 01:18:08.253078 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.253047 2578 generic.go:358] "Generic (PLEG): container finished" podID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerID="d2738358d6f63e29494e9acd1b5f862c7a83b3ac44db895d5511070c520b58f8" exitCode=0 Jun 02 01:18:08.253265 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.253177 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" event={"ID":"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb","Type":"ContainerDied","Data":"d2738358d6f63e29494e9acd1b5f862c7a83b3ac44db895d5511070c520b58f8"} Jun 02 01:18:08.253265 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.253210 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" event={"ID":"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb","Type":"ContainerStarted","Data":"714fcf1756c3f04d5e70cec63dfa0227d2f223f3a8ab50a61991085da6cba750"} Jun 02 01:18:08.255150 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.255121 2578 generic.go:358] "Generic (PLEG): container finished" podID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerID="721f16578432e8b6bbf2c1f8080c5f43671db51d426cceb0ec152b5b496e6d16" exitCode=0 Jun 02 01:18:08.255253 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.255187 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" event={"ID":"26e31b3c-5079-4a51-b2b7-6e252b173b11","Type":"ContainerDied","Data":"721f16578432e8b6bbf2c1f8080c5f43671db51d426cceb0ec152b5b496e6d16"} Jun 02 01:18:08.260714 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.260661 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84d56c9c97-274zk" Jun 02 01:18:08.278639 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.278614 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6"] Jun 02 01:18:08.288116 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:18:08.288089 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbead123a_5c0f_44b2_b361_40ccbf76f089.slice/crio-3c01475adb585b4928ed8ab12a1e30dc21a2dc94165cfb7073037fb1eb7e8535 WatchSource:0}: Error finding container 3c01475adb585b4928ed8ab12a1e30dc21a2dc94165cfb7073037fb1eb7e8535: Status 404 returned error can't find the container with id 3c01475adb585b4928ed8ab12a1e30dc21a2dc94165cfb7073037fb1eb7e8535 Jun 02 01:18:08.321786 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.321400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.321786 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.321450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.321786 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.321500 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpsb4\" (UniqueName: \"kubernetes.io/projected/a447c11d-58d8-436c-b7ad-55d3acb69fee-kube-api-access-kpsb4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.422814 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.422784 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.422948 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.422823 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.422948 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.422846 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpsb4\" (UniqueName: \"kubernetes.io/projected/a447c11d-58d8-436c-b7ad-55d3acb69fee-kube-api-access-kpsb4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.423324 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.423298 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.423443 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.423339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.431327 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.431303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpsb4\" (UniqueName: \"kubernetes.io/projected/a447c11d-58d8-436c-b7ad-55d3acb69fee-kube-api-access-kpsb4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.508141 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.508112 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:08.657252 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:08.657228 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs"] Jun 02 01:18:08.658167 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:18:08.658135 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda447c11d_58d8_436c_b7ad_55d3acb69fee.slice/crio-3617ce8ed1835511eca5902c1045b5aeedb19b90d7e969a7050e92f39b48b9df WatchSource:0}: Error finding container 3617ce8ed1835511eca5902c1045b5aeedb19b90d7e969a7050e92f39b48b9df: Status 404 returned error can't find the container with id 3617ce8ed1835511eca5902c1045b5aeedb19b90d7e969a7050e92f39b48b9df Jun 02 01:18:09.260821 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.260732 2578 generic.go:358] "Generic (PLEG): container finished" podID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerID="afda490ba044d208c201354a805d182cd233a299f7201a57d989ecd836c00427" exitCode=0 Jun 02 01:18:09.260821 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.260783 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" event={"ID":"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb","Type":"ContainerDied","Data":"afda490ba044d208c201354a805d182cd233a299f7201a57d989ecd836c00427"} Jun 02 01:18:09.262824 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.262803 2578 generic.go:358] "Generic (PLEG): container finished" podID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerID="d1097c3487800f5225345c717497a8aa8c420c4cd9d52cb9a1918b4d33fcf1a7" exitCode=0 Jun 02 01:18:09.262948 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.262862 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" event={"ID":"26e31b3c-5079-4a51-b2b7-6e252b173b11","Type":"ContainerDied","Data":"d1097c3487800f5225345c717497a8aa8c420c4cd9d52cb9a1918b4d33fcf1a7"} Jun 02 01:18:09.264264 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.264243 2578 generic.go:358] "Generic (PLEG): container finished" podID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerID="41ce2ea6c5faee1db34f60f3e5897fcf7ba88e9f1e0e80ccbda5bc06762764e6" exitCode=0 Jun 02 01:18:09.264334 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.264295 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" event={"ID":"a447c11d-58d8-436c-b7ad-55d3acb69fee","Type":"ContainerDied","Data":"41ce2ea6c5faee1db34f60f3e5897fcf7ba88e9f1e0e80ccbda5bc06762764e6"} Jun 02 01:18:09.264334 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.264316 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" event={"ID":"a447c11d-58d8-436c-b7ad-55d3acb69fee","Type":"ContainerStarted","Data":"3617ce8ed1835511eca5902c1045b5aeedb19b90d7e969a7050e92f39b48b9df"} Jun 02 01:18:09.265637 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.265617 2578 generic.go:358] "Generic (PLEG): container finished" podID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerID="54c4bcef7b3d6a6005fbc644f41d0911ee966268fe2235ecf821f17b6910c5fa" exitCode=0 Jun 02 01:18:09.265719 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.265650 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" event={"ID":"bead123a-5c0f-44b2-b361-40ccbf76f089","Type":"ContainerDied","Data":"54c4bcef7b3d6a6005fbc644f41d0911ee966268fe2235ecf821f17b6910c5fa"} Jun 02 01:18:09.265719 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:09.265685 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" event={"ID":"bead123a-5c0f-44b2-b361-40ccbf76f089","Type":"ContainerStarted","Data":"3c01475adb585b4928ed8ab12a1e30dc21a2dc94165cfb7073037fb1eb7e8535"} Jun 02 01:18:10.271031 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.270951 2578 generic.go:358] "Generic (PLEG): container finished" podID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerID="1b9ac44cd70c60fc7bab60ffdf2a04d53ce878de3a601ab3a8bcb61b3ad83754" exitCode=0 Jun 02 01:18:10.271462 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.271028 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" event={"ID":"a447c11d-58d8-436c-b7ad-55d3acb69fee","Type":"ContainerDied","Data":"1b9ac44cd70c60fc7bab60ffdf2a04d53ce878de3a601ab3a8bcb61b3ad83754"} Jun 02 01:18:10.272631 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.272603 2578 generic.go:358] "Generic (PLEG): container finished" podID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerID="9fe4de9441d5a059436360dc655f32af5754fb8ceaa6e680a9de834bba537f7f" exitCode=0 Jun 02 01:18:10.272732 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.272639 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" event={"ID":"bead123a-5c0f-44b2-b361-40ccbf76f089","Type":"ContainerDied","Data":"9fe4de9441d5a059436360dc655f32af5754fb8ceaa6e680a9de834bba537f7f"} Jun 02 01:18:10.274714 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.274692 2578 generic.go:358] "Generic (PLEG): container finished" podID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerID="4baf76841604cf6d103c05f3778258b08fbb1776e93498abb4fd438360f16291" exitCode=0 Jun 02 01:18:10.274794 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.274771 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" event={"ID":"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb","Type":"ContainerDied","Data":"4baf76841604cf6d103c05f3778258b08fbb1776e93498abb4fd438360f16291"} Jun 02 01:18:10.403162 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.403133 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:10.442168 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.442138 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kjls\" (UniqueName: \"kubernetes.io/projected/26e31b3c-5079-4a51-b2b7-6e252b173b11-kube-api-access-4kjls\") pod \"26e31b3c-5079-4a51-b2b7-6e252b173b11\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " Jun 02 01:18:10.442335 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.442241 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-bundle\") pod \"26e31b3c-5079-4a51-b2b7-6e252b173b11\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " Jun 02 01:18:10.442407 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.442334 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-util\") pod \"26e31b3c-5079-4a51-b2b7-6e252b173b11\" (UID: \"26e31b3c-5079-4a51-b2b7-6e252b173b11\") " Jun 02 01:18:10.442839 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.442815 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-bundle" (OuterVolumeSpecName: "bundle") pod "26e31b3c-5079-4a51-b2b7-6e252b173b11" (UID: "26e31b3c-5079-4a51-b2b7-6e252b173b11"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:10.444267 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.444245 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26e31b3c-5079-4a51-b2b7-6e252b173b11-kube-api-access-4kjls" (OuterVolumeSpecName: "kube-api-access-4kjls") pod "26e31b3c-5079-4a51-b2b7-6e252b173b11" (UID: "26e31b3c-5079-4a51-b2b7-6e252b173b11"). InnerVolumeSpecName "kube-api-access-4kjls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:18:10.449593 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.449572 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-util" (OuterVolumeSpecName: "util") pod "26e31b3c-5079-4a51-b2b7-6e252b173b11" (UID: "26e31b3c-5079-4a51-b2b7-6e252b173b11"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:10.543591 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.543509 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:10.543591 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.543542 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kjls\" (UniqueName: \"kubernetes.io/projected/26e31b3c-5079-4a51-b2b7-6e252b173b11-kube-api-access-4kjls\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:10.543591 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:10.543558 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26e31b3c-5079-4a51-b2b7-6e252b173b11-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:11.280636 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.280561 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" Jun 02 01:18:11.281074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.280560 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv" event={"ID":"26e31b3c-5079-4a51-b2b7-6e252b173b11","Type":"ContainerDied","Data":"666576dbdba6dc732a82c6a18467651794ab949001efd375bcf38c7fcb0fdc12"} Jun 02 01:18:11.281074 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.280677 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="666576dbdba6dc732a82c6a18467651794ab949001efd375bcf38c7fcb0fdc12" Jun 02 01:18:11.282396 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.282369 2578 generic.go:358] "Generic (PLEG): container finished" podID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerID="cdf2a65e09279bc90254ccf092426300d8e84448ebd5061f11c503d697c8d08a" exitCode=0 Jun 02 01:18:11.282515 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.282449 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" event={"ID":"a447c11d-58d8-436c-b7ad-55d3acb69fee","Type":"ContainerDied","Data":"cdf2a65e09279bc90254ccf092426300d8e84448ebd5061f11c503d697c8d08a"} Jun 02 01:18:11.284201 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.284178 2578 generic.go:358] "Generic (PLEG): container finished" podID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerID="6fa15e91d29c249b267c1b8589e890c05c4c702c2d1fcd34bf55256b484d0efa" exitCode=0 Jun 02 01:18:11.284287 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.284270 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" event={"ID":"bead123a-5c0f-44b2-b361-40ccbf76f089","Type":"ContainerDied","Data":"6fa15e91d29c249b267c1b8589e890c05c4c702c2d1fcd34bf55256b484d0efa"} Jun 02 01:18:11.416287 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.416236 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:11.452012 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.451975 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9hth\" (UniqueName: \"kubernetes.io/projected/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-kube-api-access-k9hth\") pod \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " Jun 02 01:18:11.452169 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.452024 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-bundle\") pod \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " Jun 02 01:18:11.452169 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.452053 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-util\") pod \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\" (UID: \"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb\") " Jun 02 01:18:11.452501 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.452477 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-bundle" (OuterVolumeSpecName: "bundle") pod "1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" (UID: "1c342fc3-3cbd-4014-8836-85e1dbbdc5eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:11.454305 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.454278 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-kube-api-access-k9hth" (OuterVolumeSpecName: "kube-api-access-k9hth") pod "1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" (UID: "1c342fc3-3cbd-4014-8836-85e1dbbdc5eb"). InnerVolumeSpecName "kube-api-access-k9hth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:18:11.457654 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.457627 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-util" (OuterVolumeSpecName: "util") pod "1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" (UID: "1c342fc3-3cbd-4014-8836-85e1dbbdc5eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:11.553179 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.553086 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9hth\" (UniqueName: \"kubernetes.io/projected/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-kube-api-access-k9hth\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:11.553179 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.553120 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:11.553179 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:11.553136 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c342fc3-3cbd-4014-8836-85e1dbbdc5eb-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:12.289825 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.289797 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" Jun 02 01:18:12.289825 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.289814 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz" event={"ID":"1c342fc3-3cbd-4014-8836-85e1dbbdc5eb","Type":"ContainerDied","Data":"714fcf1756c3f04d5e70cec63dfa0227d2f223f3a8ab50a61991085da6cba750"} Jun 02 01:18:12.290289 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.289851 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="714fcf1756c3f04d5e70cec63dfa0227d2f223f3a8ab50a61991085da6cba750" Jun 02 01:18:12.420623 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.420599 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:12.455923 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.455889 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:12.462127 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.462093 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpsb4\" (UniqueName: \"kubernetes.io/projected/a447c11d-58d8-436c-b7ad-55d3acb69fee-kube-api-access-kpsb4\") pod \"a447c11d-58d8-436c-b7ad-55d3acb69fee\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " Jun 02 01:18:12.462246 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.462142 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-util\") pod \"a447c11d-58d8-436c-b7ad-55d3acb69fee\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " Jun 02 01:18:12.462246 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.462170 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-bundle\") pod \"a447c11d-58d8-436c-b7ad-55d3acb69fee\" (UID: \"a447c11d-58d8-436c-b7ad-55d3acb69fee\") " Jun 02 01:18:12.462803 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.462691 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-bundle" (OuterVolumeSpecName: "bundle") pod "a447c11d-58d8-436c-b7ad-55d3acb69fee" (UID: "a447c11d-58d8-436c-b7ad-55d3acb69fee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:12.463088 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.463068 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:12.464370 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.464333 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a447c11d-58d8-436c-b7ad-55d3acb69fee-kube-api-access-kpsb4" (OuterVolumeSpecName: "kube-api-access-kpsb4") pod "a447c11d-58d8-436c-b7ad-55d3acb69fee" (UID: "a447c11d-58d8-436c-b7ad-55d3acb69fee"). InnerVolumeSpecName "kube-api-access-kpsb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:18:12.467625 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.467605 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-util" (OuterVolumeSpecName: "util") pod "a447c11d-58d8-436c-b7ad-55d3acb69fee" (UID: "a447c11d-58d8-436c-b7ad-55d3acb69fee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:12.563453 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.563370 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-util\") pod \"bead123a-5c0f-44b2-b361-40ccbf76f089\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " Jun 02 01:18:12.563597 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.563458 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-bundle\") pod \"bead123a-5c0f-44b2-b361-40ccbf76f089\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " Jun 02 01:18:12.563597 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.563491 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvhz7\" (UniqueName: \"kubernetes.io/projected/bead123a-5c0f-44b2-b361-40ccbf76f089-kube-api-access-rvhz7\") pod \"bead123a-5c0f-44b2-b361-40ccbf76f089\" (UID: \"bead123a-5c0f-44b2-b361-40ccbf76f089\") " Jun 02 01:18:12.563674 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.563665 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpsb4\" (UniqueName: \"kubernetes.io/projected/a447c11d-58d8-436c-b7ad-55d3acb69fee-kube-api-access-kpsb4\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:12.563704 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.563677 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a447c11d-58d8-436c-b7ad-55d3acb69fee-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:12.564058 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.564027 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-bundle" (OuterVolumeSpecName: "bundle") pod "bead123a-5c0f-44b2-b361-40ccbf76f089" (UID: "bead123a-5c0f-44b2-b361-40ccbf76f089"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:12.565427 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.565403 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bead123a-5c0f-44b2-b361-40ccbf76f089-kube-api-access-rvhz7" (OuterVolumeSpecName: "kube-api-access-rvhz7") pod "bead123a-5c0f-44b2-b361-40ccbf76f089" (UID: "bead123a-5c0f-44b2-b361-40ccbf76f089"). InnerVolumeSpecName "kube-api-access-rvhz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:18:12.568641 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.568623 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-util" (OuterVolumeSpecName: "util") pod "bead123a-5c0f-44b2-b361-40ccbf76f089" (UID: "bead123a-5c0f-44b2-b361-40ccbf76f089"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:12.664583 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.664544 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:12.664583 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.664575 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bead123a-5c0f-44b2-b361-40ccbf76f089-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:12.664583 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:12.664585 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvhz7\" (UniqueName: \"kubernetes.io/projected/bead123a-5c0f-44b2-b361-40ccbf76f089-kube-api-access-rvhz7\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:13.295333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:13.295297 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" event={"ID":"a447c11d-58d8-436c-b7ad-55d3acb69fee","Type":"ContainerDied","Data":"3617ce8ed1835511eca5902c1045b5aeedb19b90d7e969a7050e92f39b48b9df"} Jun 02 01:18:13.295333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:13.295318 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs" Jun 02 01:18:13.295333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:13.295331 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3617ce8ed1835511eca5902c1045b5aeedb19b90d7e969a7050e92f39b48b9df" Jun 02 01:18:13.297049 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:13.297030 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" Jun 02 01:18:13.297157 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:13.297056 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6" event={"ID":"bead123a-5c0f-44b2-b361-40ccbf76f089","Type":"ContainerDied","Data":"3c01475adb585b4928ed8ab12a1e30dc21a2dc94165cfb7073037fb1eb7e8535"} Jun 02 01:18:13.297157 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:13.297078 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c01475adb585b4928ed8ab12a1e30dc21a2dc94165cfb7073037fb1eb7e8535" Jun 02 01:18:34.480737 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.480706 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8"] Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481167 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerName="pull" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481186 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerName="pull" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481196 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerName="util" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481202 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerName="util" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481214 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerName="extract" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481220 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerName="extract" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481227 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerName="pull" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481232 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerName="pull" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481241 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerName="extract" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481249 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerName="extract" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481260 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerName="extract" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481265 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerName="extract" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481272 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerName="pull" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481277 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerName="pull" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481285 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerName="util" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481290 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerName="util" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481313 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerName="util" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481321 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerName="util" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481326 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerName="pull" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481331 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerName="pull" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481336 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerName="util" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481341 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerName="util" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481348 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerName="extract" Jun 02 01:18:34.481375 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481353 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerName="extract" Jun 02 01:18:34.482108 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481413 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="26e31b3c-5079-4a51-b2b7-6e252b173b11" containerName="extract" Jun 02 01:18:34.482108 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481422 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c342fc3-3cbd-4014-8836-85e1dbbdc5eb" containerName="extract" Jun 02 01:18:34.482108 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481430 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="bead123a-5c0f-44b2-b361-40ccbf76f089" containerName="extract" Jun 02 01:18:34.482108 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.481437 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="a447c11d-58d8-436c-b7ad-55d3acb69fee" containerName="extract" Jun 02 01:18:34.484629 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.484614 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:34.487083 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.487065 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 01:18:34.487783 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.487764 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 01:18:34.487830 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.487764 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zbph5\"" Jun 02 01:18:34.493447 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.493425 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8"] Jun 02 01:18:34.663052 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.663014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp5jl\" (UniqueName: \"kubernetes.io/projected/4b624672-7f97-4430-baaa-a0b2b9eaa06c-kube-api-access-vp5jl\") pod \"limitador-operator-controller-manager-85c4996f8c-tv2m8\" (UID: \"4b624672-7f97-4430-baaa-a0b2b9eaa06c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:34.764268 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.764173 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vp5jl\" (UniqueName: \"kubernetes.io/projected/4b624672-7f97-4430-baaa-a0b2b9eaa06c-kube-api-access-vp5jl\") pod \"limitador-operator-controller-manager-85c4996f8c-tv2m8\" (UID: \"4b624672-7f97-4430-baaa-a0b2b9eaa06c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:34.771867 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.771843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp5jl\" (UniqueName: \"kubernetes.io/projected/4b624672-7f97-4430-baaa-a0b2b9eaa06c-kube-api-access-vp5jl\") pod \"limitador-operator-controller-manager-85c4996f8c-tv2m8\" (UID: \"4b624672-7f97-4430-baaa-a0b2b9eaa06c\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:34.795747 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.795720 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:34.932988 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:34.932961 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8"] Jun 02 01:18:34.935009 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:18:34.934978 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b624672_7f97_4430_baaa_a0b2b9eaa06c.slice/crio-4cad8bd968ede6505d81ae9951e4977c65114115663b653b3800732c72c8a4d3 WatchSource:0}: Error finding container 4cad8bd968ede6505d81ae9951e4977c65114115663b653b3800732c72c8a4d3: Status 404 returned error can't find the container with id 4cad8bd968ede6505d81ae9951e4977c65114115663b653b3800732c72c8a4d3 Jun 02 01:18:35.381204 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:35.381171 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" event={"ID":"4b624672-7f97-4430-baaa-a0b2b9eaa06c","Type":"ContainerStarted","Data":"4cad8bd968ede6505d81ae9951e4977c65114115663b653b3800732c72c8a4d3"} Jun 02 01:18:37.390188 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:37.390151 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" event={"ID":"4b624672-7f97-4430-baaa-a0b2b9eaa06c","Type":"ContainerStarted","Data":"8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b"} Jun 02 01:18:37.390642 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:37.390199 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:37.410881 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:37.410835 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" podStartSLOduration=1.77247721 podStartE2EDuration="3.410820433s" podCreationTimestamp="2026-06-02 01:18:34 +0000 UTC" firstStartedPulling="2026-06-02 01:18:34.936781928 +0000 UTC m=+473.717700946" lastFinishedPulling="2026-06-02 01:18:36.575125148 +0000 UTC m=+475.356044169" observedRunningTime="2026-06-02 01:18:37.408841722 +0000 UTC m=+476.189760762" watchObservedRunningTime="2026-06-02 01:18:37.410820433 +0000 UTC m=+476.191739469" Jun 02 01:18:45.087888 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.087851 2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8"] Jun 02 01:18:45.088301 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.088111 2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" containerName="manager" containerID="cri-o://8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b" gracePeriod=2 Jun 02 01:18:45.090036 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.090012 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:45.101431 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.101408 2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8"] Jun 02 01:18:45.114716 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.114692 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr"] Jun 02 01:18:45.115178 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.115159 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" containerName="manager" Jun 02 01:18:45.115245 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.115183 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" containerName="manager" Jun 02 01:18:45.115290 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.115279 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" containerName="manager" Jun 02 01:18:45.118239 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.118223 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" Jun 02 01:18:45.130709 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.130686 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr"] Jun 02 01:18:45.142241 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.142206 2578 status_manager.go:895] "Failed to get status for pod" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" err="pods \"limitador-operator-controller-manager-85c4996f8c-tv2m8\" is forbidden: User \"system:node:ip-10-0-135-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-17.ec2.internal' and this object" Jun 02 01:18:45.145234 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.145211 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85bd2\" (UniqueName: \"kubernetes.io/projected/54798556-9528-40c7-99d8-4fb7efa4c83b-kube-api-access-85bd2\") pod \"limitador-operator-controller-manager-85c4996f8c-drxqr\" (UID: \"54798556-9528-40c7-99d8-4fb7efa4c83b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" Jun 02 01:18:45.246116 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.246080 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85bd2\" (UniqueName: \"kubernetes.io/projected/54798556-9528-40c7-99d8-4fb7efa4c83b-kube-api-access-85bd2\") pod \"limitador-operator-controller-manager-85c4996f8c-drxqr\" (UID: \"54798556-9528-40c7-99d8-4fb7efa4c83b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" Jun 02 01:18:45.256317 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.256287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85bd2\" (UniqueName: \"kubernetes.io/projected/54798556-9528-40c7-99d8-4fb7efa4c83b-kube-api-access-85bd2\") pod \"limitador-operator-controller-manager-85c4996f8c-drxqr\" (UID: \"54798556-9528-40c7-99d8-4fb7efa4c83b\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" Jun 02 01:18:45.325032 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.325007 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:45.327206 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.327182 2578 status_manager.go:895] "Failed to get status for pod" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" err="pods \"limitador-operator-controller-manager-85c4996f8c-tv2m8\" is forbidden: User \"system:node:ip-10-0-135-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-17.ec2.internal' and this object" Jun 02 01:18:45.346623 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.346556 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp5jl\" (UniqueName: \"kubernetes.io/projected/4b624672-7f97-4430-baaa-a0b2b9eaa06c-kube-api-access-vp5jl\") pod \"4b624672-7f97-4430-baaa-a0b2b9eaa06c\" (UID: \"4b624672-7f97-4430-baaa-a0b2b9eaa06c\") " Jun 02 01:18:45.348506 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.348483 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b624672-7f97-4430-baaa-a0b2b9eaa06c-kube-api-access-vp5jl" (OuterVolumeSpecName: "kube-api-access-vp5jl") pod "4b624672-7f97-4430-baaa-a0b2b9eaa06c" (UID: "4b624672-7f97-4430-baaa-a0b2b9eaa06c"). InnerVolumeSpecName "kube-api-access-vp5jl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:18:45.420535 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.420502 2578 generic.go:358] "Generic (PLEG): container finished" podID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" containerID="8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b" exitCode=0 Jun 02 01:18:45.420710 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.420548 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" Jun 02 01:18:45.420710 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.420601 2578 scope.go:117] "RemoveContainer" containerID="8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b" Jun 02 01:18:45.423121 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.423093 2578 status_manager.go:895] "Failed to get status for pod" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" err="pods \"limitador-operator-controller-manager-85c4996f8c-tv2m8\" is forbidden: User \"system:node:ip-10-0-135-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-17.ec2.internal' and this object" Jun 02 01:18:45.430344 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.430326 2578 scope.go:117] "RemoveContainer" containerID="8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b" Jun 02 01:18:45.430564 ip-10-0-135-17 kubenswrapper[2578]: E0602 01:18:45.430546 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b\": container with ID starting with 8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b not found: ID does not exist" containerID="8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b" Jun 02 01:18:45.430610 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.430571 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b"} err="failed to get container status \"8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b\": rpc error: code = NotFound desc = could not find container \"8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b\": container with ID starting with 8d2b8a30ed391ab3e583c76c575952b6177e5c3d5259f6af4fa28a1edd945a0b not found: ID does not exist" Jun 02 01:18:45.431398 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.431375 2578 status_manager.go:895] "Failed to get status for pod" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-tv2m8" err="pods \"limitador-operator-controller-manager-85c4996f8c-tv2m8\" is forbidden: User \"system:node:ip-10-0-135-17.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-17.ec2.internal' and this object" Jun 02 01:18:45.447886 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.447862 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp5jl\" (UniqueName: \"kubernetes.io/projected/4b624672-7f97-4430-baaa-a0b2b9eaa06c-kube-api-access-vp5jl\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:18:45.462811 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.462784 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" Jun 02 01:18:45.592939 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.592901 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr"] Jun 02 01:18:45.594970 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:18:45.594945 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54798556_9528_40c7_99d8_4fb7efa4c83b.slice/crio-4918b30d94ad1ef378cdf6194ee1f5ed888b58c61dd4bb1083838599b5807a0f WatchSource:0}: Error finding container 4918b30d94ad1ef378cdf6194ee1f5ed888b58c61dd4bb1083838599b5807a0f: Status 404 returned error can't find the container with id 4918b30d94ad1ef378cdf6194ee1f5ed888b58c61dd4bb1083838599b5807a0f Jun 02 01:18:45.698404 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:45.698362 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b624672-7f97-4430-baaa-a0b2b9eaa06c" path="/var/lib/kubelet/pods/4b624672-7f97-4430-baaa-a0b2b9eaa06c/volumes" Jun 02 01:18:46.426608 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:46.426570 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" event={"ID":"54798556-9528-40c7-99d8-4fb7efa4c83b","Type":"ContainerStarted","Data":"3becb0f53ade1c8366a49d2653aef8e4b707c47a22441fe3356fb025a61ffc57"} Jun 02 01:18:46.426608 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:46.426607 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" event={"ID":"54798556-9528-40c7-99d8-4fb7efa4c83b","Type":"ContainerStarted","Data":"4918b30d94ad1ef378cdf6194ee1f5ed888b58c61dd4bb1083838599b5807a0f"} Jun 02 01:18:46.427134 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:46.426729 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" Jun 02 01:18:46.442643 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:46.442593 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" podStartSLOduration=1.442577191 podStartE2EDuration="1.442577191s" podCreationTimestamp="2026-06-02 01:18:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:18:46.441746711 +0000 UTC m=+485.222665742" watchObservedRunningTime="2026-06-02 01:18:46.442577191 +0000 UTC m=+485.223496231" Jun 02 01:18:57.432390 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:18:57.432357 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-drxqr" Jun 02 01:19:20.248740 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.248704 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:19:20.254659 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.254637 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:20.257216 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.257186 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zd7mt\"" Jun 02 01:19:20.257339 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.257189 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 01:19:20.257952 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.257901 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:19:20.268899 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.268877 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:19:20.348016 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.347980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05149929-dc5c-45e8-8f56-93e29d283778-config-file\") pod \"limitador-limitador-78c99df468-ljstm\" (UID: \"05149929-dc5c-45e8-8f56-93e29d283778\") " pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:20.348016 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.348018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwgnh\" (UniqueName: \"kubernetes.io/projected/05149929-dc5c-45e8-8f56-93e29d283778-kube-api-access-nwgnh\") pod \"limitador-limitador-78c99df468-ljstm\" (UID: \"05149929-dc5c-45e8-8f56-93e29d283778\") " pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:20.449126 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.449091 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05149929-dc5c-45e8-8f56-93e29d283778-config-file\") pod \"limitador-limitador-78c99df468-ljstm\" (UID: \"05149929-dc5c-45e8-8f56-93e29d283778\") " pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:20.449305 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.449136 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nwgnh\" (UniqueName: \"kubernetes.io/projected/05149929-dc5c-45e8-8f56-93e29d283778-kube-api-access-nwgnh\") pod \"limitador-limitador-78c99df468-ljstm\" (UID: \"05149929-dc5c-45e8-8f56-93e29d283778\") " pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:20.449769 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.449750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/05149929-dc5c-45e8-8f56-93e29d283778-config-file\") pod \"limitador-limitador-78c99df468-ljstm\" (UID: \"05149929-dc5c-45e8-8f56-93e29d283778\") " pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:20.456903 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.456871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwgnh\" (UniqueName: \"kubernetes.io/projected/05149929-dc5c-45e8-8f56-93e29d283778-kube-api-access-nwgnh\") pod \"limitador-limitador-78c99df468-ljstm\" (UID: \"05149929-dc5c-45e8-8f56-93e29d283778\") " pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:20.568392 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.568371 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:20.701235 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:20.701208 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:19:20.703102 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:19:20.703074 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05149929_dc5c_45e8_8f56_93e29d283778.slice/crio-6b3945dada70414ce7da49a3029ece7b724d816e9c4333fded95e081679d38c9 WatchSource:0}: Error finding container 6b3945dada70414ce7da49a3029ece7b724d816e9c4333fded95e081679d38c9: Status 404 returned error can't find the container with id 6b3945dada70414ce7da49a3029ece7b724d816e9c4333fded95e081679d38c9 Jun 02 01:19:21.560262 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:21.560220 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" event={"ID":"05149929-dc5c-45e8-8f56-93e29d283778","Type":"ContainerStarted","Data":"6b3945dada70414ce7da49a3029ece7b724d816e9c4333fded95e081679d38c9"} Jun 02 01:19:23.569156 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:23.569124 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" event={"ID":"05149929-dc5c-45e8-8f56-93e29d283778","Type":"ContainerStarted","Data":"ee7847f2a12c8ac57b6b915c634c83b02ef509956a445e12b93a381e18b1f1fe"} Jun 02 01:19:23.569533 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:23.569170 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:23.583276 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:23.583200 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" podStartSLOduration=1.2097419010000001 podStartE2EDuration="3.583182117s" podCreationTimestamp="2026-06-02 01:19:20 +0000 UTC" firstStartedPulling="2026-06-02 01:19:20.704978729 +0000 UTC m=+519.485897749" lastFinishedPulling="2026-06-02 01:19:23.078418937 +0000 UTC m=+521.859337965" observedRunningTime="2026-06-02 01:19:23.582799659 +0000 UTC m=+522.363718698" watchObservedRunningTime="2026-06-02 01:19:23.583182117 +0000 UTC m=+522.364101172" Jun 02 01:19:34.573487 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:34.573412 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-ljstm" Jun 02 01:19:45.945685 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.945647 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq"] Jun 02 01:19:45.957551 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.957514 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:45.958167 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.958138 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq"] Jun 02 01:19:45.960117 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.960095 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:19:45.960117 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.960111 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wfvvs\"" Jun 02 01:19:45.960861 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.960842 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:19:45.980542 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.980511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-886pj\" (UniqueName: \"kubernetes.io/projected/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-kube-api-access-886pj\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:45.980705 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.980560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:45.980705 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:45.980607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:46.081881 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.081836 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-886pj\" (UniqueName: \"kubernetes.io/projected/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-kube-api-access-886pj\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:46.082127 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.081945 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:46.082127 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.081977 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:46.082353 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.082330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:46.082353 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.082346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:46.090491 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.090463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-886pj\" (UniqueName: \"kubernetes.io/projected/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-kube-api-access-886pj\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:46.267232 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.267150 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:46.430805 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.430772 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq"] Jun 02 01:19:46.432088 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:19:46.432061 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4910bf_598e_44f5_820c_e2a5cf7d43f1.slice/crio-700c7b31ae5f24ac8baf5f9c3271bf73d1414e8b8c7681b2ac0598c03fbbf492 WatchSource:0}: Error finding container 700c7b31ae5f24ac8baf5f9c3271bf73d1414e8b8c7681b2ac0598c03fbbf492: Status 404 returned error can't find the container with id 700c7b31ae5f24ac8baf5f9c3271bf73d1414e8b8c7681b2ac0598c03fbbf492 Jun 02 01:19:46.659741 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.659699 2578 generic.go:358] "Generic (PLEG): container finished" podID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerID="0bea87f49ad1b5c138a641360fd1a8d20ef4210e59c291808b2ab212f8d6e9d9" exitCode=0 Jun 02 01:19:46.659943 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.659794 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" event={"ID":"3a4910bf-598e-44f5-820c-e2a5cf7d43f1","Type":"ContainerDied","Data":"0bea87f49ad1b5c138a641360fd1a8d20ef4210e59c291808b2ab212f8d6e9d9"} Jun 02 01:19:46.659943 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:46.659840 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" event={"ID":"3a4910bf-598e-44f5-820c-e2a5cf7d43f1","Type":"ContainerStarted","Data":"700c7b31ae5f24ac8baf5f9c3271bf73d1414e8b8c7681b2ac0598c03fbbf492"} Jun 02 01:19:47.665673 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:47.665640 2578 generic.go:358] "Generic (PLEG): container finished" podID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerID="165addb9413d3579ceb9eb035fb89ec0a34277683c8b661332e167cd2fb83aa2" exitCode=0 Jun 02 01:19:47.666112 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:47.665716 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" event={"ID":"3a4910bf-598e-44f5-820c-e2a5cf7d43f1","Type":"ContainerDied","Data":"165addb9413d3579ceb9eb035fb89ec0a34277683c8b661332e167cd2fb83aa2"} Jun 02 01:19:48.671250 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:48.671216 2578 generic.go:358] "Generic (PLEG): container finished" podID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerID="bfe9baf7f84be51c8efd039026293dcafddb8caa1573fd23f23f08bf6a3d8e1b" exitCode=0 Jun 02 01:19:48.671648 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:48.671279 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" event={"ID":"3a4910bf-598e-44f5-820c-e2a5cf7d43f1","Type":"ContainerDied","Data":"bfe9baf7f84be51c8efd039026293dcafddb8caa1573fd23f23f08bf6a3d8e1b"} Jun 02 01:19:49.806978 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.806955 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:19:49.814442 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.814422 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-bundle\") pod \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " Jun 02 01:19:49.814507 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.814458 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-886pj\" (UniqueName: \"kubernetes.io/projected/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-kube-api-access-886pj\") pod \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " Jun 02 01:19:49.814548 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.814531 2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-util\") pod \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\" (UID: \"3a4910bf-598e-44f5-820c-e2a5cf7d43f1\") " Jun 02 01:19:49.814958 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.814922 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-bundle" (OuterVolumeSpecName: "bundle") pod "3a4910bf-598e-44f5-820c-e2a5cf7d43f1" (UID: "3a4910bf-598e-44f5-820c-e2a5cf7d43f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:19:49.816512 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.816490 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-kube-api-access-886pj" (OuterVolumeSpecName: "kube-api-access-886pj") pod "3a4910bf-598e-44f5-820c-e2a5cf7d43f1" (UID: "3a4910bf-598e-44f5-820c-e2a5cf7d43f1"). InnerVolumeSpecName "kube-api-access-886pj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:19:49.820026 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.820004 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-util" (OuterVolumeSpecName: "util") pod "3a4910bf-598e-44f5-820c-e2a5cf7d43f1" (UID: "3a4910bf-598e-44f5-820c-e2a5cf7d43f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:19:49.915310 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.915273 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-bundle\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:19:49.915310 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.915304 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-886pj\" (UniqueName: \"kubernetes.io/projected/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-kube-api-access-886pj\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:19:49.915513 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:49.915323 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a4910bf-598e-44f5-820c-e2a5cf7d43f1-util\") on node \"ip-10-0-135-17.ec2.internal\" DevicePath \"\"" Jun 02 01:19:50.681488 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:50.681452 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" event={"ID":"3a4910bf-598e-44f5-820c-e2a5cf7d43f1","Type":"ContainerDied","Data":"700c7b31ae5f24ac8baf5f9c3271bf73d1414e8b8c7681b2ac0598c03fbbf492"} Jun 02 01:19:50.681488 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:50.681487 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="700c7b31ae5f24ac8baf5f9c3271bf73d1414e8b8c7681b2ac0598c03fbbf492" Jun 02 01:19:50.681488 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:19:50.681468 2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70hpnmq" Jun 02 01:20:41.626598 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:20:41.626567 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:20:41.627113 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:20:41.626775 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:20:41.629719 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:20:41.629698 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:20:41.629926 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:20:41.629895 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:21:16.933024 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:21:16.932988 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:22:33.585349 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.585271 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c"] Jun 02 01:22:33.585864 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.585845 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerName="util" Jun 02 01:22:33.585933 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.585870 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerName="util" Jun 02 01:22:33.585933 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.585886 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerName="pull" Jun 02 01:22:33.585933 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.585895 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerName="pull" Jun 02 01:22:33.586030 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.585951 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerName="extract" Jun 02 01:22:33.586030 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.585961 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerName="extract" Jun 02 01:22:33.586092 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.586069 2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a4910bf-598e-44f5-820c-e2a5cf7d43f1" containerName="extract" Jun 02 01:22:33.589785 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.589767 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.592607 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.592583 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 01:22:33.592937 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.592798 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xv875\"" Jun 02 01:22:33.593120 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.592859 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 01:22:33.593763 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.593744 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 01:22:33.595800 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.595778 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c"] Jun 02 01:22:33.675556 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.675523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntb5w\" (UniqueName: \"kubernetes.io/projected/bf509641-9898-4c67-84df-a20276627f99-kube-api-access-ntb5w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.675715 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.675571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.675715 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.675590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.675715 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.675685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf509641-9898-4c67-84df-a20276627f99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.675849 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.675721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.675849 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.675753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.776619 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.776561 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntb5w\" (UniqueName: \"kubernetes.io/projected/bf509641-9898-4c67-84df-a20276627f99-kube-api-access-ntb5w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.776619 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.776615 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.776875 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.776645 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.776875 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.776688 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf509641-9898-4c67-84df-a20276627f99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.776875 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.776714 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.776875 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.776736 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.777205 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.777158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.777361 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.777168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.777558 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.777525 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.779152 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.779084 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bf509641-9898-4c67-84df-a20276627f99-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.779819 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.779769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bf509641-9898-4c67-84df-a20276627f99-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.784133 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.784110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntb5w\" (UniqueName: \"kubernetes.io/projected/bf509641-9898-4c67-84df-a20276627f99-kube-api-access-ntb5w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c\" (UID: \"bf509641-9898-4c67-84df-a20276627f99\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.903497 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.903400 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:33.994755 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:33.994705 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:22:34.042406 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:34.042379 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c"] Jun 02 01:22:34.044079 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:22:34.044054 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf509641_9898_4c67_84df_a20276627f99.slice/crio-54773a9524fb272b0508cf939ce35bb8f7e0bf1904865c150b08b625e19b5b83 WatchSource:0}: Error finding container 54773a9524fb272b0508cf939ce35bb8f7e0bf1904865c150b08b625e19b5b83: Status 404 returned error can't find the container with id 54773a9524fb272b0508cf939ce35bb8f7e0bf1904865c150b08b625e19b5b83 Jun 02 01:22:34.045809 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:34.045791 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:22:34.305888 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:34.305801 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" event={"ID":"bf509641-9898-4c67-84df-a20276627f99","Type":"ContainerStarted","Data":"54773a9524fb272b0508cf939ce35bb8f7e0bf1904865c150b08b625e19b5b83"} Jun 02 01:22:38.328346 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:38.328310 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" event={"ID":"bf509641-9898-4c67-84df-a20276627f99","Type":"ContainerStarted","Data":"6c916717bfc13debf799a23e69e02d6a74fc5cf8edd8666818d242b50c905a48"} Jun 02 01:22:39.332931 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:39.332873 2578 generic.go:358] "Generic (PLEG): container finished" podID="bf509641-9898-4c67-84df-a20276627f99" containerID="6c916717bfc13debf799a23e69e02d6a74fc5cf8edd8666818d242b50c905a48" exitCode=0 Jun 02 01:22:39.333345 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:39.332954 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" event={"ID":"bf509641-9898-4c67-84df-a20276627f99","Type":"ContainerDied","Data":"6c916717bfc13debf799a23e69e02d6a74fc5cf8edd8666818d242b50c905a48"} Jun 02 01:22:41.342745 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:41.342701 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" event={"ID":"bf509641-9898-4c67-84df-a20276627f99","Type":"ContainerStarted","Data":"b665480e73785486a8ff718eae173bbde1cb43c1e16d6004b84f982efa4b7751"} Jun 02 01:22:41.361954 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:41.361884 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" podStartSLOduration=2.027933234 podStartE2EDuration="8.361870352s" podCreationTimestamp="2026-06-02 01:22:33 +0000 UTC" firstStartedPulling="2026-06-02 01:22:34.045935045 +0000 UTC m=+712.826854070" lastFinishedPulling="2026-06-02 01:22:40.379872168 +0000 UTC m=+719.160791188" observedRunningTime="2026-06-02 01:22:41.358601389 +0000 UTC m=+720.139520462" watchObservedRunningTime="2026-06-02 01:22:41.361870352 +0000 UTC m=+720.142789384" Jun 02 01:22:43.904538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:43.904499 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:43.905047 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:43.904578 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:43.917059 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:43.917037 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:44.365572 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:44.365546 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c" Jun 02 01:22:47.398106 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.398073 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr"] Jun 02 01:22:47.400835 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.400814 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.402992 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.402970 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 01:22:47.411007 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.410983 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr"] Jun 02 01:22:47.505729 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.505695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbl4q\" (UniqueName: \"kubernetes.io/projected/f20b4e19-1d7e-486c-be90-fae8084a4855-kube-api-access-xbl4q\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.505895 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.505739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.505895 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.505841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.505895 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.505878 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f20b4e19-1d7e-486c-be90-fae8084a4855-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.506039 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.506017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.506098 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.506054 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607098 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607058 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607098 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607102 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607335 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607131 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbl4q\" (UniqueName: \"kubernetes.io/projected/f20b4e19-1d7e-486c-be90-fae8084a4855-kube-api-access-xbl4q\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607335 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607154 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607335 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607192 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607335 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607222 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f20b4e19-1d7e-486c-be90-fae8084a4855-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607543 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607671 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607644 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.607786 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.607656 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.609397 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.609377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f20b4e19-1d7e-486c-be90-fae8084a4855-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.609611 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.609594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f20b4e19-1d7e-486c-be90-fae8084a4855-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.615123 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.615102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbl4q\" (UniqueName: \"kubernetes.io/projected/f20b4e19-1d7e-486c-be90-fae8084a4855-kube-api-access-xbl4q\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr\" (UID: \"f20b4e19-1d7e-486c-be90-fae8084a4855\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.713747 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.713665 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:47.844602 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:47.844578 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr"] Jun 02 01:22:47.846672 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:22:47.846646 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf20b4e19_1d7e_486c_be90_fae8084a4855.slice/crio-1fc054b6fba3a3a5ec581f3cd6b6cd852c8b4e7823514eabbf58d5777e49d504 WatchSource:0}: Error finding container 1fc054b6fba3a3a5ec581f3cd6b6cd852c8b4e7823514eabbf58d5777e49d504: Status 404 returned error can't find the container with id 1fc054b6fba3a3a5ec581f3cd6b6cd852c8b4e7823514eabbf58d5777e49d504 Jun 02 01:22:48.192367 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:48.192329 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:22:48.372781 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:48.372742 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" event={"ID":"f20b4e19-1d7e-486c-be90-fae8084a4855","Type":"ContainerStarted","Data":"a174d6448157bddfb0e8b377d639fba35922800b3e5d97c728114ac0b2d53b89"} Jun 02 01:22:48.372980 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:48.372790 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" event={"ID":"f20b4e19-1d7e-486c-be90-fae8084a4855","Type":"ContainerStarted","Data":"1fc054b6fba3a3a5ec581f3cd6b6cd852c8b4e7823514eabbf58d5777e49d504"} Jun 02 01:22:49.378183 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:49.378146 2578 generic.go:358] "Generic (PLEG): container finished" podID="f20b4e19-1d7e-486c-be90-fae8084a4855" containerID="a174d6448157bddfb0e8b377d639fba35922800b3e5d97c728114ac0b2d53b89" exitCode=0 Jun 02 01:22:49.378538 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:49.378237 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" event={"ID":"f20b4e19-1d7e-486c-be90-fae8084a4855","Type":"ContainerDied","Data":"a174d6448157bddfb0e8b377d639fba35922800b3e5d97c728114ac0b2d53b89"} Jun 02 01:22:50.383320 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:50.383284 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" event={"ID":"f20b4e19-1d7e-486c-be90-fae8084a4855","Type":"ContainerStarted","Data":"87b22a5a9995e4e3e9291d0323440c1464143a20ad1db52c75cbf797c3a644c4"} Jun 02 01:22:50.401485 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:50.401434 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" podStartSLOduration=3.188396226 podStartE2EDuration="3.401420794s" podCreationTimestamp="2026-06-02 01:22:47 +0000 UTC" firstStartedPulling="2026-06-02 01:22:49.378747155 +0000 UTC m=+728.159666171" lastFinishedPulling="2026-06-02 01:22:49.591771719 +0000 UTC m=+728.372690739" observedRunningTime="2026-06-02 01:22:50.398318926 +0000 UTC m=+729.179237976" watchObservedRunningTime="2026-06-02 01:22:50.401420794 +0000 UTC m=+729.182339832" Jun 02 01:22:57.714008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:57.713974 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:57.714008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:57.714015 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:57.726755 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:57.726725 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:58.425271 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:58.425245 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr" Jun 02 01:22:59.597550 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:22:59.597516 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:23:10.901576 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:10.901546 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v"] Jun 02 01:23:10.913579 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:10.913553 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v"] Jun 02 01:23:10.913714 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:10.913667 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:10.916064 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:10.916041 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 01:23:11.016758 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.016720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.016948 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.016781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.016948 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.016798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df9d439e-ea69-48fe-805c-55f9801735b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.016948 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.016883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55w2\" (UniqueName: \"kubernetes.io/projected/df9d439e-ea69-48fe-805c-55f9801735b7-kube-api-access-t55w2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.016948 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.016928 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.017118 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.016957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118154 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118118 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118336 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118189 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118336 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118206 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df9d439e-ea69-48fe-805c-55f9801735b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118336 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118256 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t55w2\" (UniqueName: \"kubernetes.io/projected/df9d439e-ea69-48fe-805c-55f9801735b7-kube-api-access-t55w2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118336 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118279 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118336 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118308 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118724 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118724 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.118724 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.118655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.120419 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.120399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df9d439e-ea69-48fe-805c-55f9801735b7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.120689 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.120669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df9d439e-ea69-48fe-805c-55f9801735b7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.125432 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.125409 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55w2\" (UniqueName: \"kubernetes.io/projected/df9d439e-ea69-48fe-805c-55f9801735b7-kube-api-access-t55w2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v\" (UID: \"df9d439e-ea69-48fe-805c-55f9801735b7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.223705 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.223612 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:11.360310 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.360285 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v"] Jun 02 01:23:11.361601 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:23:11.361572 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf9d439e_ea69_48fe_805c_55f9801735b7.slice/crio-17d0fa6647c87a00fc22c267e44b881994a83f3507340561c997d5b6a43cb98c WatchSource:0}: Error finding container 17d0fa6647c87a00fc22c267e44b881994a83f3507340561c997d5b6a43cb98c: Status 404 returned error can't find the container with id 17d0fa6647c87a00fc22c267e44b881994a83f3507340561c997d5b6a43cb98c Jun 02 01:23:11.466774 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.466734 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" event={"ID":"df9d439e-ea69-48fe-805c-55f9801735b7","Type":"ContainerStarted","Data":"dd114bbc373bf195fac2e36bf6bd2166e2ceb301f3cd6ddcbe5a57f79293bf88"} Jun 02 01:23:11.466774 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.466775 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" event={"ID":"df9d439e-ea69-48fe-805c-55f9801735b7","Type":"ContainerStarted","Data":"17d0fa6647c87a00fc22c267e44b881994a83f3507340561c997d5b6a43cb98c"} Jun 02 01:23:11.798519 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:11.798484 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:23:13.477702 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:13.477670 2578 generic.go:358] "Generic (PLEG): container finished" podID="df9d439e-ea69-48fe-805c-55f9801735b7" containerID="dd114bbc373bf195fac2e36bf6bd2166e2ceb301f3cd6ddcbe5a57f79293bf88" exitCode=0 Jun 02 01:23:13.478119 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:13.477743 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" event={"ID":"df9d439e-ea69-48fe-805c-55f9801735b7","Type":"ContainerDied","Data":"dd114bbc373bf195fac2e36bf6bd2166e2ceb301f3cd6ddcbe5a57f79293bf88"} Jun 02 01:23:14.483708 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:14.483675 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" event={"ID":"df9d439e-ea69-48fe-805c-55f9801735b7","Type":"ContainerStarted","Data":"b7a87735b1363e7f42a906b5988fe6b0207327f17bb0e09d48b89a44ab7c9a2c"} Jun 02 01:23:14.504298 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:14.504243 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" podStartSLOduration=4.3274866339999996 podStartE2EDuration="4.504227666s" podCreationTimestamp="2026-06-02 01:23:10 +0000 UTC" firstStartedPulling="2026-06-02 01:23:13.478378358 +0000 UTC m=+752.259297376" lastFinishedPulling="2026-06-02 01:23:13.655119387 +0000 UTC m=+752.436038408" observedRunningTime="2026-06-02 01:23:14.500592671 +0000 UTC m=+753.281511746" watchObservedRunningTime="2026-06-02 01:23:14.504227666 +0000 UTC m=+753.285146705" Jun 02 01:23:19.400766 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:19.400725 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:23:21.224496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:21.224462 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:21.224496 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:21.224496 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:21.237525 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:21.237501 2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:21.523289 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:21.523212 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v" Jun 02 01:23:26.198260 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:23:26.198224 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-ljstm"] Jun 02 01:25:41.662284 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:25:41.662212 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:25:41.664495 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:25:41.664469 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:25:41.665840 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:25:41.665816 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:25:41.667681 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:25:41.667663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:29:16.615764 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:16.615734 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78fffc7cf9-pd45t_6417204b-862f-4916-8df2-e9b7859bac16/nginx/0.log" Jun 02 01:29:16.722041 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:16.722017 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-jcn7w_7455b30a-8151-4784-affa-d4fcecf301cd/manager/0.log" Jun 02 01:29:16.832659 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:16.832630 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-99frn_1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721/manager/0.log" Jun 02 01:29:17.164594 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:17.164570 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-zqfjg_392b844e-0cc7-4b19-8407-62a4e8910715/server/0.log" Jun 02 01:29:17.397552 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:17.397521 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-cp29h_e8d0672d-f659-45b6-a196-19fe05ffbca7/copy-manifests/0.log" Jun 02 01:29:17.403580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:17.403554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-cp29h_e8d0672d-f659-45b6-a196-19fe05ffbca7/manager/0.log" Jun 02 01:29:18.497422 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.497394 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz_1c342fc3-3cbd-4014-8836-85e1dbbdc5eb/extract/0.log" Jun 02 01:29:18.503014 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.502995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz_1c342fc3-3cbd-4014-8836-85e1dbbdc5eb/util/0.log" Jun 02 01:29:18.508624 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.508606 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz_1c342fc3-3cbd-4014-8836-85e1dbbdc5eb/pull/0.log" Jun 02 01:29:18.614655 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.614632 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs_a447c11d-58d8-436c-b7ad-55d3acb69fee/util/0.log" Jun 02 01:29:18.620348 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.620328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs_a447c11d-58d8-436c-b7ad-55d3acb69fee/pull/0.log" Jun 02 01:29:18.625722 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.625697 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs_a447c11d-58d8-436c-b7ad-55d3acb69fee/extract/0.log" Jun 02 01:29:18.730062 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.730037 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv_26e31b3c-5079-4a51-b2b7-6e252b173b11/extract/0.log" Jun 02 01:29:18.735377 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.735361 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv_26e31b3c-5079-4a51-b2b7-6e252b173b11/util/0.log" Jun 02 01:29:18.741490 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.741477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv_26e31b3c-5079-4a51-b2b7-6e252b173b11/pull/0.log" Jun 02 01:29:18.847017 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.846994 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6_bead123a-5c0f-44b2-b361-40ccbf76f089/util/0.log" Jun 02 01:29:18.852896 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.852877 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6_bead123a-5c0f-44b2-b361-40ccbf76f089/pull/0.log" Jun 02 01:29:18.861463 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:18.861444 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6_bead123a-5c0f-44b2-b361-40ccbf76f089/extract/0.log" Jun 02 01:29:19.647873 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:19.647847 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-ljstm_05149929-dc5c-45e8-8f56-93e29d283778/limitador/0.log" Jun 02 01:29:19.753558 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:19.753530 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-drxqr_54798556-9528-40c7-99d8-4fb7efa4c83b/manager/0.log" Jun 02 01:29:20.191118 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:20.191064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-gslkv_962303fa-47d3-44c3-abc9-bde86b23fc61/discovery/0.log" Jun 02 01:29:20.407057 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:20.407030 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-549c788894-g5njn_4e52b34c-a753-407a-9e46-96f3e9b29935/kube-auth-proxy/0.log" Jun 02 01:29:21.076687 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:21.076659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c_bf509641-9898-4c67-84df-a20276627f99/storage-initializer/0.log" Jun 02 01:29:21.083549 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:21.083516 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-rgt7c_bf509641-9898-4c67-84df-a20276627f99/main/0.log" Jun 02 01:29:21.195300 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:21.195269 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr_f20b4e19-1d7e-486c-be90-fae8084a4855/storage-initializer/0.log" Jun 02 01:29:21.202379 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:21.202360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-2r9lr_f20b4e19-1d7e-486c-be90-fae8084a4855/main/0.log" Jun 02 01:29:21.423571 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:21.423490 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v_df9d439e-ea69-48fe-805c-55f9801735b7/storage-initializer/0.log" Jun 02 01:29:21.429765 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:21.429742 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9p274v_df9d439e-ea69-48fe-805c-55f9801735b7/main/0.log" Jun 02 01:29:28.272491 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:28.272462 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q77t7_9953c519-40ab-4a49-91f9-d25e41679017/global-pull-secret-syncer/0.log" Jun 02 01:29:28.417771 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:28.417742 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z7d9x_e278cf9d-46fd-41bb-8daf-c486f570e7e9/konnectivity-agent/0.log" Jun 02 01:29:28.465414 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:28.465380 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-17.ec2.internal_faaa2ba4daf8787f5aaaffd3e90a7239/haproxy/0.log" Jun 02 01:29:32.234546 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.234514 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz_1c342fc3-3cbd-4014-8836-85e1dbbdc5eb/extract/0.log" Jun 02 01:29:32.254162 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.254138 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz_1c342fc3-3cbd-4014-8836-85e1dbbdc5eb/util/0.log" Jun 02 01:29:32.280732 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.280709 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ffglz_1c342fc3-3cbd-4014-8836-85e1dbbdc5eb/pull/0.log" Jun 02 01:29:32.323842 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.323808 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs_a447c11d-58d8-436c-b7ad-55d3acb69fee/extract/0.log" Jun 02 01:29:32.345212 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.345191 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs_a447c11d-58d8-436c-b7ad-55d3acb69fee/util/0.log" Jun 02 01:29:32.367658 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.367636 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0r5wgs_a447c11d-58d8-436c-b7ad-55d3acb69fee/pull/0.log" Jun 02 01:29:32.392847 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.392821 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv_26e31b3c-5079-4a51-b2b7-6e252b173b11/extract/0.log" Jun 02 01:29:32.413960 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.413939 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv_26e31b3c-5079-4a51-b2b7-6e252b173b11/util/0.log" Jun 02 01:29:32.437079 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.437060 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xrgbv_26e31b3c-5079-4a51-b2b7-6e252b173b11/pull/0.log" Jun 02 01:29:32.463125 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.463105 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6_bead123a-5c0f-44b2-b361-40ccbf76f089/extract/0.log" Jun 02 01:29:32.484257 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.484233 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6_bead123a-5c0f-44b2-b361-40ccbf76f089/util/0.log" Jun 02 01:29:32.504601 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.504539 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1krkq6_bead123a-5c0f-44b2-b361-40ccbf76f089/pull/0.log" Jun 02 01:29:32.740707 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.740683 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-ljstm_05149929-dc5c-45e8-8f56-93e29d283778/limitador/0.log" Jun 02 01:29:32.773452 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:32.773387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-drxqr_54798556-9528-40c7-99d8-4fb7efa4c83b/manager/0.log" Jun 02 01:29:34.228549 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:34.228517 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-lg6fp_506f5f2f-f1e5-4211-943a-a81fb5904abb/cluster-monitoring-operator/0.log" Jun 02 01:29:34.376432 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:34.376404 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b4f8b76fd-mhv76_b9ef0395-2723-40ce-bb5e-da7652727338/metrics-server/0.log" Jun 02 01:29:34.529235 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:34.529213 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pgflg_52678558-0c90-4046-a735-3ebde58594e0/node-exporter/0.log" Jun 02 01:29:34.553008 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:34.552971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pgflg_52678558-0c90-4046-a735-3ebde58594e0/kube-rbac-proxy/0.log" Jun 02 01:29:34.589497 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:34.589470 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pgflg_52678558-0c90-4046-a735-3ebde58594e0/init-textfile/0.log" Jun 02 01:29:34.707547 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:34.707519 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-nf9pq_a083563b-48a0-4d4f-a2f6-6b494b8fdb72/kube-rbac-proxy-main/0.log" Jun 02 01:29:34.730542 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:34.730519 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-nf9pq_a083563b-48a0-4d4f-a2f6-6b494b8fdb72/kube-rbac-proxy-self/0.log" Jun 02 01:29:34.755796 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:34.755769 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-nf9pq_a083563b-48a0-4d4f-a2f6-6b494b8fdb72/openshift-state-metrics/0.log" Jun 02 01:29:35.038929 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.038889 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcbc5c5b5-bvx8k_08073dc3-9be8-4449-9355-43506953c1b7/telemeter-client/0.log" Jun 02 01:29:35.061344 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.061321 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcbc5c5b5-bvx8k_08073dc3-9be8-4449-9355-43506953c1b7/reload/0.log" Jun 02 01:29:35.081893 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.081868 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5bcbc5c5b5-bvx8k_08073dc3-9be8-4449-9355-43506953c1b7/kube-rbac-proxy/0.log" Jun 02 01:29:35.117611 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.117584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cdc8b-m8v9x_7438cb1b-3a84-4f67-ab88-414c1ae1a1e1/thanos-query/0.log" Jun 02 01:29:35.145000 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.144975 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cdc8b-m8v9x_7438cb1b-3a84-4f67-ab88-414c1ae1a1e1/kube-rbac-proxy-web/0.log" Jun 02 01:29:35.169058 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.169037 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cdc8b-m8v9x_7438cb1b-3a84-4f67-ab88-414c1ae1a1e1/kube-rbac-proxy/0.log" Jun 02 01:29:35.192958 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.192906 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cdc8b-m8v9x_7438cb1b-3a84-4f67-ab88-414c1ae1a1e1/prom-label-proxy/0.log" Jun 02 01:29:35.214810 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.214785 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cdc8b-m8v9x_7438cb1b-3a84-4f67-ab88-414c1ae1a1e1/kube-rbac-proxy-rules/0.log" Jun 02 01:29:35.235637 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:35.235621 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79cdc8b-m8v9x_7438cb1b-3a84-4f67-ab88-414c1ae1a1e1/kube-rbac-proxy-metrics/0.log" Jun 02 01:29:36.813205 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:36.813175 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/1.log" Jun 02 01:29:36.818276 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:36.818254 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-8l28t_ea4507ac-5777-4af3-9120-359832712f5d/console-operator/2.log" Jun 02 01:29:37.294809 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.294781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84d56c9c97-274zk_796ac906-d804-4451-996a-8a8b83004c37/console/0.log" Jun 02 01:29:37.846062 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.846033 2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9"] Jun 02 01:29:37.849840 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.849819 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:37.852163 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.852138 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2tbbt\"/\"openshift-service-ca.crt\"" Jun 02 01:29:37.852287 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.852241 2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2tbbt\"/\"kube-root-ca.crt\"" Jun 02 01:29:37.853145 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.853122 2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2tbbt\"/\"default-dockercfg-w25v7\"" Jun 02 01:29:37.857998 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.857980 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9"] Jun 02 01:29:37.914673 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.914635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-podres\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:37.914844 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.914687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-sys\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:37.914844 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.914759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5smv2\" (UniqueName: \"kubernetes.io/projected/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-kube-api-access-5smv2\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:37.914844 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.914787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-proc\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:37.914844 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:37.914813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-lib-modules\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.015955 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.015924 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5smv2\" (UniqueName: \"kubernetes.io/projected/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-kube-api-access-5smv2\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.016101 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.015965 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-proc\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.016101 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.015996 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-lib-modules\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.016101 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.016031 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-podres\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.016101 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.016053 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-proc\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.016101 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.016059 2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-sys\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.016101 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.016097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-sys\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.016352 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.016178 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-lib-modules\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.016352 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.016195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-podres\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.025513 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.025486 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5smv2\" (UniqueName: \"kubernetes.io/projected/c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68-kube-api-access-5smv2\") pod \"perf-node-gather-daemonset-7psd9\" (UID: \"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.161794 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.161709 2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:38.296624 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.296596 2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9"] Jun 02 01:29:38.297957 ip-10-0-135-17 kubenswrapper[2578]: W0602 01:29:38.297925 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc488ce7e_4c8d_40c1_a7ef_8bf75a7e3b68.slice/crio-28cddc17411fcac0a155ff8086626e29207c7482f9a33dc68bec2fd48baf0c48 WatchSource:0}: Error finding container 28cddc17411fcac0a155ff8086626e29207c7482f9a33dc68bec2fd48baf0c48: Status 404 returned error can't find the container with id 28cddc17411fcac0a155ff8086626e29207c7482f9a33dc68bec2fd48baf0c48 Jun 02 01:29:38.299598 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.299582 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:29:38.792956 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.792860 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j4c5m_eb73dfb9-e19a-4a9e-9d70-24a508ba0031/dns/0.log" Jun 02 01:29:38.813615 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.813590 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j4c5m_eb73dfb9-e19a-4a9e-9d70-24a508ba0031/kube-rbac-proxy/0.log" Jun 02 01:29:38.917349 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:38.917325 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pvvrj_a7db0dfa-6fe7-42e4-92a8-ebb431d579ee/dns-node-resolver/0.log" Jun 02 01:29:39.060592 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:39.060502 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" event={"ID":"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68","Type":"ContainerStarted","Data":"bad122181cb4e43b4a94104d6ab168cf355b0a6df3909e8ef4b73cfbf63e2bed"} Jun 02 01:29:39.060592 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:39.060542 2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" event={"ID":"c488ce7e-4c8d-40c1-a7ef-8bf75a7e3b68","Type":"ContainerStarted","Data":"28cddc17411fcac0a155ff8086626e29207c7482f9a33dc68bec2fd48baf0c48"} Jun 02 01:29:39.060768 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:39.060644 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:39.076719 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:39.076666 2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" podStartSLOduration=2.076653569 podStartE2EDuration="2.076653569s" podCreationTimestamp="2026-06-02 01:29:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:29:39.074316158 +0000 UTC m=+1137.855235196" watchObservedRunningTime="2026-06-02 01:29:39.076653569 +0000 UTC m=+1137.857572658" Jun 02 01:29:39.425880 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:39.425848 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5d64bb5885-krsdr_7b7be1c5-0162-4b8b-863c-4a10e89710a2/registry/0.log" Jun 02 01:29:39.489940 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:39.489640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c9kf6_0341013e-72f1-43aa-8869-7fcc75f8df43/node-ca/0.log" Jun 02 01:29:40.396930 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:40.396883 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-gslkv_962303fa-47d3-44c3-abc9-bde86b23fc61/discovery/0.log" Jun 02 01:29:40.439636 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:40.439607 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-549c788894-g5njn_4e52b34c-a753-407a-9e46-96f3e9b29935/kube-auth-proxy/0.log" Jun 02 01:29:41.094042 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:41.094007 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fhkr2_a6d4f294-bdec-4d4b-893c-c9694026c804/serve-healthcheck-canary/0.log" Jun 02 01:29:41.689312 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:41.689280 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmng2_3ca525bf-5363-48b2-92ec-a4046da15baa/kube-rbac-proxy/0.log" Jun 02 01:29:41.710573 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:41.710540 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmng2_3ca525bf-5363-48b2-92ec-a4046da15baa/exporter/0.log" Jun 02 01:29:41.730686 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:41.730664 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmng2_3ca525bf-5363-48b2-92ec-a4046da15baa/extractor/0.log" Jun 02 01:29:43.664689 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:43.664659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78fffc7cf9-pd45t_6417204b-862f-4916-8df2-e9b7859bac16/nginx/0.log" Jun 02 01:29:43.688965 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:43.688934 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-jcn7w_7455b30a-8151-4784-affa-d4fcecf301cd/manager/0.log" Jun 02 01:29:43.722013 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:43.721983 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-99frn_1e3f4b4f-0f98-4956-8dd7-3e2ba0acb721/manager/0.log" Jun 02 01:29:43.788687 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:43.788662 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-zqfjg_392b844e-0cc7-4b19-8407-62a4e8910715/server/0.log" Jun 02 01:29:43.878263 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:43.878235 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-cp29h_e8d0672d-f659-45b6-a196-19fe05ffbca7/manager/0.log" Jun 02 01:29:43.897448 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:43.897423 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-cp29h_e8d0672d-f659-45b6-a196-19fe05ffbca7/copy-manifests/0.log" Jun 02 01:29:45.075504 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:45.075478 2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-7psd9" Jun 02 01:29:45.456344 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:45.456258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-hvg8z_e85d14f9-9d15-4365-97f4-c56c62bff003/openshift-lws-operator/0.log" Jun 02 01:29:51.840559 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:51.840529 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnb8j_1fc744de-9f37-42ba-a215-839045bc96ae/kube-multus-additional-cni-plugins/0.log" Jun 02 01:29:51.861897 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:51.861867 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnb8j_1fc744de-9f37-42ba-a215-839045bc96ae/egress-router-binary-copy/0.log" Jun 02 01:29:51.882013 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:51.881982 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnb8j_1fc744de-9f37-42ba-a215-839045bc96ae/cni-plugins/0.log" Jun 02 01:29:51.911502 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:51.911474 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnb8j_1fc744de-9f37-42ba-a215-839045bc96ae/bond-cni-plugin/0.log" Jun 02 01:29:51.932203 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:51.932177 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnb8j_1fc744de-9f37-42ba-a215-839045bc96ae/routeoverride-cni/0.log" Jun 02 01:29:51.953625 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:51.953597 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnb8j_1fc744de-9f37-42ba-a215-839045bc96ae/whereabouts-cni-bincopy/0.log" Jun 02 01:29:51.972514 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:51.972489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tnb8j_1fc744de-9f37-42ba-a215-839045bc96ae/whereabouts-cni/0.log" Jun 02 01:29:52.058958 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:52.058927 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xvlp8_ed9a2d6f-d80f-4d2b-9f6b-67ff1bfbff92/kube-multus/0.log" Jun 02 01:29:52.160406 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:52.160333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gtv6j_501af48d-d29b-428f-a029-9a0a83619b0b/network-metrics-daemon/0.log" Jun 02 01:29:52.183288 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:52.183259 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gtv6j_501af48d-d29b-428f-a029-9a0a83619b0b/kube-rbac-proxy/0.log" Jun 02 01:29:53.033595 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.033532 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-controller/0.log" Jun 02 01:29:53.051333 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.051303 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/0.log" Jun 02 01:29:53.056170 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.056154 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovn-acl-logging/1.log" Jun 02 01:29:53.073344 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.073320 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/kube-rbac-proxy-node/0.log" Jun 02 01:29:53.093945 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.093905 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 01:29:53.112124 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.112097 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/northd/0.log" Jun 02 01:29:53.131586 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.131545 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/nbdb/0.log" Jun 02 01:29:53.153413 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.153393 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/sbdb/0.log" Jun 02 01:29:53.252690 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:53.252661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5h6vx_a2584c13-0ef1-4aec-ba13-53595473cd95/ovnkube-controller/0.log" Jun 02 01:29:55.124580 ip-10-0-135-17 kubenswrapper[2578]: I0602 01:29:55.124551 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-n5qxb_f9738c4d-db83-4b44-9cf5-7df1118311f6/network-check-target-container/0.log"