Jun 02 01:50:37.975433 ip-10-0-135-96 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:50:38.545980 ip-10-0-135-96 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:50:38.545980 ip-10-0-135-96 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:50:38.545980 ip-10-0-135-96 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:50:38.545980 ip-10-0-135-96 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:50:38.545980 ip-10-0-135-96 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:50:38.547322 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.547186 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:50:38.550777 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550754 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.550777 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550773 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.550777 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550777 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.550777 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550780 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.550777 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550783 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.550777 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550786 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550789 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550792 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550795 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550798 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550801 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550804 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550807 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550809 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550812 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550814 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550817 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550819 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550824 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550828 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550830 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550835 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550839 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550842 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.550999 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550845 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550847 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550850 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550856 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550859 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550861 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550864 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550866 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550869 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550871 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550874 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550876 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550878 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550881 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550883 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550887 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550890 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550893 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550895 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550898 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.551450 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550900 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550903 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550905 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550908 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550911 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550913 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550916 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550918 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550921 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550924 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550927 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550929 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550932 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550934 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550937 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550940 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550942 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550945 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550947 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.551970 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550950 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550953 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550955 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550959 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550961 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550964 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550966 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550969 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550972 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550975 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550977 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550980 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550983 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550986 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550989 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550992 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550995 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.550997 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551000 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551003 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.552421 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551005 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551008 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551011 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551453 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551460 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551463 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551466 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551470 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551473 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551475 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551478 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551481 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551483 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551486 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551489 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551491 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551494 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551496 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551498 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551501 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.552886 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551504 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551507 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551509 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551512 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551515 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551517 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551520 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551522 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551525 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551527 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551529 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551532 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551534 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551537 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551540 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551542 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551545 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551547 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551550 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551552 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.553372 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551554 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551557 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551559 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551562 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551566 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551568 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551570 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551573 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551575 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551578 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551580 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551583 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551585 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551587 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551590 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551593 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551595 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551597 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551600 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551603 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.553842 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551605 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551607 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551610 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551612 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551615 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551618 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551620 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551623 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551628 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551631 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551634 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551637 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551641 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551643 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551646 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551651 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551654 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551657 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551660 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551662 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.554355 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551665 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551668 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551671 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551673 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551676 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551679 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551682 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551684 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.551687 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551756 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551763 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551769 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551774 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551778 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551782 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551786 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551790 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551794 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551797 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551800 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551805 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:50:38.554827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551808 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551811 2559 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551814 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551816 2559 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551819 2559 flags.go:64] FLAG: --cloud-config="" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551822 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551824 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551829 2559 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551832 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551835 2559 flags.go:64] FLAG: --config-dir="" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551838 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551841 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551845 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551848 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551851 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551854 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551857 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551860 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551863 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551866 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551869 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551873 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551876 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551880 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551883 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:50:38.555339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551886 2559 flags.go:64] FLAG: --enable-server="true" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551889 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551893 2559 flags.go:64] FLAG: --event-burst="100" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551896 2559 flags.go:64] FLAG: --event-qps="50" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551899 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551902 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551906 2559 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551909 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551912 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551915 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551918 2559 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551921 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551924 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551927 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551929 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551933 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551936 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551939 2559 flags.go:64] FLAG: --feature-gates="" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551943 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551946 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551949 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551952 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551955 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551958 2559 flags.go:64] FLAG: --help="false" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551961 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-135-96.ec2.internal" Jun 02 01:50:38.555954 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551964 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551967 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551970 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551973 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551976 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551979 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551982 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551985 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551988 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551991 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551994 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.551997 2559 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552000 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552004 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552007 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552010 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552012 2559 flags.go:64] FLAG: --lock-file="" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552015 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552018 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552021 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552026 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552028 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552031 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:50:38.556535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552034 2559 flags.go:64] FLAG: --logging-format="text" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552037 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552040 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552042 2559 flags.go:64] FLAG: --manifest-url="" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552045 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552049 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552052 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552058 2559 flags.go:64] FLAG: --max-pods="110" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552061 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552063 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552066 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552069 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552072 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552075 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552078 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552086 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552089 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552092 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552095 2559 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552098 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552103 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552106 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552109 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552113 2559 flags.go:64] FLAG: --port="10250" Jun 02 01:50:38.557064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552116 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552119 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f2920dbf8cfc92d1" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552123 2559 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552126 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552128 2559 flags.go:64] FLAG: --register-node="true" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552131 2559 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552134 2559 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552150 2559 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552153 2559 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552155 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552158 2559 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552162 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552165 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552168 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552171 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552178 2559 flags.go:64] FLAG: --runonce="false" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552182 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552185 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552187 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552190 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552193 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552197 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552200 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552203 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552205 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552209 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:50:38.557632 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552212 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552215 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552217 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552221 2559 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552223 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552230 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552233 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552236 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552240 2559 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552243 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552245 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552248 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552251 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552254 2559 flags.go:64] FLAG: --v="2" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552258 2559 flags.go:64] FLAG: --version="false" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552262 2559 flags.go:64] FLAG: --vmodule="" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552265 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.552269 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552364 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552367 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552370 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552374 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552377 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552381 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.558260 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552384 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552386 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552389 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552391 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552394 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552397 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552399 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552402 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552405 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552407 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552410 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552412 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552415 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552418 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552421 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552423 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552426 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552428 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552431 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552434 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.558808 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552437 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552439 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552442 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552444 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552446 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552449 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552452 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552454 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552457 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552460 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552463 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552465 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552468 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552470 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552473 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552475 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552478 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552481 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552483 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552485 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.559341 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552488 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552491 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552495 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552498 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552501 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552505 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552508 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552511 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552514 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552516 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552519 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552521 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552523 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552526 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552528 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552531 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552533 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552536 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552538 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.559827 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552540 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552543 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552547 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552549 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552551 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552554 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552556 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552559 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552561 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552564 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552566 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552569 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552572 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552574 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552577 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552580 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552582 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552585 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552589 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.560286 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552591 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.552594 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.553122 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.559383 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.559398 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559451 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559456 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559459 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559462 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559465 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559467 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559470 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559472 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559475 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559477 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559480 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.560730 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559483 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559485 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559488 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559490 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559493 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559495 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559498 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559501 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559503 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559506 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559508 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559511 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559515 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559517 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559520 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559522 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559525 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559527 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559530 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559533 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.561116 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559535 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559538 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559541 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559544 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559546 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559549 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559551 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559554 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559556 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559559 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559562 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559564 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559566 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559569 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559572 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559574 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559577 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559579 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559581 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559584 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.561609 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559587 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559589 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559592 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559594 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559598 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559603 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559606 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559608 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559611 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559614 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559617 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559620 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559623 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559625 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559628 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559631 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559634 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559636 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559638 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.562065 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559641 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559644 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559647 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559649 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559652 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559654 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559657 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559659 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559662 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559664 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559666 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559670 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559674 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559676 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559679 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.562598 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559682 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.559687 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559787 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559791 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559794 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559797 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559801 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559803 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559806 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559809 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559812 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559815 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559817 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559820 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559822 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:50:38.562951 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559825 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559828 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559830 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559833 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559836 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559838 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559841 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559844 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559846 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559850 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559853 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559856 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559859 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559862 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559865 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559867 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559870 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559873 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559876 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:50:38.563349 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559878 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559881 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559883 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559890 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559893 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559895 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559898 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559901 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559903 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559906 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559908 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559910 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559913 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559915 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559918 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559920 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559922 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559925 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559927 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559930 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:50:38.563799 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559932 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559935 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559937 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559939 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559942 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559944 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559947 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559949 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559951 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559953 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559956 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559958 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559961 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559963 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559966 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559968 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559971 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559973 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559976 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559978 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:50:38.564274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559981 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559985 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559988 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559991 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559993 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559995 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.559998 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.560000 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.560003 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.560005 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.560008 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.560010 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.560013 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:38.560015 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.560020 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:50:38.564733 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.560652 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:50:38.565085 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.563128 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:50:38.565085 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.563954 2559 server.go:1019] "Starting client certificate rotation" Jun 02 01:50:38.565085 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.564052 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:50:38.565085 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.564089 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:50:38.583711 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.583691 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:50:38.585419 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.585398 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:50:38.594551 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.594532 2559 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:50:38.599770 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.599747 2559 log.go:25] "Validated CRI v1 image API" Jun 02 01:50:38.602872 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.602856 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:50:38.605810 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.605789 2559 fs.go:135] Filesystem UUIDs: map[12ee49a7-16ce-413d-a4a8-260d3a4996a7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e8c9496b-76e3-43df-a768-a010e2668fb3:/dev/nvme0n1p3] Jun 02 01:50:38.605888 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.605808 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:50:38.610101 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.609989 2559 manager.go:217] Machine: {Timestamp:2026-06-02 01:50:38.609495269 +0000 UTC m=+0.525626288 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3185233 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d7356ca0391b0fb07517dc7bb91d7 SystemUUID:ec2d7356-ca03-91b0-fb07-517dc7bb91d7 BootID:fa63dfdb-0caa-495d-b9ec-89b6c06e7afc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0c:31:ce:30:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0c:31:ce:30:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:94:0c:5c:8f:ce Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:50:38.610662 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.610647 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:50:38.610749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.610737 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:50:38.613427 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.613392 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:50:38.613590 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.613576 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:50:38.613629 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.613427 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:50:38.613629 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.613609 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:50:38.613629 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.613618 2559 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:50:38.613629 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.613625 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:50:38.614202 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.614191 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:50:38.615490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.615479 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:50:38.615611 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.615602 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:50:38.617440 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.617430 2559 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:50:38.617479 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.617443 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:50:38.617479 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.617456 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:50:38.617479 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.617466 2559 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:50:38.617479 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.617475 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:50:38.618469 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.618457 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:50:38.618509 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.618477 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:50:38.621338 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.621321 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:50:38.623174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.623161 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:50:38.625359 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625344 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:50:38.625359 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625361 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:50:38.625359 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625369 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625374 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625384 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625389 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625395 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625400 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625406 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625413 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625421 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:50:38.625490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.625427 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:50:38.626087 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.626078 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:50:38.626174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.626087 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:50:38.629215 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.629200 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:50:38.629294 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.629238 2559 server.go:1295] "Started kubelet" Jun 02 01:50:38.629381 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.629328 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:50:38.629440 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.629388 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:50:38.629440 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.629415 2559 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:50:38.632371 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.632349 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:50:38.632461 ip-10-0-135-96 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:50:38.632564 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.632527 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:50:38.632713 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.632686 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:50:38.633154 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.633115 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:50:38.636348 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.636332 2559 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:50:38.637165 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.636366 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-96.ec2.internal.18b52091e204ce6d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-96.ec2.internal,UID:ip-10-0-135-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-96.ec2.internal,},FirstTimestamp:2026-06-02 01:50:38.629211757 +0000 UTC m=+0.545342777,LastTimestamp:2026-06-02 01:50:38.629211757 +0000 UTC m=+0.545342777,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-96.ec2.internal,}" Jun 02 01:50:38.639009 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.638991 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:50:38.639386 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.639372 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:50:38.639492 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.639478 2559 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:50:38.639560 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.639511 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:50:38.639620 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.639609 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:50:38.639672 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.639660 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:50:38.639713 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.639674 2559 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:50:38.641082 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.640169 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:38.641082 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.641073 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:50:38.641228 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.641090 2559 factory.go:55] Registering systemd factory Jun 02 01:50:38.641228 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.641100 2559 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:50:38.642119 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.641803 2559 factory.go:153] Registering CRI-O factory Jun 02 01:50:38.642119 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.641821 2559 factory.go:223] Registration of the crio container factory successfully Jun 02 01:50:38.642119 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.641819 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 01:50:38.642119 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.641839 2559 factory.go:103] Registering Raw factory Jun 02 01:50:38.642119 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.641859 2559 manager.go:1196] Started watching for new ooms in manager Jun 02 01:50:38.642381 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.642305 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 01:50:38.642381 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.642324 2559 manager.go:319] Starting recovery of all containers Jun 02 01:50:38.645724 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.645549 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:50:38.653207 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.653193 2559 manager.go:324] Recovery completed Jun 02 01:50:38.657472 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.657456 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:38.659246 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.659224 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:38.659305 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.659256 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:38.659305 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.659275 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:38.659848 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.659835 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:50:38.659848 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.659846 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:50:38.659944 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.659863 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:50:38.661935 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.661923 2559 policy_none.go:49] "None policy: Start" Jun 02 01:50:38.661973 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.661939 2559 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:50:38.661973 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.661949 2559 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:50:38.663633 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.663614 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tv6bg" Jun 02 01:50:38.668368 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.668272 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-96.ec2.internal.18b52091e3cf086b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-96.ec2.internal,UID:ip-10-0-135-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-96.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-96.ec2.internal,},FirstTimestamp:2026-06-02 01:50:38.659242091 +0000 UTC m=+0.575373111,LastTimestamp:2026-06-02 01:50:38.659242091 +0000 UTC m=+0.575373111,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-96.ec2.internal,}" Jun 02 01:50:38.672403 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.672375 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tv6bg" Jun 02 01:50:38.691728 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.691711 2559 manager.go:341] "Starting Device Plugin manager" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.691761 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.691773 2559 server.go:85] "Starting device plugin registration server" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.692049 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.692061 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.692161 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.692301 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.692312 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.693106 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:50:38.696861 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.693160 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:38.753666 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.753620 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:50:38.754882 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.754863 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:50:38.754970 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.754893 2559 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:50:38.754970 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.754916 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:50:38.754970 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.754925 2559 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:50:38.755114 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.754971 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:50:38.757684 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.757666 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:38.793240 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.793216 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:38.794366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.794348 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:38.794460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.794381 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:38.794460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.794394 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:38.794460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.794427 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-96.ec2.internal" Jun 02 01:50:38.800998 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.800952 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-96.ec2.internal" Jun 02 01:50:38.800998 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.800974 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-96.ec2.internal\": node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:38.824752 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.824725 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:38.855061 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.855035 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal"] Jun 02 01:50:38.855168 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.855100 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:38.858595 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.858577 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:38.858668 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.858606 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:38.858668 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.858616 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:38.859698 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.859686 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:38.859865 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.859852 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:38.859900 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.859880 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:38.860459 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.860445 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:38.860529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.860474 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:38.860529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.860447 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:38.860529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.860492 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:38.860529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.860507 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:38.860529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.860520 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:38.861618 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.861605 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" Jun 02 01:50:38.861680 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.861627 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:50:38.862342 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.862325 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:50:38.862385 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.862346 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:50:38.862385 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:38.862359 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:50:38.875681 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.875661 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-96.ec2.internal\" not found" node="ip-10-0-135-96.ec2.internal" Jun 02 01:50:38.879522 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.879508 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-96.ec2.internal\" not found" node="ip-10-0-135-96.ec2.internal" Jun 02 01:50:38.925377 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:38.925353 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.025760 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:39.025720 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.041049 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.041023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b4ca6b244512da7ed67981aea007461-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal\" (UID: \"7b4ca6b244512da7ed67981aea007461\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.041116 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.041056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b4ca6b244512da7ed67981aea007461-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal\" (UID: \"7b4ca6b244512da7ed67981aea007461\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.041116 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.041077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1081596490cd45967eb050f77c113fcd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-96.ec2.internal\" (UID: \"1081596490cd45967eb050f77c113fcd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.126497 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:39.126419 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.141714 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.141695 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b4ca6b244512da7ed67981aea007461-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal\" (UID: \"7b4ca6b244512da7ed67981aea007461\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.141778 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.141721 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b4ca6b244512da7ed67981aea007461-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal\" (UID: \"7b4ca6b244512da7ed67981aea007461\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.141778 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.141738 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1081596490cd45967eb050f77c113fcd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-96.ec2.internal\" (UID: \"1081596490cd45967eb050f77c113fcd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.141842 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.141778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1081596490cd45967eb050f77c113fcd-config\") pod \"kube-apiserver-proxy-ip-10-0-135-96.ec2.internal\" (UID: \"1081596490cd45967eb050f77c113fcd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.141842 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.141818 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b4ca6b244512da7ed67981aea007461-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal\" (UID: \"7b4ca6b244512da7ed67981aea007461\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.141907 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.141818 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7b4ca6b244512da7ed67981aea007461-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal\" (UID: \"7b4ca6b244512da7ed67981aea007461\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.177842 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.177812 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.182318 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.182297 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.227033 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:39.227002 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.327529 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:39.327503 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.428055 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:39.427988 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.528547 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:39.528516 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.563962 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.563941 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:50:39.564415 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.564073 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:50:39.629580 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:39.629546 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.639441 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.639420 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:50:39.655587 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.655567 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:50:39.674306 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.674274 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:45:38 +0000 UTC" deadline="2027-12-01 12:39:36.090185021 +0000 UTC" Jun 02 01:50:39.674306 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.674301 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13138h48m56.415886842s" Jun 02 01:50:39.682364 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.682306 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mrnzm" Jun 02 01:50:39.690165 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.690126 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mrnzm" Jun 02 01:50:39.707705 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.707683 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:39.730219 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:39.730194 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-96.ec2.internal\" not found" Jun 02 01:50:39.762667 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:39.762632 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4ca6b244512da7ed67981aea007461.slice/crio-0fbafe513b57e08f5ce789b60b95ef42123d48eb6d1381b55f305335fb32f898 WatchSource:0}: Error finding container 0fbafe513b57e08f5ce789b60b95ef42123d48eb6d1381b55f305335fb32f898: Status 404 returned error can't find the container with id 0fbafe513b57e08f5ce789b60b95ef42123d48eb6d1381b55f305335fb32f898 Jun 02 01:50:39.762955 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:39.762936 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1081596490cd45967eb050f77c113fcd.slice/crio-12f4c36fee75d376883a5e8a5268891bc1363ee8a15a394d2981a0f17bfb4f1f WatchSource:0}: Error finding container 12f4c36fee75d376883a5e8a5268891bc1363ee8a15a394d2981a0f17bfb4f1f: Status 404 returned error can't find the container with id 12f4c36fee75d376883a5e8a5268891bc1363ee8a15a394d2981a0f17bfb4f1f Jun 02 01:50:39.766465 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.766452 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:50:39.792547 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.792527 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:39.839701 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.839679 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.859282 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.859264 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:50:39.860037 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.860025 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" Jun 02 01:50:39.869284 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.869269 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:50:39.944855 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:39.944779 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:40.619230 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.619194 2559 apiserver.go:52] "Watching apiserver" Jun 02 01:50:40.629233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.629212 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:50:40.631215 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.631171 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-jkp2b","openshift-network-operator/iptables-alerter-8mtgv","openshift-ovn-kubernetes/ovnkube-node-rfpnc","kube-system/global-pull-secret-syncer-7nfcg","kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8","openshift-cluster-node-tuning-operator/tuned-7f869","openshift-dns/node-resolver-9rrkx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal","openshift-multus/multus-f782n","openshift-network-diagnostics/network-check-target-5dq9z","kube-system/konnectivity-agent-cxwg2","openshift-image-registry/node-ca-x82gn","openshift-multus/multus-additional-cni-plugins-d22lb"] Jun 02 01:50:40.632669 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.632644 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f782n" Jun 02 01:50:40.633759 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.633733 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.636242 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.635944 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qgc5m\"" Jun 02 01:50:40.636242 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.635960 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.636242 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.635983 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:50:40.636242 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.635946 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:50:40.636242 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.636218 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:50:40.636507 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.636290 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.637159 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.636709 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.637159 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.636711 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5wtx\"" Jun 02 01:50:40.637159 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.636812 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.637159 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.636973 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.637573 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.637555 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.641069 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.640258 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:50:40.641069 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.640617 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:50:40.641069 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.640760 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:50:40.641069 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.640928 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6x9wh\"" Jun 02 01:50:40.641438 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.641161 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:50:40.641438 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.641222 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:50:40.641718 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.641702 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-59qlj\"" Jun 02 01:50:40.642089 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.641949 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cl5tr\"" Jun 02 01:50:40.642089 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.641963 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.642089 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.641973 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.642894 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.642369 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.642894 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.642380 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:50:40.642894 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.642442 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:50:40.642894 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.642796 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.643326 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.643308 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.643406 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.643344 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:40.643459 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.643437 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:40.643585 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.643313 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.646946 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.645221 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:40.646946 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.645295 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:40.647088 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.647010 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.647156 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.647078 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:40.647992 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.647926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-systemd\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.647992 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.647999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-var-lib-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-run-ovn-kubernetes\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.648226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-system-cni-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.648226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648086 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysctl-conf\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.648226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cpb8\" (UniqueName: \"kubernetes.io/projected/788f1e4b-ae50-4e76-8199-2ce5f3c32125-kube-api-access-9cpb8\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.648226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648128 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovn-node-metrics-cert\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-registration-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.648226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-multus-certs\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-cni-netd\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-k8s-cni-cncf-io\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648310 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-run-netns\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovnkube-config\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648396 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzb6b\" (UniqueName: \"kubernetes.io/projected/c98e7568-2413-4bc9-8364-340bd4df48d0-kube-api-access-dzb6b\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648456 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-cni-bin\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysconfig\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-socket-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-cni-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/788f1e4b-ae50-4e76-8199-2ce5f3c32125-tmp\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648593 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovnkube-script-lib\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a3e83f6-a64c-4ea2-b495-276fd21ae308-iptables-alerter-script\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-ovn\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.648689 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648695 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648705 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-env-overrides\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c98e7568-2413-4bc9-8364-340bd4df48d0-serviceca\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-cni-bin\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtgqp\" (UniqueName: \"kubernetes.io/projected/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-kube-api-access-wtgqp\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4869edb7-b7c3-49b2-8014-5a85cd52b448-agent-certs\") pod \"konnectivity-agent-cxwg2\" (UID: \"4869edb7-b7c3-49b2-8014-5a85cd52b448\") " pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648802 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4869edb7-b7c3-49b2-8014-5a85cd52b448-konnectivity-ca\") pod \"konnectivity-agent-cxwg2\" (UID: \"4869edb7-b7c3-49b2-8014-5a85cd52b448\") " pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-kubernetes\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648904 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-socket-dir-parent\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-run\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648947 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-var-lib-kubelet\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-device-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.648991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4jlk\" (UniqueName: \"kubernetes.io/projected/4a3e83f6-a64c-4ea2-b495-276fd21ae308-kube-api-access-f4jlk\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649003 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649008 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-krgjr\"" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649032 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649048 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ggtl7\"" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649015 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-tuned\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.649497 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649109 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-cnibin\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-kubelet\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a3e83f6-a64c-4ea2-b495-276fd21ae308-host-slash\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649232 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-modprobe-d\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c98e7568-2413-4bc9-8364-340bd4df48d0-host\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-sys-fs\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-cni-binary-copy\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-hostroot\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-conf-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-daemon-config\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-cni-multus\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649460 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-etc-kubernetes\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-systemd\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-sys\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-lib-modules\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-systemd-units\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.650339 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6jgq\" (UniqueName: \"kubernetes.io/projected/b4903e25-41e1-4b5d-8053-812193bac7e7-kube-api-access-q6jgq\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-kubelet\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-etc-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-log-socket\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-os-release\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-netns\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8ckx\" (UniqueName: \"kubernetes.io/projected/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-kube-api-access-g8ckx\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649814 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysctl-d\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-host\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-slash\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.649896 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-node-log\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.650989 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.651366 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.651018 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.654218 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.654196 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:50:40.654318 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.654260 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:50:40.654318 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.654300 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q74tj\"" Jun 02 01:50:40.654746 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.654526 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:50:40.654746 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.654526 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:50:40.654873 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.654842 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bdlw\"" Jun 02 01:50:40.691777 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.691756 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:45:39 +0000 UTC" deadline="2028-03-11 17:17:07.297551928 +0000 UTC" Jun 02 01:50:40.691777 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.691777 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15567h26m26.605777121s" Jun 02 01:50:40.740630 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.740610 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:50:40.752387 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752355 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-k8s-cni-cncf-io\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.752515 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752397 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-run-netns\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.752515 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752423 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovnkube-config\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.752515 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752444 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzb6b\" (UniqueName: \"kubernetes.io/projected/c98e7568-2413-4bc9-8364-340bd4df48d0-kube-api-access-dzb6b\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.752515 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-k8s-cni-cncf-io\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.752515 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-run-netns\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.752515 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752467 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.752515 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752509 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752513 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-cni-bin\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-cni-bin\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752551 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysconfig\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752573 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752592 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-socket-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-tmp-dir\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752641 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-cni-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752662 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/788f1e4b-ae50-4e76-8199-2ce5f3c32125-tmp\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752664 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752696 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752724 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovnkube-script-lib\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752742 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-cni-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752751 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a3e83f6-a64c-4ea2-b495-276fd21ae308-iptables-alerter-script\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.752805 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752772 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysconfig\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752819 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-ovn\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752849 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-env-overrides\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752865 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-socket-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752874 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c98e7568-2413-4bc9-8364-340bd4df48d0-serviceca\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-hosts-file\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-system-cni-dir\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-os-release\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cni-binary-copy\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753028 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovnkube-config\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753036 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-cni-bin\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753070 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-cni-bin\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753062 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753099 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtgqp\" (UniqueName: \"kubernetes.io/projected/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-kube-api-access-wtgqp\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753124 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4869edb7-b7c3-49b2-8014-5a85cd52b448-agent-certs\") pod \"konnectivity-agent-cxwg2\" (UID: \"4869edb7-b7c3-49b2-8014-5a85cd52b448\") " pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753177 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4869edb7-b7c3-49b2-8014-5a85cd52b448-konnectivity-ca\") pod \"konnectivity-agent-cxwg2\" (UID: \"4869edb7-b7c3-49b2-8014-5a85cd52b448\") " pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:50:40.753489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753202 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-kubernetes\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753226 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-socket-dir-parent\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753248 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-run\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-env-overrides\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753275 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-var-lib-kubelet\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753288 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovnkube-script-lib\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753300 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-device-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753303 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a3e83f6-a64c-4ea2-b495-276fd21ae308-iptables-alerter-script\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.752904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-ovn\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753328 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jlk\" (UniqueName: \"kubernetes.io/projected/4a3e83f6-a64c-4ea2-b495-276fd21ae308-kube-api-access-f4jlk\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk6fp\" (UniqueName: \"kubernetes.io/projected/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-kube-api-access-rk6fp\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753432 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-tuned\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753456 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e723871-88b6-4db1-b057-e7429c6c906d-kubelet-config\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cnibin\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753502 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-cnibin\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753522 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-kubelet\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.754296 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753543 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a3e83f6-a64c-4ea2-b495-276fd21ae308-host-slash\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753565 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c98e7568-2413-4bc9-8364-340bd4df48d0-serviceca\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753584 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-modprobe-d\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753570 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-run\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753604 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c98e7568-2413-4bc9-8364-340bd4df48d0-host\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753618 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-kubernetes\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-kubelet\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-cnibin\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753669 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-sys-fs\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753623 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-sys-fs\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-socket-dir-parent\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a3e83f6-a64c-4ea2-b495-276fd21ae308-host-slash\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-modprobe-d\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753814 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c98e7568-2413-4bc9-8364-340bd4df48d0-host\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753863 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-device-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753908 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4869edb7-b7c3-49b2-8014-5a85cd52b448-konnectivity-ca\") pod \"konnectivity-agent-cxwg2\" (UID: \"4869edb7-b7c3-49b2-8014-5a85cd52b448\") " pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:50:40.755033 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-var-lib-kubelet\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753911 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-cni-binary-copy\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753956 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-hostroot\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753976 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-conf-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.753997 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-daemon-config\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-hostroot\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk4ll\" (UniqueName: \"kubernetes.io/projected/7390b1f2-1a3d-48af-a481-196e75ec47d9-kube-api-access-tk4ll\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754054 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-conf-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754070 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-cni-multus\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754094 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-etc-kubernetes\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754116 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-systemd\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754153 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-sys\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754175 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-lib-modules\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754198 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-systemd-units\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754222 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6jgq\" (UniqueName: \"kubernetes.io/projected/b4903e25-41e1-4b5d-8053-812193bac7e7-kube-api-access-q6jgq\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754248 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.755869 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754270 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-kubelet\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754291 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-etc-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754311 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-log-socket\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754331 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-os-release\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754353 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-netns\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754379 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8ckx\" (UniqueName: \"kubernetes.io/projected/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-kube-api-access-g8ckx\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754402 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysctl-d\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754409 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-cni-binary-copy\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754424 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-host\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754449 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-slash\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754481 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-node-log\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754506 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-systemd\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754533 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-var-lib-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754558 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-run-ovn-kubernetes\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-multus-daemon-config\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754586 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754611 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-system-cni-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754636 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysctl-conf\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.756659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754661 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9cpb8\" (UniqueName: \"kubernetes.io/projected/788f1e4b-ae50-4e76-8199-2ce5f3c32125-kube-api-access-9cpb8\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754675 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-var-lib-cni-multus\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754694 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovn-node-metrics-cert\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754718 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-registration-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754722 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-etc-kubernetes\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754759 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-multus-certs\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-registration-dir\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754788 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-cni-netd\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754886 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysctl-d\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e723871-88b6-4db1-b057-e7429c6c906d-dbus\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754934 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-node-log\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszxv\" (UniqueName: \"kubernetes.io/projected/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-kube-api-access-vszxv\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-run-systemd\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-host\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.754944 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-sys\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-slash\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755021 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-systemd\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.757454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755063 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4903e25-41e1-4b5d-8053-812193bac7e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755065 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-system-cni-dir\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-run-ovn-kubernetes\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-lib-modules\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755201 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-systemd-units\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-var-lib-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-multus-certs\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-etc-openvswitch\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-os-release\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-kubelet\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755593 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-host-run-netns\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-log-socket\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.755793 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-host-cni-netd\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.756469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-sysctl-conf\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.756506 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/788f1e4b-ae50-4e76-8199-2ce5f3c32125-tmp\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.756943 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4869edb7-b7c3-49b2-8014-5a85cd52b448-agent-certs\") pod \"konnectivity-agent-cxwg2\" (UID: \"4869edb7-b7c3-49b2-8014-5a85cd52b448\") " pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.757115 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/788f1e4b-ae50-4e76-8199-2ce5f3c32125-etc-tuned\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.758115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.757451 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-ovn-node-metrics-cert\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.759534 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.759476 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" event={"ID":"1081596490cd45967eb050f77c113fcd","Type":"ContainerStarted","Data":"12f4c36fee75d376883a5e8a5268891bc1363ee8a15a394d2981a0f17bfb4f1f"} Jun 02 01:50:40.760381 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.760358 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzb6b\" (UniqueName: \"kubernetes.io/projected/c98e7568-2413-4bc9-8364-340bd4df48d0-kube-api-access-dzb6b\") pod \"node-ca-x82gn\" (UID: \"c98e7568-2413-4bc9-8364-340bd4df48d0\") " pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.760629 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.760606 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" event={"ID":"7b4ca6b244512da7ed67981aea007461","Type":"ContainerStarted","Data":"0fbafe513b57e08f5ce789b60b95ef42123d48eb6d1381b55f305335fb32f898"} Jun 02 01:50:40.761868 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.761851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4jlk\" (UniqueName: \"kubernetes.io/projected/4a3e83f6-a64c-4ea2-b495-276fd21ae308-kube-api-access-f4jlk\") pod \"iptables-alerter-8mtgv\" (UID: \"4a3e83f6-a64c-4ea2-b495-276fd21ae308\") " pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:40.762646 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.762602 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtgqp\" (UniqueName: \"kubernetes.io/projected/0fe017f5-70c9-4bc5-a37f-1a1b70c7a938-kube-api-access-wtgqp\") pod \"ovnkube-node-rfpnc\" (UID: \"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938\") " pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.769453 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.769426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cpb8\" (UniqueName: \"kubernetes.io/projected/788f1e4b-ae50-4e76-8199-2ce5f3c32125-kube-api-access-9cpb8\") pod \"tuned-7f869\" (UID: \"788f1e4b-ae50-4e76-8199-2ce5f3c32125\") " pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.769563 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.769543 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8ckx\" (UniqueName: \"kubernetes.io/projected/b1b3cdb5-8988-45b7-8f5c-80a5ff316895-kube-api-access-g8ckx\") pod \"multus-f782n\" (UID: \"b1b3cdb5-8988-45b7-8f5c-80a5ff316895\") " pod="openshift-multus/multus-f782n" Jun 02 01:50:40.770085 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.770067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6jgq\" (UniqueName: \"kubernetes.io/projected/b4903e25-41e1-4b5d-8053-812193bac7e7-kube-api-access-q6jgq\") pod \"aws-ebs-csi-driver-node-ns2g8\" (UID: \"b4903e25-41e1-4b5d-8053-812193bac7e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.819040 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.819009 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:50:40.855795 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855759 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-tmp-dir\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.855945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855807 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-hosts-file\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.855945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855835 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-system-cni-dir\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.855945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855859 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-os-release\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.855945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855883 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cni-binary-copy\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.855945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855912 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855948 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rk6fp\" (UniqueName: \"kubernetes.io/projected/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-kube-api-access-rk6fp\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855947 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-system-cni-dir\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855973 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855998 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e723871-88b6-4db1-b057-e7429c6c906d-kubelet-config\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856020 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-hosts-file\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856022 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cnibin\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cnibin\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856076 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856103 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856133 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856173 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tk4ll\" (UniqueName: \"kubernetes.io/projected/7390b1f2-1a3d-48af-a481-196e75ec47d9-kube-api-access-tk4ll\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.855995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-os-release\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6e723871-88b6-4db1-b057-e7429c6c906d-kubelet-config\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856295 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856332 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e723871-88b6-4db1-b057-e7429c6c906d-dbus\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856348 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vszxv\" (UniqueName: \"kubernetes.io/projected/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-kube-api-access-vszxv\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.856440 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6e723871-88b6-4db1-b057-e7429c6c906d-dbus\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.856526 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret podName:6e723871-88b6-4db1-b057-e7429c6c906d nodeName:}" failed. No retries permitted until 2026-06-02 01:50:41.356483646 +0000 UTC m=+3.272614671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret") pod "global-pull-secret-syncer-7nfcg" (UID: "6e723871-88b6-4db1-b057-e7429c6c906d") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856572 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cni-binary-copy\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856572 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856665 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-tmp-dir\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.856692 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.856749 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:40.856826 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.856796 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:41.356780485 +0000 UTC m=+3.272911494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:40.867723 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.867690 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:40.867723 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.867724 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:40.867896 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.867738 2559 projected.go:194] Error preparing data for projected volume kube-api-access-vq499 for pod openshift-network-diagnostics/network-check-target-5dq9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:40.867896 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:40.867798 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499 podName:03bd6b6a-ac55-46aa-ab2d-e420fbfe783c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:41.367781593 +0000 UTC m=+3.283912601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vq499" (UniqueName: "kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499") pod "network-check-target-5dq9z" (UID: "03bd6b6a-ac55-46aa-ab2d-e420fbfe783c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:40.868058 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.868038 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszxv\" (UniqueName: \"kubernetes.io/projected/d066af60-4fa2-44da-92b5-d1c3ecdf5f22-kube-api-access-vszxv\") pod \"multus-additional-cni-plugins-d22lb\" (UID: \"d066af60-4fa2-44da-92b5-d1c3ecdf5f22\") " pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:40.869899 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.869848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk6fp\" (UniqueName: \"kubernetes.io/projected/937fac9e-c35b-4b3e-9f62-934a5fbb01bf-kube-api-access-rk6fp\") pod \"node-resolver-9rrkx\" (UID: \"937fac9e-c35b-4b3e-9f62-934a5fbb01bf\") " pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:40.870291 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.870275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk4ll\" (UniqueName: \"kubernetes.io/projected/7390b1f2-1a3d-48af-a481-196e75ec47d9-kube-api-access-tk4ll\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:40.945188 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.945154 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f782n" Jun 02 01:50:40.953826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.953806 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7f869" Jun 02 01:50:40.970568 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.970537 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:50:40.977228 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.977199 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:50:40.984767 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.984745 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x82gn" Jun 02 01:50:40.990254 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.990231 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" Jun 02 01:50:40.995730 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:40.995710 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8mtgv" Jun 02 01:50:41.001216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.001196 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9rrkx" Jun 02 01:50:41.004711 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.004692 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d22lb" Jun 02 01:50:41.363086 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.363001 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:41.363086 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.363046 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:41.363270 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:41.363162 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:41.363270 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:41.363219 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret podName:6e723871-88b6-4db1-b057-e7429c6c906d nodeName:}" failed. No retries permitted until 2026-06-02 01:50:42.363197914 +0000 UTC m=+4.279328920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret") pod "global-pull-secret-syncer-7nfcg" (UID: "6e723871-88b6-4db1-b057-e7429c6c906d") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:41.363270 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:41.363161 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:41.363400 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:41.363289 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:42.363276097 +0000 UTC m=+4.279407122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:41.464111 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.464078 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:41.464296 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:41.464252 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:41.464296 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:41.464272 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:41.464296 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:41.464284 2559 projected.go:194] Error preparing data for projected volume kube-api-access-vq499 for pod openshift-network-diagnostics/network-check-target-5dq9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:41.464447 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:41.464349 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499 podName:03bd6b6a-ac55-46aa-ab2d-e420fbfe783c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:42.464330628 +0000 UTC m=+4.380461637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq499" (UniqueName: "kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499") pod "network-check-target-5dq9z" (UID: "03bd6b6a-ac55-46aa-ab2d-e420fbfe783c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:41.508795 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:41.508770 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3e83f6_a64c_4ea2_b495_276fd21ae308.slice/crio-ec3899f33cdb35ed7d0bda27702d5f97db45bf637d1118cd89813279f99566ee WatchSource:0}: Error finding container ec3899f33cdb35ed7d0bda27702d5f97db45bf637d1118cd89813279f99566ee: Status 404 returned error can't find the container with id ec3899f33cdb35ed7d0bda27702d5f97db45bf637d1118cd89813279f99566ee Jun 02 01:50:41.510052 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:41.510026 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98e7568_2413_4bc9_8364_340bd4df48d0.slice/crio-546bba86a8e649e6df9680f784eb14995b8a04dafe0c85fb04098d789dd6b53b WatchSource:0}: Error finding container 546bba86a8e649e6df9680f784eb14995b8a04dafe0c85fb04098d789dd6b53b: Status 404 returned error can't find the container with id 546bba86a8e649e6df9680f784eb14995b8a04dafe0c85fb04098d789dd6b53b Jun 02 01:50:41.510726 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:41.510652 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b3cdb5_8988_45b7_8f5c_80a5ff316895.slice/crio-f9eb738fd5e093d5b9352a57a9366a0c6709f35127077118b74c0c4d887f1fad WatchSource:0}: Error finding container f9eb738fd5e093d5b9352a57a9366a0c6709f35127077118b74c0c4d887f1fad: Status 404 returned error can't find the container with id f9eb738fd5e093d5b9352a57a9366a0c6709f35127077118b74c0c4d887f1fad Jun 02 01:50:41.513593 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:41.513578 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4903e25_41e1_4b5d_8053_812193bac7e7.slice/crio-758f0c977fe0fe6b60d261d6b44cfe00df23aa134093054af649c1788b2f841e WatchSource:0}: Error finding container 758f0c977fe0fe6b60d261d6b44cfe00df23aa134093054af649c1788b2f841e: Status 404 returned error can't find the container with id 758f0c977fe0fe6b60d261d6b44cfe00df23aa134093054af649c1788b2f841e Jun 02 01:50:41.514447 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:41.514425 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937fac9e_c35b_4b3e_9f62_934a5fbb01bf.slice/crio-ca139eb187181b871023d43bb002f4f93c9d6a5ac86c0e7689d6d52d1281252a WatchSource:0}: Error finding container ca139eb187181b871023d43bb002f4f93c9d6a5ac86c0e7689d6d52d1281252a: Status 404 returned error can't find the container with id ca139eb187181b871023d43bb002f4f93c9d6a5ac86c0e7689d6d52d1281252a Jun 02 01:50:41.515546 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:41.515295 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4869edb7_b7c3_49b2_8014_5a85cd52b448.slice/crio-4faaf40f6d0163fd1d41d7026f099f861508fd5e1ccaa14f9c81b2b98dbb046f WatchSource:0}: Error finding container 4faaf40f6d0163fd1d41d7026f099f861508fd5e1ccaa14f9c81b2b98dbb046f: Status 404 returned error can't find the container with id 4faaf40f6d0163fd1d41d7026f099f861508fd5e1ccaa14f9c81b2b98dbb046f Jun 02 01:50:41.516638 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:41.516511 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd066af60_4fa2_44da_92b5_d1c3ecdf5f22.slice/crio-4c42087c26495f186fc8099463912d6c8e7529fd93444b967cdc2af94b9c7040 WatchSource:0}: Error finding container 4c42087c26495f186fc8099463912d6c8e7529fd93444b967cdc2af94b9c7040: Status 404 returned error can't find the container with id 4c42087c26495f186fc8099463912d6c8e7529fd93444b967cdc2af94b9c7040 Jun 02 01:50:41.517608 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:50:41.517556 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe017f5_70c9_4bc5_a37f_1a1b70c7a938.slice/crio-eedbf68db59a94203a4dbe5ae0115026a77a37ad9b7a6846b22e40b8376960b6 WatchSource:0}: Error finding container eedbf68db59a94203a4dbe5ae0115026a77a37ad9b7a6846b22e40b8376960b6: Status 404 returned error can't find the container with id eedbf68db59a94203a4dbe5ae0115026a77a37ad9b7a6846b22e40b8376960b6 Jun 02 01:50:41.692948 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.692685 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:45:39 +0000 UTC" deadline="2028-01-28 02:39:57.880170262 +0000 UTC" Jun 02 01:50:41.692948 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.692881 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14520h49m16.187294581s" Jun 02 01:50:41.764287 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.764247 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" event={"ID":"1081596490cd45967eb050f77c113fcd","Type":"ContainerStarted","Data":"fb3e1a04500c183500c731194cf1e82a362fe9ea4d2d583df9b7ae42da6b67fd"} Jun 02 01:50:41.766924 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.766894 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7f869" event={"ID":"788f1e4b-ae50-4e76-8199-2ce5f3c32125","Type":"ContainerStarted","Data":"e4d61fbb861e46e9ab6777d1ab7c21decbc089c5be6240ab72139d0f8c74bf2f"} Jun 02 01:50:41.767967 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.767946 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d22lb" event={"ID":"d066af60-4fa2-44da-92b5-d1c3ecdf5f22","Type":"ContainerStarted","Data":"4c42087c26495f186fc8099463912d6c8e7529fd93444b967cdc2af94b9c7040"} Jun 02 01:50:41.768952 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.768930 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" event={"ID":"b4903e25-41e1-4b5d-8053-812193bac7e7","Type":"ContainerStarted","Data":"758f0c977fe0fe6b60d261d6b44cfe00df23aa134093054af649c1788b2f841e"} Jun 02 01:50:41.769957 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.769938 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f782n" event={"ID":"b1b3cdb5-8988-45b7-8f5c-80a5ff316895","Type":"ContainerStarted","Data":"f9eb738fd5e093d5b9352a57a9366a0c6709f35127077118b74c0c4d887f1fad"} Jun 02 01:50:41.770886 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.770863 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8mtgv" event={"ID":"4a3e83f6-a64c-4ea2-b495-276fd21ae308","Type":"ContainerStarted","Data":"ec3899f33cdb35ed7d0bda27702d5f97db45bf637d1118cd89813279f99566ee"} Jun 02 01:50:41.771945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.771928 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"eedbf68db59a94203a4dbe5ae0115026a77a37ad9b7a6846b22e40b8376960b6"} Jun 02 01:50:41.772760 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.772740 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cxwg2" event={"ID":"4869edb7-b7c3-49b2-8014-5a85cd52b448","Type":"ContainerStarted","Data":"4faaf40f6d0163fd1d41d7026f099f861508fd5e1ccaa14f9c81b2b98dbb046f"} Jun 02 01:50:41.773728 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.773709 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9rrkx" event={"ID":"937fac9e-c35b-4b3e-9f62-934a5fbb01bf","Type":"ContainerStarted","Data":"ca139eb187181b871023d43bb002f4f93c9d6a5ac86c0e7689d6d52d1281252a"} Jun 02 01:50:41.774591 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:41.774574 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x82gn" event={"ID":"c98e7568-2413-4bc9-8364-340bd4df48d0","Type":"ContainerStarted","Data":"546bba86a8e649e6df9680f784eb14995b8a04dafe0c85fb04098d789dd6b53b"} Jun 02 01:50:42.372956 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.372920 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:42.373192 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.372970 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:42.373192 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.373092 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:42.373192 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.373174 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret podName:6e723871-88b6-4db1-b057-e7429c6c906d nodeName:}" failed. No retries permitted until 2026-06-02 01:50:44.373151566 +0000 UTC m=+6.289282586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret") pod "global-pull-secret-syncer-7nfcg" (UID: "6e723871-88b6-4db1-b057-e7429c6c906d") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:42.373583 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.373562 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:42.373676 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.373663 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:44.373626593 +0000 UTC m=+6.289757616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:42.473332 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.473275 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:42.473496 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.473469 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:42.473496 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.473490 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:42.473608 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.473502 2559 projected.go:194] Error preparing data for projected volume kube-api-access-vq499 for pod openshift-network-diagnostics/network-check-target-5dq9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:42.473608 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.473561 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499 podName:03bd6b6a-ac55-46aa-ab2d-e420fbfe783c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:44.473543231 +0000 UTC m=+6.389674251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq499" (UniqueName: "kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499") pod "network-check-target-5dq9z" (UID: "03bd6b6a-ac55-46aa-ab2d-e420fbfe783c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:42.755810 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.755735 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:42.756236 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.755866 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:42.756310 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.756252 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:42.756356 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.756341 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:42.756434 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.756419 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:42.756520 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:42.756499 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:42.785193 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.784885 2559 generic.go:358] "Generic (PLEG): container finished" podID="7b4ca6b244512da7ed67981aea007461" containerID="a31c9d46f5357569958c738941544703fae2fa4ee29af85bd42de83de5581db4" exitCode=0 Jun 02 01:50:42.785193 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.784990 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" event={"ID":"7b4ca6b244512da7ed67981aea007461","Type":"ContainerDied","Data":"a31c9d46f5357569958c738941544703fae2fa4ee29af85bd42de83de5581db4"} Jun 02 01:50:42.801687 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:42.801638 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-96.ec2.internal" podStartSLOduration=3.801620576 podStartE2EDuration="3.801620576s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:41.784125234 +0000 UTC m=+3.700256264" watchObservedRunningTime="2026-06-02 01:50:42.801620576 +0000 UTC m=+4.717751605" Jun 02 01:50:43.796940 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:43.796896 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" event={"ID":"7b4ca6b244512da7ed67981aea007461","Type":"ContainerStarted","Data":"ff5d1bc8eab8713264bda7b4351352e4b704fe0d4c39fac9d40e0268c8b55bb0"} Jun 02 01:50:44.391454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:44.391415 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:44.391648 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:44.391474 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:44.391648 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.391639 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:44.391775 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.391703 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret podName:6e723871-88b6-4db1-b057-e7429c6c906d nodeName:}" failed. No retries permitted until 2026-06-02 01:50:48.391685873 +0000 UTC m=+10.307816893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret") pod "global-pull-secret-syncer-7nfcg" (UID: "6e723871-88b6-4db1-b057-e7429c6c906d") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:44.391874 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.391857 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:44.391931 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.391899 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:48.391886616 +0000 UTC m=+10.308017638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:44.492342 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:44.492305 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:44.492552 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.492531 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:44.492618 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.492553 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:44.492618 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.492567 2559 projected.go:194] Error preparing data for projected volume kube-api-access-vq499 for pod openshift-network-diagnostics/network-check-target-5dq9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:44.492709 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.492631 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499 podName:03bd6b6a-ac55-46aa-ab2d-e420fbfe783c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:48.49261069 +0000 UTC m=+10.408741712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq499" (UniqueName: "kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499") pod "network-check-target-5dq9z" (UID: "03bd6b6a-ac55-46aa-ab2d-e420fbfe783c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:44.759335 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:44.759268 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:44.759491 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.759401 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:44.759758 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:44.759737 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:44.759824 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:44.759755 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:44.759874 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.759843 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:44.760073 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:44.760044 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:46.758949 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:46.758520 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:46.758949 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:46.758645 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:46.758949 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:46.758713 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:46.758949 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:46.758782 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:46.758949 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:46.758794 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:46.758949 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:46.758873 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:48.426048 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:48.425288 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:48.426048 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:48.425347 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:48.426048 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.425480 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:48.426048 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.425559 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:48.426048 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.425619 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:50:56.425601168 +0000 UTC m=+18.341732198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:48.426048 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.426009 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret podName:6e723871-88b6-4db1-b057-e7429c6c906d nodeName:}" failed. No retries permitted until 2026-06-02 01:50:56.425990165 +0000 UTC m=+18.342121190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret") pod "global-pull-secret-syncer-7nfcg" (UID: "6e723871-88b6-4db1-b057-e7429c6c906d") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:48.526737 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:48.526699 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:48.526916 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.526852 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:48.526916 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.526869 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:48.526916 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.526882 2559 projected.go:194] Error preparing data for projected volume kube-api-access-vq499 for pod openshift-network-diagnostics/network-check-target-5dq9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:48.527082 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.526945 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499 podName:03bd6b6a-ac55-46aa-ab2d-e420fbfe783c nodeName:}" failed. No retries permitted until 2026-06-02 01:50:56.52692675 +0000 UTC m=+18.443057762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq499" (UniqueName: "kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499") pod "network-check-target-5dq9z" (UID: "03bd6b6a-ac55-46aa-ab2d-e420fbfe783c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:48.759486 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:48.759449 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:48.759649 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.759600 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:48.760211 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:48.760191 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:48.760363 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.760345 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:48.760441 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:48.760427 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:48.760555 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:48.760540 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:50.759009 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:50.758977 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:50.759009 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:50.759004 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:50.759448 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:50.759026 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:50.759448 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:50.759107 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:50.759448 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:50.759205 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:50.759448 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:50.759302 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:52.755871 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:52.755841 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:52.756341 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:52.755840 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:52.756341 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:52.755968 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:52.756341 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:52.755841 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:52.756341 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:52.756038 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:52.756341 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:52.756115 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:54.758455 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:54.758420 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:54.758855 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:54.758533 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:54.758855 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:54.758420 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:54.758855 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:54.758420 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:54.758855 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:54.758637 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:54.758855 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:54.758713 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:56.490319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:56.490282 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:56.490811 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:56.490331 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:56.490811 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.490452 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:56.490811 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.490469 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:56.490811 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.490519 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret podName:6e723871-88b6-4db1-b057-e7429c6c906d nodeName:}" failed. No retries permitted until 2026-06-02 01:51:12.490502194 +0000 UTC m=+34.406633222 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret") pod "global-pull-secret-syncer-7nfcg" (UID: "6e723871-88b6-4db1-b057-e7429c6c906d") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:50:56.490811 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.490535 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:12.490527869 +0000 UTC m=+34.406658875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:50:56.591031 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:56.590995 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:56.591220 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.591200 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:50:56.591220 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.591221 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:50:56.591351 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.591235 2559 projected.go:194] Error preparing data for projected volume kube-api-access-vq499 for pod openshift-network-diagnostics/network-check-target-5dq9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:56.591351 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.591303 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499 podName:03bd6b6a-ac55-46aa-ab2d-e420fbfe783c nodeName:}" failed. No retries permitted until 2026-06-02 01:51:12.591282544 +0000 UTC m=+34.507413569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq499" (UniqueName: "kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499") pod "network-check-target-5dq9z" (UID: "03bd6b6a-ac55-46aa-ab2d-e420fbfe783c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:50:56.755232 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:56.755127 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:56.755394 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:56.755262 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:56.755394 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.755272 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:56.755394 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:56.755294 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:56.755546 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.755396 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:56.755546 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:56.755508 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:58.758113 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:58.758086 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:50:58.758614 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:58.758084 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:50:58.758614 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:58.758222 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:50:58.758614 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:58.758094 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:50:58.758614 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:58.758282 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:50:58.758614 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:50:58.758339 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:50:59.827351 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.827130 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"8c4d16493286efcecf1eee51f9e159207225d28c72fb493a68c746ceff2bbb82"} Jun 02 01:50:59.827995 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.827357 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"1720aee7e623750b9ee26715c28ace15045a7fb8a8cff3631b1a30225bf72604"} Jun 02 01:50:59.827995 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.827375 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"3f4c096e1fb5198f0d9af51e0f880e1e71b6c3278961e596cc5fe7332861862d"} Jun 02 01:50:59.828408 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.828388 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cxwg2" event={"ID":"4869edb7-b7c3-49b2-8014-5a85cd52b448","Type":"ContainerStarted","Data":"bf4930f40fb14d79401d0bf5c1b690da7f40e09f2d0f3e7ffa9643e45601eb9d"} Jun 02 01:50:59.829646 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.829628 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9rrkx" event={"ID":"937fac9e-c35b-4b3e-9f62-934a5fbb01bf","Type":"ContainerStarted","Data":"8a52aff94152b2ac7ba18fa518a52a11ca7df6835aa017f267aab94fd61f3590"} Jun 02 01:50:59.830874 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.830851 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x82gn" event={"ID":"c98e7568-2413-4bc9-8364-340bd4df48d0","Type":"ContainerStarted","Data":"91ce4d6ac0066be82dd182545d317656b0d3e69af3121f1f9ebbb1844b4bb572"} Jun 02 01:50:59.832062 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.832044 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7f869" event={"ID":"788f1e4b-ae50-4e76-8199-2ce5f3c32125","Type":"ContainerStarted","Data":"74e6b2bb66a4b7dbe38821bdd00abd3ff8705194fd87fbad951820e337ae9f8c"} Jun 02 01:50:59.833697 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.833575 2559 generic.go:358] "Generic (PLEG): container finished" podID="d066af60-4fa2-44da-92b5-d1c3ecdf5f22" containerID="c68afc5943029c5153af4aa2fbcc216217ada026c9983020cec286f4bc1c41e9" exitCode=0 Jun 02 01:50:59.833697 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.833635 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d22lb" event={"ID":"d066af60-4fa2-44da-92b5-d1c3ecdf5f22","Type":"ContainerDied","Data":"c68afc5943029c5153af4aa2fbcc216217ada026c9983020cec286f4bc1c41e9"} Jun 02 01:50:59.835204 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.835179 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" event={"ID":"b4903e25-41e1-4b5d-8053-812193bac7e7","Type":"ContainerStarted","Data":"dcc707060e35263436ef52d4b5fd511a25a267c6526d707bdc7a194f1c12f620"} Jun 02 01:50:59.836484 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.836465 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f782n" event={"ID":"b1b3cdb5-8988-45b7-8f5c-80a5ff316895","Type":"ContainerStarted","Data":"ed18012cb8d6c4298781ad7e5c2f7dc02b03e2f69d29aee56f4b8e5208c7b732"} Jun 02 01:50:59.843932 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.843896 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-96.ec2.internal" podStartSLOduration=20.843885539 podStartE2EDuration="20.843885539s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:50:43.814499608 +0000 UTC m=+5.730630636" watchObservedRunningTime="2026-06-02 01:50:59.843885539 +0000 UTC m=+21.760016602" Jun 02 01:50:59.844110 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.844087 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cxwg2" podStartSLOduration=4.04780837 podStartE2EDuration="21.844082441s" podCreationTimestamp="2026-06-02 01:50:38 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.517801911 +0000 UTC m=+3.433932947" lastFinishedPulling="2026-06-02 01:50:59.314076012 +0000 UTC m=+21.230207018" observedRunningTime="2026-06-02 01:50:59.843422541 +0000 UTC m=+21.759553571" watchObservedRunningTime="2026-06-02 01:50:59.844082441 +0000 UTC m=+21.760213468" Jun 02 01:50:59.856952 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.856911 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x82gn" podStartSLOduration=2.958050278 podStartE2EDuration="20.856898728s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.512180327 +0000 UTC m=+3.428311333" lastFinishedPulling="2026-06-02 01:50:59.411028775 +0000 UTC m=+21.327159783" observedRunningTime="2026-06-02 01:50:59.856564396 +0000 UTC m=+21.772695422" watchObservedRunningTime="2026-06-02 01:50:59.856898728 +0000 UTC m=+21.773029755" Jun 02 01:50:59.875844 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.875800 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7f869" podStartSLOduration=4.024613244 podStartE2EDuration="21.875786963s" podCreationTimestamp="2026-06-02 01:50:38 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.521210971 +0000 UTC m=+3.437341977" lastFinishedPulling="2026-06-02 01:50:59.372384675 +0000 UTC m=+21.288515696" observedRunningTime="2026-06-02 01:50:59.875101277 +0000 UTC m=+21.791232304" watchObservedRunningTime="2026-06-02 01:50:59.875786963 +0000 UTC m=+21.791917990" Jun 02 01:50:59.889588 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.889549 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9rrkx" podStartSLOduration=3.033246579 podStartE2EDuration="20.889537435s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.516128513 +0000 UTC m=+3.432259531" lastFinishedPulling="2026-06-02 01:50:59.372419381 +0000 UTC m=+21.288550387" observedRunningTime="2026-06-02 01:50:59.889392846 +0000 UTC m=+21.805523872" watchObservedRunningTime="2026-06-02 01:50:59.889537435 +0000 UTC m=+21.805668463" Jun 02 01:50:59.929265 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:50:59.929220 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-f782n" podStartSLOduration=3.874437091 podStartE2EDuration="21.929207425s" podCreationTimestamp="2026-06-02 01:50:38 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.512726673 +0000 UTC m=+3.428857679" lastFinishedPulling="2026-06-02 01:50:59.567497006 +0000 UTC m=+21.483628013" observedRunningTime="2026-06-02 01:50:59.92898176 +0000 UTC m=+21.845112789" watchObservedRunningTime="2026-06-02 01:50:59.929207425 +0000 UTC m=+21.845338449" Jun 02 01:51:00.667172 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.667108 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:51:00.667831 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.667812 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:51:00.758702 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.758675 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:00.758843 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.758684 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:00.758843 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:00.758771 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:51:00.758953 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:00.758856 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:51:00.758953 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.758684 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:00.758953 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:00.758945 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:51:00.816766 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.816742 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:51:00.839369 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.839314 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8mtgv" event={"ID":"4a3e83f6-a64c-4ea2-b495-276fd21ae308","Type":"ContainerStarted","Data":"6ec4b105ae4ca5d467eac0d8f2d55e9cd9d9181f36a5db09ec299bcb3fa0de2d"} Jun 02 01:51:00.842414 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.842385 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"75a0913af3ebc2c67de68a3fcd238cdc2bd25d9fae7513d2f2a467bbd246a047"} Jun 02 01:51:00.842530 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.842429 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"026dc8acecef7e79c02bf193beb6c43ea982b8c804dfa3106645d9e454e9e6e4"} Jun 02 01:51:00.842530 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.842444 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"0b4b0275edfc1d01bda652389decd4432698033ae382bfff7ce088eb4d1b4a56"} Jun 02 01:51:00.844099 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.844078 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" event={"ID":"b4903e25-41e1-4b5d-8053-812193bac7e7","Type":"ContainerStarted","Data":"3f6e43f77f5d8d65b0c6fb1ca807eb961eb090673b90554eee82ce4a00692b1f"} Jun 02 01:51:00.856031 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:00.855988 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8mtgv" podStartSLOduration=3.956371254 podStartE2EDuration="21.855976992s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.511475606 +0000 UTC m=+3.427606624" lastFinishedPulling="2026-06-02 01:50:59.411081351 +0000 UTC m=+21.327212362" observedRunningTime="2026-06-02 01:51:00.855286121 +0000 UTC m=+22.771417150" watchObservedRunningTime="2026-06-02 01:51:00.855976992 +0000 UTC m=+22.772108019" Jun 02 01:51:01.701594 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:01.701480 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:51:00.816762484Z","UUID":"48a48b0f-da82-4210-8176-f4afcfb9e51b","Handler":null,"Name":"","Endpoint":""} Jun 02 01:51:01.704879 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:01.704852 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:51:01.704879 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:01.704882 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:51:01.849063 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:01.849022 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" event={"ID":"b4903e25-41e1-4b5d-8053-812193bac7e7","Type":"ContainerStarted","Data":"fbad69724da51c3ca61d644ee92e84653f9a53b4ef9c4b0a33a3415e92d2d35d"} Jun 02 01:51:01.849460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:01.849188 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:51:01.867008 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:01.866958 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns2g8" podStartSLOduration=2.6558150769999997 podStartE2EDuration="22.866942312s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.515266429 +0000 UTC m=+3.431397449" lastFinishedPulling="2026-06-02 01:51:01.726393678 +0000 UTC m=+23.642524684" observedRunningTime="2026-06-02 01:51:01.866916085 +0000 UTC m=+23.783047114" watchObservedRunningTime="2026-06-02 01:51:01.866942312 +0000 UTC m=+23.783073341" Jun 02 01:51:02.755546 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:02.755509 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:02.755729 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:02.755511 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:02.755729 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:02.755633 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:51:02.755845 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:02.755739 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:51:02.755845 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:02.755509 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:02.755845 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:02.755818 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:51:02.853918 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:02.853879 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"0118eb4b0ddbc6d843a441273d2316ca0e09a81cacfe5830426ca2f699e7775f"} Jun 02 01:51:04.597774 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.597585 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:51:04.598659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.597887 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:51:04.598659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.598202 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cxwg2" Jun 02 01:51:04.757887 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.757857 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:04.758060 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.757857 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:04.758060 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:04.757939 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:51:04.758060 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:04.758029 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:51:04.758060 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.757867 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:04.758252 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:04.758132 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:51:04.858229 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.858194 2559 generic.go:358] "Generic (PLEG): container finished" podID="d066af60-4fa2-44da-92b5-d1c3ecdf5f22" containerID="833d31d6509a05e3bc20abe45b5e741f3577d8e4ce6fce5894275f160ee9812d" exitCode=0 Jun 02 01:51:04.858397 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.858243 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d22lb" event={"ID":"d066af60-4fa2-44da-92b5-d1c3ecdf5f22","Type":"ContainerDied","Data":"833d31d6509a05e3bc20abe45b5e741f3577d8e4ce6fce5894275f160ee9812d"} Jun 02 01:51:04.861346 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.861321 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" event={"ID":"0fe017f5-70c9-4bc5-a37f-1a1b70c7a938","Type":"ContainerStarted","Data":"db400bfa21d40c440a8922de8d7f0aaed954b114b5e5c8b2efed5464b8042080"} Jun 02 01:51:04.911123 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:04.911077 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" podStartSLOduration=8.975414301 podStartE2EDuration="26.911063593s" podCreationTimestamp="2026-06-02 01:50:38 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.519863498 +0000 UTC m=+3.435994506" lastFinishedPulling="2026-06-02 01:50:59.455512791 +0000 UTC m=+21.371643798" observedRunningTime="2026-06-02 01:51:04.910911356 +0000 UTC m=+26.827042383" watchObservedRunningTime="2026-06-02 01:51:04.911063593 +0000 UTC m=+26.827194621" Jun 02 01:51:05.863300 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:05.863257 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:51:05.863706 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:05.863315 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:51:05.863706 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:05.863334 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:51:05.882636 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:05.882597 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:51:05.884494 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:05.884466 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:51:06.305523 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:06.305490 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7nfcg"] Jun 02 01:51:06.305681 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:06.305635 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:06.305764 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:06.305739 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:51:06.306076 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:06.306058 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5dq9z"] Jun 02 01:51:06.306176 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:06.306165 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:06.306248 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:06.306232 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:51:06.308015 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:06.307993 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkp2b"] Jun 02 01:51:06.308123 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:06.308088 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:06.308201 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:06.308187 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:51:06.865980 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:06.865942 2559 generic.go:358] "Generic (PLEG): container finished" podID="d066af60-4fa2-44da-92b5-d1c3ecdf5f22" containerID="39d182a1707d87ad3cf3e7aa5f3c4c9d031e4f30b3951293584265cfcf947a97" exitCode=0 Jun 02 01:51:06.866493 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:06.866026 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d22lb" event={"ID":"d066af60-4fa2-44da-92b5-d1c3ecdf5f22","Type":"ContainerDied","Data":"39d182a1707d87ad3cf3e7aa5f3c4c9d031e4f30b3951293584265cfcf947a97"} Jun 02 01:51:07.755369 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:07.755109 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:07.755529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:07.755109 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:07.755529 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:07.755415 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:51:07.755529 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:07.755464 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:51:08.756916 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:08.756887 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:08.757334 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:08.756998 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:51:08.871784 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:08.871749 2559 generic.go:358] "Generic (PLEG): container finished" podID="d066af60-4fa2-44da-92b5-d1c3ecdf5f22" containerID="ffcb9ba2721cd77c1f6a36b6993cfc3936ae0584c5ab4677e90c73c71cede7b8" exitCode=0 Jun 02 01:51:08.871943 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:08.871824 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d22lb" event={"ID":"d066af60-4fa2-44da-92b5-d1c3ecdf5f22","Type":"ContainerDied","Data":"ffcb9ba2721cd77c1f6a36b6993cfc3936ae0584c5ab4677e90c73c71cede7b8"} Jun 02 01:51:09.755774 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:09.755737 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:09.755950 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:09.755861 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:51:09.755950 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:09.755913 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:09.756065 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:09.756019 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:51:10.755371 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:10.755336 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:10.755958 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:10.755470 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5dq9z" podUID="03bd6b6a-ac55-46aa-ab2d-e420fbfe783c" Jun 02 01:51:11.755582 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:11.755549 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:11.755984 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:11.755549 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:11.755984 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:11.755659 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:51:11.755984 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:11.755749 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7nfcg" podUID="6e723871-88b6-4db1-b057-e7429c6c906d" Jun 02 01:51:12.452249 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.452220 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-96.ec2.internal" event="NodeReady" Jun 02 01:51:12.452421 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.452376 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:51:12.493941 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.493909 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-75gv6"] Jun 02 01:51:12.497357 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.497328 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2ls86"] Jun 02 01:51:12.497472 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.497415 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.499995 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.499969 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:51:12.500325 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.500305 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:51:12.500434 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.500344 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqf6s\"" Jun 02 01:51:12.500493 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.500432 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:12.502545 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.502471 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:51:12.502874 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.502739 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:51:12.502874 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.502766 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:51:12.502874 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.502793 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jf6tl\"" Jun 02 01:51:12.504933 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.504900 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-75gv6"] Jun 02 01:51:12.507741 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.507716 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:12.507836 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.507757 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:12.507898 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.507857 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:51:12.507949 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.507909 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret podName:6e723871-88b6-4db1-b057-e7429c6c906d nodeName:}" failed. No retries permitted until 2026-06-02 01:51:44.507895184 +0000 UTC m=+66.424026191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret") pod "global-pull-secret-syncer-7nfcg" (UID: "6e723871-88b6-4db1-b057-e7429c6c906d") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:51:12.508064 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.508046 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:51:12.508131 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.508106 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:51:44.508088837 +0000 UTC m=+66.424219862 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:51:12.515164 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.515129 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2ls86"] Jun 02 01:51:12.608692 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.608649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.608868 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.608693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmddt\" (UniqueName: \"kubernetes.io/projected/586260d8-1a00-4e53-97bb-7da92f4473ed-kube-api-access-mmddt\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.608868 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.608740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/586260d8-1a00-4e53-97bb-7da92f4473ed-config-volume\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.608868 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.608809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/586260d8-1a00-4e53-97bb-7da92f4473ed-tmp-dir\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.608991 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.608867 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8npc\" (UniqueName: \"kubernetes.io/projected/420f75c1-1c72-45e3-82af-19acef404dcf-kube-api-access-j8npc\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:12.608991 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.608933 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:12.608991 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.608961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:12.609126 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.609109 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:51:12.609205 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.609133 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:51:12.609205 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.609160 2559 projected.go:194] Error preparing data for projected volume kube-api-access-vq499 for pod openshift-network-diagnostics/network-check-target-5dq9z: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:51:12.609288 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.609239 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499 podName:03bd6b6a-ac55-46aa-ab2d-e420fbfe783c nodeName:}" failed. No retries permitted until 2026-06-02 01:51:44.609215866 +0000 UTC m=+66.525346886 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq499" (UniqueName: "kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499") pod "network-check-target-5dq9z" (UID: "03bd6b6a-ac55-46aa-ab2d-e420fbfe783c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:51:12.709802 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.709716 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.709973 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.709763 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmddt\" (UniqueName: \"kubernetes.io/projected/586260d8-1a00-4e53-97bb-7da92f4473ed-kube-api-access-mmddt\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.709973 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.709839 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/586260d8-1a00-4e53-97bb-7da92f4473ed-config-volume\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.709973 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.709864 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/586260d8-1a00-4e53-97bb-7da92f4473ed-tmp-dir\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.709973 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.709871 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:12.709973 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.709884 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8npc\" (UniqueName: \"kubernetes.io/projected/420f75c1-1c72-45e3-82af-19acef404dcf-kube-api-access-j8npc\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:12.709973 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.709919 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:12.709973 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.709940 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:51:13.209920033 +0000 UTC m=+35.126051059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:51:12.710305 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.710107 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:12.710305 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:12.710173 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:51:13.21015656 +0000 UTC m=+35.126287566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:51:12.710305 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.710297 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/586260d8-1a00-4e53-97bb-7da92f4473ed-tmp-dir\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.710487 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.710468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/586260d8-1a00-4e53-97bb-7da92f4473ed-config-volume\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.720531 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.720508 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmddt\" (UniqueName: \"kubernetes.io/projected/586260d8-1a00-4e53-97bb-7da92f4473ed-kube-api-access-mmddt\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:12.720654 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.720640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8npc\" (UniqueName: \"kubernetes.io/projected/420f75c1-1c72-45e3-82af-19acef404dcf-kube-api-access-j8npc\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:12.755483 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.755446 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:12.758294 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.758246 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:51:12.758835 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.758297 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkwhc\"" Jun 02 01:51:12.758835 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:12.758401 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:51:13.213792 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:13.213758 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:13.213983 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:13.213811 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:13.213983 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:13.213936 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:13.214064 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:13.214003 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:13.214064 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:13.214046 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:51:14.214030398 +0000 UTC m=+36.130161404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:51:13.214162 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:13.214072 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:51:14.214059457 +0000 UTC m=+36.130190469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:51:13.755335 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:13.755291 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:13.755520 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:13.755290 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:13.758544 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:13.758521 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:51:13.759683 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:13.759662 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:51:13.759785 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:13.759665 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsfrq\"" Jun 02 01:51:14.221055 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:14.221017 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:14.221220 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:14.221092 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:14.221220 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:14.221176 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:14.221286 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:14.221248 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:51:16.221233842 +0000 UTC m=+38.137364853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:51:14.221286 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:14.221178 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:14.221354 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:14.221318 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:51:16.221306115 +0000 UTC m=+38.137437121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:51:14.886105 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:14.885901 2559 generic.go:358] "Generic (PLEG): container finished" podID="d066af60-4fa2-44da-92b5-d1c3ecdf5f22" containerID="c7a1057f4194592fcfbb823dbe076716cb5c5b283275d0690cd487212ceabb5e" exitCode=0 Jun 02 01:51:14.886492 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:14.885977 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d22lb" event={"ID":"d066af60-4fa2-44da-92b5-d1c3ecdf5f22","Type":"ContainerDied","Data":"c7a1057f4194592fcfbb823dbe076716cb5c5b283275d0690cd487212ceabb5e"} Jun 02 01:51:15.890327 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:15.890294 2559 generic.go:358] "Generic (PLEG): container finished" podID="d066af60-4fa2-44da-92b5-d1c3ecdf5f22" containerID="3713f8828cd94ae3e4867ddc7a8a9e96ee64e6e24f91bf18c4a5aebf9a4c98d3" exitCode=0 Jun 02 01:51:15.890661 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:15.890355 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d22lb" event={"ID":"d066af60-4fa2-44da-92b5-d1c3ecdf5f22","Type":"ContainerDied","Data":"3713f8828cd94ae3e4867ddc7a8a9e96ee64e6e24f91bf18c4a5aebf9a4c98d3"} Jun 02 01:51:16.235399 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:16.235366 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:16.235569 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:16.235418 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:16.235569 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:16.235519 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:16.235569 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:16.235534 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:16.235667 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:16.235584 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:51:20.235568307 +0000 UTC m=+42.151699313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:51:16.235667 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:16.235612 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:51:20.235593023 +0000 UTC m=+42.151724030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:51:16.894837 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:16.894802 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d22lb" event={"ID":"d066af60-4fa2-44da-92b5-d1c3ecdf5f22","Type":"ContainerStarted","Data":"698d28c38bd64b310926ced434aede9c11077c5c04fffa8a4d51bb13b486ada5"} Jun 02 01:51:16.945476 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:16.945423 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d22lb" podStartSLOduration=4.951381297 podStartE2EDuration="37.945409932s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:50:41.518874998 +0000 UTC m=+3.435006007" lastFinishedPulling="2026-06-02 01:51:14.512903631 +0000 UTC m=+36.429034642" observedRunningTime="2026-06-02 01:51:16.944789501 +0000 UTC m=+38.860920531" watchObservedRunningTime="2026-06-02 01:51:16.945409932 +0000 UTC m=+38.861540959" Jun 02 01:51:20.263935 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:20.263891 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:20.263935 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:20.263946 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:20.264423 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:20.264033 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:20.264423 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:20.264094 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:51:28.264080949 +0000 UTC m=+50.180211975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:51:20.264423 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:20.264039 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:20.264423 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:20.264205 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:51:28.264186568 +0000 UTC m=+50.180317580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:51:28.319581 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:28.319534 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:28.319992 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:28.319637 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:28.319992 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:28.319699 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:28.319992 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:28.319735 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:28.319992 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:28.319767 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:51:44.319748998 +0000 UTC m=+66.235880027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:51:28.319992 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:28.319784 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:51:44.31977649 +0000 UTC m=+66.235907496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:51:37.877262 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:37.877234 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rfpnc" Jun 02 01:51:44.333198 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.333158 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:51:44.333581 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.333238 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:51:44.333581 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:44.333315 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:51:44.333581 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:44.333315 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:51:44.333581 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:44.333366 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:52:16.333352484 +0000 UTC m=+98.249483490 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:51:44.333581 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:44.333379 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:52:16.333373855 +0000 UTC m=+98.249504861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:51:44.534565 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.534530 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:51:44.534565 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.534569 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:44.537319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.537299 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:51:44.537319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.537311 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:51:44.545629 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:44.545609 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:51:44.545695 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:51:44.545685 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:52:48.54566516 +0000 UTC m=+130.461796167 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : secret "metrics-daemon-secret" not found Jun 02 01:51:44.548666 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.548642 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6e723871-88b6-4db1-b057-e7429c6c906d-original-pull-secret\") pod \"global-pull-secret-syncer-7nfcg\" (UID: \"6e723871-88b6-4db1-b057-e7429c6c906d\") " pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:44.635887 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.635805 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:44.638672 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.638655 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:51:44.648813 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.648796 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:51:44.659062 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.659035 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq499\" (UniqueName: \"kubernetes.io/projected/03bd6b6a-ac55-46aa-ab2d-e420fbfe783c-kube-api-access-vq499\") pod \"network-check-target-5dq9z\" (UID: \"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c\") " pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:44.666834 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.666814 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7nfcg" Jun 02 01:51:44.814823 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.814796 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7nfcg"] Jun 02 01:51:44.818353 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:51:44.818330 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e723871_88b6_4db1_b057_e7429c6c906d.slice/crio-5dd7ef0d08e31b45b29eca128fbf8e9425b2fbe5861474dd12f898dc2d762981 WatchSource:0}: Error finding container 5dd7ef0d08e31b45b29eca128fbf8e9425b2fbe5861474dd12f898dc2d762981: Status 404 returned error can't find the container with id 5dd7ef0d08e31b45b29eca128fbf8e9425b2fbe5861474dd12f898dc2d762981 Jun 02 01:51:44.869947 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.869927 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkwhc\"" Jun 02 01:51:44.878189 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.878172 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:44.945998 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.945965 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7nfcg" event={"ID":"6e723871-88b6-4db1-b057-e7429c6c906d","Type":"ContainerStarted","Data":"5dd7ef0d08e31b45b29eca128fbf8e9425b2fbe5861474dd12f898dc2d762981"} Jun 02 01:51:44.993503 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:44.993470 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5dq9z"] Jun 02 01:51:44.997180 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:51:44.997150 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03bd6b6a_ac55_46aa_ab2d_e420fbfe783c.slice/crio-94148f39fbb2cc460e592cff16183f9d781a7a2606c6273dbb5e909249af259d WatchSource:0}: Error finding container 94148f39fbb2cc460e592cff16183f9d781a7a2606c6273dbb5e909249af259d: Status 404 returned error can't find the container with id 94148f39fbb2cc460e592cff16183f9d781a7a2606c6273dbb5e909249af259d Jun 02 01:51:45.949559 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:45.949520 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5dq9z" event={"ID":"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c","Type":"ContainerStarted","Data":"94148f39fbb2cc460e592cff16183f9d781a7a2606c6273dbb5e909249af259d"} Jun 02 01:51:49.961927 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:49.961881 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7nfcg" event={"ID":"6e723871-88b6-4db1-b057-e7429c6c906d","Type":"ContainerStarted","Data":"8a98a9ba9786fb917eda57290b6a5c9eb4867636d87fbd055c3e5889a24ceca3"} Jun 02 01:51:49.963171 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:49.963151 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5dq9z" event={"ID":"03bd6b6a-ac55-46aa-ab2d-e420fbfe783c","Type":"ContainerStarted","Data":"588e22080959ccd674cf88271e515c9217bad0072fe77c8d381481116be57dc4"} Jun 02 01:51:49.963298 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:49.963288 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:51:49.979413 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:49.979360 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7nfcg" podStartSLOduration=66.669258532 podStartE2EDuration="1m10.9793474s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:51:44.819899876 +0000 UTC m=+66.736030883" lastFinishedPulling="2026-06-02 01:51:49.129988743 +0000 UTC m=+71.046119751" observedRunningTime="2026-06-02 01:51:49.97858691 +0000 UTC m=+71.894717931" watchObservedRunningTime="2026-06-02 01:51:49.9793474 +0000 UTC m=+71.895478428" Jun 02 01:51:49.992460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:51:49.992414 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5dq9z" podStartSLOduration=66.863948701 podStartE2EDuration="1m10.992400727s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:51:44.998969472 +0000 UTC m=+66.915100478" lastFinishedPulling="2026-06-02 01:51:49.127421491 +0000 UTC m=+71.043552504" observedRunningTime="2026-06-02 01:51:49.991934681 +0000 UTC m=+71.908065708" watchObservedRunningTime="2026-06-02 01:51:49.992400727 +0000 UTC m=+71.908531754" Jun 02 01:52:16.355097 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:52:16.355040 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:52:16.355583 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:52:16.355133 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:52:16.355583 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:52:16.355203 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:52:16.355583 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:52:16.355443 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:52:16.357713 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:52:16.356167 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:53:20.356131035 +0000 UTC m=+162.272262041 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:52:16.357713 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:52:16.356252 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:53:20.356231122 +0000 UTC m=+162.272362148 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:52:20.967239 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:52:20.967209 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5dq9z" Jun 02 01:52:48.573644 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:52:48.573604 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:52:48.574098 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:52:48.573728 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:52:48.574098 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:52:48.573800 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs podName:7390b1f2-1a3d-48af-a481-196e75ec47d9 nodeName:}" failed. No retries permitted until 2026-06-02 01:54:50.573778696 +0000 UTC m=+252.489909715 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs") pod "network-metrics-daemon-jkp2b" (UID: "7390b1f2-1a3d-48af-a481-196e75ec47d9") : secret "metrics-daemon-secret" not found Jun 02 01:53:11.378609 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.378579 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc"] Jun 02 01:53:11.380148 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.380123 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc" Jun 02 01:53:11.383222 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.383193 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cvtx6\"" Jun 02 01:53:11.383387 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.383364 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 01:53:11.383571 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.383235 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b6bdcd6bc-h4mhx"] Jun 02 01:53:11.384098 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.384073 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:53:11.386824 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.386805 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.389268 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.389248 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:53:11.389356 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.389319 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 01:53:11.389427 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.389411 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:53:11.389544 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.389523 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 01:53:11.389941 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.389696 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 01:53:11.389941 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.389887 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wsfxw\"" Jun 02 01:53:11.390029 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.389998 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 01:53:11.392454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.392436 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc"] Jun 02 01:53:11.398184 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.398163 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b6bdcd6bc-h4mhx"] Jun 02 01:53:11.481152 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.481105 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv"] Jun 02 01:53:11.482917 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.482892 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv" Jun 02 01:53:11.483859 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.483843 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh"] Jun 02 01:53:11.485250 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.485233 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94"] Jun 02 01:53:11.485389 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.485370 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.486040 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.486025 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l7wth\"" Jun 02 01:53:11.486791 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.486776 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9qdzw"] Jun 02 01:53:11.486916 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.486902 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.488313 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.488295 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.488866 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.488850 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 01:53:11.489473 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.489412 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 01:53:11.489573 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.489521 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:53:11.490523 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.490506 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 01:53:11.490719 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.490704 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:53:11.490793 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.490734 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:53:11.490793 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.490749 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 01:53:11.490793 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.490779 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-67pqb\"" Jun 02 01:53:11.490941 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.490801 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 01:53:11.491114 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.491100 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 01:53:11.491276 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.491261 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:53:11.491365 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.491267 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wwr54\"" Jun 02 01:53:11.491776 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.491761 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 01:53:11.491891 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.491810 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 01:53:11.492102 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.492088 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dm7tg\"" Jun 02 01:53:11.497043 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.497025 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 01:53:11.502488 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.502468 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh"] Jun 02 01:53:11.503622 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.503605 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94"] Jun 02 01:53:11.504604 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.504587 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv"] Jun 02 01:53:11.505289 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.505271 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9qdzw"] Jun 02 01:53:11.532252 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.532229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk8zx\" (UniqueName: \"kubernetes.io/projected/3c532827-81af-4e0f-b793-c7f9662ed2db-kube-api-access-wk8zx\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.532372 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.532266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.532437 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.532368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-default-certificate\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.532437 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.532405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-stats-auth\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.532510 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.532480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc79h\" (UniqueName: \"kubernetes.io/projected/fd07b245-a919-413e-9e0b-f98a1c92f85a-kube-api-access-cc79h\") pod \"volume-data-source-validator-7598fd5bd-c7hnc\" (UID: \"fd07b245-a919-413e-9e0b-f98a1c92f85a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc" Jun 02 01:53:11.532559 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.532541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.633336 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633268 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-default-certificate\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.633336 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633302 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-stats-auth\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.633336 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ef8e458-ef29-443c-8356-413b4256e95d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.633509 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mbl\" (UniqueName: \"kubernetes.io/projected/a52ef298-36bb-4174-a13a-dcead25e5f76-kube-api-access-w6mbl\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.633509 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633435 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d4f73d5-17fc-444f-9beb-bb7474e3321d-trusted-ca\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.633509 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633458 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cc79h\" (UniqueName: \"kubernetes.io/projected/fd07b245-a919-413e-9e0b-f98a1c92f85a-kube-api-access-cc79h\") pod \"volume-data-source-validator-7598fd5bd-c7hnc\" (UID: \"fd07b245-a919-413e-9e0b-f98a1c92f85a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc" Jun 02 01:53:11.633509 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsxks\" (UniqueName: \"kubernetes.io/projected/35229097-97b4-44c1-a975-dba62528f00c-kube-api-access-xsxks\") pod \"network-check-source-56d84b9f44-7kjcv\" (UID: \"35229097-97b4-44c1-a975-dba62528f00c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv" Jun 02 01:53:11.633660 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633519 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d4f73d5-17fc-444f-9beb-bb7474e3321d-serving-cert\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.633660 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633550 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.633660 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633579 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rbf6\" (UniqueName: \"kubernetes.io/projected/6d4f73d5-17fc-444f-9beb-bb7474e3321d-kube-api-access-6rbf6\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.633790 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a52ef298-36bb-4174-a13a-dcead25e5f76-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.633790 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:11.633704 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:12.133682158 +0000 UTC m=+154.049813198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : configmap references non-existent config key: service-ca.crt Jun 02 01:53:11.633790 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d4f73d5-17fc-444f-9beb-bb7474e3321d-config\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.633922 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.633922 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krc78\" (UniqueName: \"kubernetes.io/projected/3ef8e458-ef29-443c-8356-413b4256e95d-kube-api-access-krc78\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.633922 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633868 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wk8zx\" (UniqueName: \"kubernetes.io/projected/3c532827-81af-4e0f-b793-c7f9662ed2db-kube-api-access-wk8zx\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.633922 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633885 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.634090 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.633939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a52ef298-36bb-4174-a13a-dcead25e5f76-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.634090 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:11.633968 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:53:11.634090 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:11.634012 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:12.133996728 +0000 UTC m=+154.050127734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : secret "router-metrics-certs-default" not found Jun 02 01:53:11.635806 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.635788 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-stats-auth\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.635889 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.635809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-default-certificate\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.650788 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.650770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk8zx\" (UniqueName: \"kubernetes.io/projected/3c532827-81af-4e0f-b793-c7f9662ed2db-kube-api-access-wk8zx\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:11.651151 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.651120 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc79h\" (UniqueName: \"kubernetes.io/projected/fd07b245-a919-413e-9e0b-f98a1c92f85a-kube-api-access-cc79h\") pod \"volume-data-source-validator-7598fd5bd-c7hnc\" (UID: \"fd07b245-a919-413e-9e0b-f98a1c92f85a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc" Jun 02 01:53:11.692727 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.692703 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734394 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734433 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krc78\" (UniqueName: \"kubernetes.io/projected/3ef8e458-ef29-443c-8356-413b4256e95d-kube-api-access-krc78\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734487 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a52ef298-36bb-4174-a13a-dcead25e5f76-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734509 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ef8e458-ef29-443c-8356-413b4256e95d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734532 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mbl\" (UniqueName: \"kubernetes.io/projected/a52ef298-36bb-4174-a13a-dcead25e5f76-kube-api-access-w6mbl\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734553 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d4f73d5-17fc-444f-9beb-bb7474e3321d-trusted-ca\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734591 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsxks\" (UniqueName: \"kubernetes.io/projected/35229097-97b4-44c1-a975-dba62528f00c-kube-api-access-xsxks\") pod \"network-check-source-56d84b9f44-7kjcv\" (UID: \"35229097-97b4-44c1-a975-dba62528f00c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734617 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d4f73d5-17fc-444f-9beb-bb7474e3321d-serving-cert\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734662 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rbf6\" (UniqueName: \"kubernetes.io/projected/6d4f73d5-17fc-444f-9beb-bb7474e3321d-kube-api-access-6rbf6\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734696 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a52ef298-36bb-4174-a13a-dcead25e5f76-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.734910 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.734727 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d4f73d5-17fc-444f-9beb-bb7474e3321d-config\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.735758 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.735340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a52ef298-36bb-4174-a13a-dcead25e5f76-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.735758 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.735516 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6d4f73d5-17fc-444f-9beb-bb7474e3321d-config\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.735758 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:11.735664 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:11.735758 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:11.735750 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls podName:3ef8e458-ef29-443c-8356-413b4256e95d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:12.235730383 +0000 UTC m=+154.151861403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dpv94" (UID: "3ef8e458-ef29-443c-8356-413b4256e95d") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:11.736300 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.736275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/3ef8e458-ef29-443c-8356-413b4256e95d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.737363 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.737336 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6d4f73d5-17fc-444f-9beb-bb7474e3321d-trusted-ca\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.738739 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.738711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a52ef298-36bb-4174-a13a-dcead25e5f76-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.738837 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.738778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6d4f73d5-17fc-444f-9beb-bb7474e3321d-serving-cert\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.745683 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.745638 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mbl\" (UniqueName: \"kubernetes.io/projected/a52ef298-36bb-4174-a13a-dcead25e5f76-kube-api-access-w6mbl\") pod \"kube-storage-version-migrator-operator-96ddc787c-5cfgh\" (UID: \"a52ef298-36bb-4174-a13a-dcead25e5f76\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.745767 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.745730 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krc78\" (UniqueName: \"kubernetes.io/projected/3ef8e458-ef29-443c-8356-413b4256e95d-kube-api-access-krc78\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:11.746001 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.745978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rbf6\" (UniqueName: \"kubernetes.io/projected/6d4f73d5-17fc-444f-9beb-bb7474e3321d-kube-api-access-6rbf6\") pod \"console-operator-86d7c6cc77-9qdzw\" (UID: \"6d4f73d5-17fc-444f-9beb-bb7474e3321d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.746364 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.746341 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsxks\" (UniqueName: \"kubernetes.io/projected/35229097-97b4-44c1-a975-dba62528f00c-kube-api-access-xsxks\") pod \"network-check-source-56d84b9f44-7kjcv\" (UID: \"35229097-97b4-44c1-a975-dba62528f00c\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv" Jun 02 01:53:11.792721 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.792698 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv" Jun 02 01:53:11.799383 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.799367 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" Jun 02 01:53:11.806995 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.806971 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc"] Jun 02 01:53:11.811543 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.811518 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:11.812401 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:11.812371 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd07b245_a919_413e_9e0b_f98a1c92f85a.slice/crio-65d55aa2826e0cc68faedf744f9948be360bbc509edfd941d9a36e81711c9a95 WatchSource:0}: Error finding container 65d55aa2826e0cc68faedf744f9948be360bbc509edfd941d9a36e81711c9a95: Status 404 returned error can't find the container with id 65d55aa2826e0cc68faedf744f9948be360bbc509edfd941d9a36e81711c9a95 Jun 02 01:53:11.920684 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.920655 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv"] Jun 02 01:53:11.923723 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:11.923692 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35229097_97b4_44c1_a975_dba62528f00c.slice/crio-cdfcdb8dbf7ac1c82390bf9a63dfec711a9bcba9db3ba95204da67332fff3e19 WatchSource:0}: Error finding container cdfcdb8dbf7ac1c82390bf9a63dfec711a9bcba9db3ba95204da67332fff3e19: Status 404 returned error can't find the container with id cdfcdb8dbf7ac1c82390bf9a63dfec711a9bcba9db3ba95204da67332fff3e19 Jun 02 01:53:11.936079 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.936052 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh"] Jun 02 01:53:11.938943 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:11.938922 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda52ef298_36bb_4174_a13a_dcead25e5f76.slice/crio-47bf2ca8c0f06d01966348b31efd492c2a6b0b1a5c35a18585d4bf96bb653e5f WatchSource:0}: Error finding container 47bf2ca8c0f06d01966348b31efd492c2a6b0b1a5c35a18585d4bf96bb653e5f: Status 404 returned error can't find the container with id 47bf2ca8c0f06d01966348b31efd492c2a6b0b1a5c35a18585d4bf96bb653e5f Jun 02 01:53:11.952390 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:11.952368 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-9qdzw"] Jun 02 01:53:11.956274 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:11.956252 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4f73d5_17fc_444f_9beb_bb7474e3321d.slice/crio-4511c47a2e4481af9d07e9c93079fcaa7203b2bf15e55d0bfe3dd3d8e3f47bd4 WatchSource:0}: Error finding container 4511c47a2e4481af9d07e9c93079fcaa7203b2bf15e55d0bfe3dd3d8e3f47bd4: Status 404 returned error can't find the container with id 4511c47a2e4481af9d07e9c93079fcaa7203b2bf15e55d0bfe3dd3d8e3f47bd4 Jun 02 01:53:12.115641 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.115599 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc" event={"ID":"fd07b245-a919-413e-9e0b-f98a1c92f85a","Type":"ContainerStarted","Data":"65d55aa2826e0cc68faedf744f9948be360bbc509edfd941d9a36e81711c9a95"} Jun 02 01:53:12.116750 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.116725 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv" event={"ID":"35229097-97b4-44c1-a975-dba62528f00c","Type":"ContainerStarted","Data":"b3bfc9004cbae644d96bdb08adabe86828d83289467cca793be5b7fe63c9d8aa"} Jun 02 01:53:12.116876 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.116756 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv" event={"ID":"35229097-97b4-44c1-a975-dba62528f00c","Type":"ContainerStarted","Data":"cdfcdb8dbf7ac1c82390bf9a63dfec711a9bcba9db3ba95204da67332fff3e19"} Jun 02 01:53:12.117581 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.117557 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" event={"ID":"6d4f73d5-17fc-444f-9beb-bb7474e3321d","Type":"ContainerStarted","Data":"4511c47a2e4481af9d07e9c93079fcaa7203b2bf15e55d0bfe3dd3d8e3f47bd4"} Jun 02 01:53:12.118358 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.118340 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" event={"ID":"a52ef298-36bb-4174-a13a-dcead25e5f76","Type":"ContainerStarted","Data":"47bf2ca8c0f06d01966348b31efd492c2a6b0b1a5c35a18585d4bf96bb653e5f"} Jun 02 01:53:12.132464 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.132428 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7kjcv" podStartSLOduration=1.13241609 podStartE2EDuration="1.13241609s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:53:12.131403804 +0000 UTC m=+154.047534831" watchObservedRunningTime="2026-06-02 01:53:12.13241609 +0000 UTC m=+154.048547132" Jun 02 01:53:12.137902 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.137858 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:12.137902 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.137898 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:12.138010 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:12.137999 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:13.137984985 +0000 UTC m=+155.054115997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : configmap references non-existent config key: service-ca.crt Jun 02 01:53:12.138058 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:12.138013 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:53:12.138058 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:12.138046 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:13.138036477 +0000 UTC m=+155.054167486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : secret "router-metrics-certs-default" not found Jun 02 01:53:12.238420 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:12.238386 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:12.238579 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:12.238499 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:12.238579 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:12.238550 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls podName:3ef8e458-ef29-443c-8356-413b4256e95d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:13.238535569 +0000 UTC m=+155.154666576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dpv94" (UID: "3ef8e458-ef29-443c-8356-413b4256e95d") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:13.145299 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:13.145196 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:13.145707 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:13.145323 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:13.145707 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:13.145349 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:53:13.145707 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:13.145414 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:15.145396135 +0000 UTC m=+157.061527158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : secret "router-metrics-certs-default" not found Jun 02 01:53:13.145707 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:13.145432 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:15.145422487 +0000 UTC m=+157.061553493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : configmap references non-existent config key: service-ca.crt Jun 02 01:53:13.246793 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:13.246675 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:13.246967 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:13.246825 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:13.246967 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:13.246895 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls podName:3ef8e458-ef29-443c-8356-413b4256e95d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:15.246873482 +0000 UTC m=+157.163004506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dpv94" (UID: "3ef8e458-ef29-443c-8356-413b4256e95d") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:14.124368 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:14.124328 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc" event={"ID":"fd07b245-a919-413e-9e0b-f98a1c92f85a","Type":"ContainerStarted","Data":"2efadd2a0634f463489bee81d63e88513bdb02ba40c94b695689de5e8d94b9fe"} Jun 02 01:53:14.140951 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:14.140899 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-c7hnc" podStartSLOduration=1.5050590769999999 podStartE2EDuration="3.140885257s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="2026-06-02 01:53:11.815057732 +0000 UTC m=+153.731188752" lastFinishedPulling="2026-06-02 01:53:13.450883911 +0000 UTC m=+155.367014932" observedRunningTime="2026-06-02 01:53:14.139156914 +0000 UTC m=+156.055287939" watchObservedRunningTime="2026-06-02 01:53:14.140885257 +0000 UTC m=+156.057016288" Jun 02 01:53:15.128187 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.128156 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/0.log" Jun 02 01:53:15.128614 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.128200 2559 generic.go:358] "Generic (PLEG): container finished" podID="6d4f73d5-17fc-444f-9beb-bb7474e3321d" containerID="611678a3261ccc696a775d1c96c557dfd97f04e59e0c065c9f650dd52209d548" exitCode=255 Jun 02 01:53:15.128614 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.128232 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" event={"ID":"6d4f73d5-17fc-444f-9beb-bb7474e3321d","Type":"ContainerDied","Data":"611678a3261ccc696a775d1c96c557dfd97f04e59e0c065c9f650dd52209d548"} Jun 02 01:53:15.128614 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.128511 2559 scope.go:117] "RemoveContainer" containerID="611678a3261ccc696a775d1c96c557dfd97f04e59e0c065c9f650dd52209d548" Jun 02 01:53:15.129620 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.129601 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" event={"ID":"a52ef298-36bb-4174-a13a-dcead25e5f76","Type":"ContainerStarted","Data":"670d6c99cc86c98c9af003135e64ef58c2ac9cf98d7d8817d628fd63dcd311b1"} Jun 02 01:53:15.160343 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.160319 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:15.160440 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.160367 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:15.160500 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:15.160480 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.160460172 +0000 UTC m=+161.076591202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : configmap references non-existent config key: service-ca.crt Jun 02 01:53:15.160500 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:15.160486 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:53:15.160581 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:15.160525 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.160514422 +0000 UTC m=+161.076645448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : secret "router-metrics-certs-default" not found Jun 02 01:53:15.161394 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.161357 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" podStartSLOduration=1.408875994 podStartE2EDuration="4.16134617s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="2026-06-02 01:53:11.941707193 +0000 UTC m=+153.857838200" lastFinishedPulling="2026-06-02 01:53:14.69417736 +0000 UTC m=+156.610308376" observedRunningTime="2026-06-02 01:53:15.161011877 +0000 UTC m=+157.077142904" watchObservedRunningTime="2026-06-02 01:53:15.16134617 +0000 UTC m=+157.077477221" Jun 02 01:53:15.262244 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:15.261937 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:15.262244 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:15.262061 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:15.262244 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:15.262120 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls podName:3ef8e458-ef29-443c-8356-413b4256e95d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:19.262101888 +0000 UTC m=+161.178232910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dpv94" (UID: "3ef8e458-ef29-443c-8356-413b4256e95d") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:15.510994 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:15.510938 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-75gv6" podUID="586260d8-1a00-4e53-97bb-7da92f4473ed" Jun 02 01:53:15.517044 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:15.517015 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2ls86" podUID="420f75c1-1c72-45e3-82af-19acef404dcf" Jun 02 01:53:16.133878 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:16.133806 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 01:53:16.134253 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:16.134222 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/0.log" Jun 02 01:53:16.134289 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:16.134252 2559 generic.go:358] "Generic (PLEG): container finished" podID="6d4f73d5-17fc-444f-9beb-bb7474e3321d" containerID="11d3af6c482849191c059e85f18139d7cf7c4056d81c207749198d416b6e32c8" exitCode=255 Jun 02 01:53:16.134321 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:16.134283 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" event={"ID":"6d4f73d5-17fc-444f-9beb-bb7474e3321d","Type":"ContainerDied","Data":"11d3af6c482849191c059e85f18139d7cf7c4056d81c207749198d416b6e32c8"} Jun 02 01:53:16.134373 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:16.134326 2559 scope.go:117] "RemoveContainer" containerID="611678a3261ccc696a775d1c96c557dfd97f04e59e0c065c9f650dd52209d548" Jun 02 01:53:16.134415 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:16.134394 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:53:16.134567 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:16.134550 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75gv6" Jun 02 01:53:16.134567 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:16.134561 2559 scope.go:117] "RemoveContainer" containerID="11d3af6c482849191c059e85f18139d7cf7c4056d81c207749198d416b6e32c8" Jun 02 01:53:16.134753 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:16.134732 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qdzw_openshift-console-operator(6d4f73d5-17fc-444f-9beb-bb7474e3321d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" podUID="6d4f73d5-17fc-444f-9beb-bb7474e3321d" Jun 02 01:53:16.772934 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:16.772898 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jkp2b" podUID="7390b1f2-1a3d-48af-a481-196e75ec47d9" Jun 02 01:53:17.138275 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.138203 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 01:53:17.138616 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.138520 2559 scope.go:117] "RemoveContainer" containerID="11d3af6c482849191c059e85f18139d7cf7c4056d81c207749198d416b6e32c8" Jun 02 01:53:17.138687 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:17.138671 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qdzw_openshift-console-operator(6d4f73d5-17fc-444f-9beb-bb7474e3321d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" podUID="6d4f73d5-17fc-444f-9beb-bb7474e3321d" Jun 02 01:53:17.820040 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.820005 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hhklt"] Jun 02 01:53:17.822380 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.822364 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:17.824750 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.824725 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 01:53:17.824887 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.824871 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 01:53:17.824930 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.824870 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 01:53:17.825999 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.825984 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 01:53:17.826057 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.826035 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8tjpd\"" Jun 02 01:53:17.831489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.831468 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hhklt"] Jun 02 01:53:17.895439 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.895413 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9rrkx_937fac9e-c35b-4b3e-9f62-934a5fbb01bf/dns-node-resolver/0.log" Jun 02 01:53:17.982993 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.982964 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/16c44349-0fdf-44f8-9f0f-e16b36cd803a-signing-cabundle\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:17.983104 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.983042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/16c44349-0fdf-44f8-9f0f-e16b36cd803a-signing-key\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:17.983104 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:17.983069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67j45\" (UniqueName: \"kubernetes.io/projected/16c44349-0fdf-44f8-9f0f-e16b36cd803a-kube-api-access-67j45\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:18.083488 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:18.083399 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/16c44349-0fdf-44f8-9f0f-e16b36cd803a-signing-cabundle\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:18.083566 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:18.083498 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/16c44349-0fdf-44f8-9f0f-e16b36cd803a-signing-key\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:18.083566 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:18.083519 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67j45\" (UniqueName: \"kubernetes.io/projected/16c44349-0fdf-44f8-9f0f-e16b36cd803a-kube-api-access-67j45\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:18.084182 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:18.084163 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/16c44349-0fdf-44f8-9f0f-e16b36cd803a-signing-cabundle\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:18.085915 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:18.085891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/16c44349-0fdf-44f8-9f0f-e16b36cd803a-signing-key\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:18.092958 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:18.092940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67j45\" (UniqueName: \"kubernetes.io/projected/16c44349-0fdf-44f8-9f0f-e16b36cd803a-kube-api-access-67j45\") pod \"service-ca-685df94d57-hhklt\" (UID: \"16c44349-0fdf-44f8-9f0f-e16b36cd803a\") " pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:18.130556 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:18.130539 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-hhklt" Jun 02 01:53:18.245122 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:18.245088 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-hhklt"] Jun 02 01:53:18.247977 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:18.247948 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c44349_0fdf_44f8_9f0f_e16b36cd803a.slice/crio-f8bbd4a485d7e99d2b900e2adb279523fe87ee1db2323b8ed055671b5ae910e3 WatchSource:0}: Error finding container f8bbd4a485d7e99d2b900e2adb279523fe87ee1db2323b8ed055671b5ae910e3: Status 404 returned error can't find the container with id f8bbd4a485d7e99d2b900e2adb279523fe87ee1db2323b8ed055671b5ae910e3 Jun 02 01:53:19.145960 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:19.145928 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-hhklt" event={"ID":"16c44349-0fdf-44f8-9f0f-e16b36cd803a","Type":"ContainerStarted","Data":"f8bbd4a485d7e99d2b900e2adb279523fe87ee1db2323b8ed055671b5ae910e3"} Jun 02 01:53:19.190932 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:19.190910 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:19.191022 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:19.191006 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:19.191071 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:19.191057 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:53:19.191129 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:19.191120 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:27.191102921 +0000 UTC m=+169.107233929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : secret "router-metrics-certs-default" not found Jun 02 01:53:19.191184 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:19.191148 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:27.191130705 +0000 UTC m=+169.107261711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : configmap references non-existent config key: service-ca.crt Jun 02 01:53:19.292410 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:19.292372 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:19.292776 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:19.292508 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:19.292776 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:19.292570 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls podName:3ef8e458-ef29-443c-8356-413b4256e95d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:27.292554929 +0000 UTC m=+169.208685935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dpv94" (UID: "3ef8e458-ef29-443c-8356-413b4256e95d") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:19.295919 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:19.295902 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x82gn_c98e7568-2413-4bc9-8364-340bd4df48d0/node-ca/0.log" Jun 02 01:53:20.150178 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:20.150125 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-hhklt" event={"ID":"16c44349-0fdf-44f8-9f0f-e16b36cd803a","Type":"ContainerStarted","Data":"7ca1e93414d08c0e232aad78bd3b8dbec8a1c38206398fec0f50a1226feb1f59"} Jun 02 01:53:20.165482 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:20.165442 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-hhklt" podStartSLOduration=1.416090576 podStartE2EDuration="3.165430713s" podCreationTimestamp="2026-06-02 01:53:17 +0000 UTC" firstStartedPulling="2026-06-02 01:53:18.249714432 +0000 UTC m=+160.165845443" lastFinishedPulling="2026-06-02 01:53:19.999054569 +0000 UTC m=+161.915185580" observedRunningTime="2026-06-02 01:53:20.16472389 +0000 UTC m=+162.080854917" watchObservedRunningTime="2026-06-02 01:53:20.165430713 +0000 UTC m=+162.081561740" Jun 02 01:53:20.400358 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:20.400276 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:53:20.400696 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:20.400411 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:53:20.400696 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:20.400420 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:53:20.400696 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:20.400478 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert podName:420f75c1-1c72-45e3-82af-19acef404dcf nodeName:}" failed. No retries permitted until 2026-06-02 01:55:22.400460583 +0000 UTC m=+284.316591608 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert") pod "ingress-canary-2ls86" (UID: "420f75c1-1c72-45e3-82af-19acef404dcf") : secret "canary-serving-cert" not found Jun 02 01:53:20.400696 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:20.400498 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:53:20.400696 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:20.400529 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls podName:586260d8-1a00-4e53-97bb-7da92f4473ed nodeName:}" failed. No retries permitted until 2026-06-02 01:55:22.400520341 +0000 UTC m=+284.316651348 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls") pod "dns-default-75gv6" (UID: "586260d8-1a00-4e53-97bb-7da92f4473ed") : secret "dns-default-metrics-tls" not found Jun 02 01:53:21.811663 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:21.811622 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:21.811663 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:21.811659 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:21.812044 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:21.811974 2559 scope.go:117] "RemoveContainer" containerID="11d3af6c482849191c059e85f18139d7cf7c4056d81c207749198d416b6e32c8" Jun 02 01:53:21.812155 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:21.812119 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-9qdzw_openshift-console-operator(6d4f73d5-17fc-444f-9beb-bb7474e3321d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" podUID="6d4f73d5-17fc-444f-9beb-bb7474e3321d" Jun 02 01:53:27.255332 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:27.255296 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:27.255790 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:27.255401 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:27.255790 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:27.255584 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle podName:3c532827-81af-4e0f-b793-c7f9662ed2db nodeName:}" failed. No retries permitted until 2026-06-02 01:53:43.255564407 +0000 UTC m=+185.171695426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle") pod "router-default-5b6bdcd6bc-h4mhx" (UID: "3c532827-81af-4e0f-b793-c7f9662ed2db") : configmap references non-existent config key: service-ca.crt Jun 02 01:53:27.257641 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:27.257616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c532827-81af-4e0f-b793-c7f9662ed2db-metrics-certs\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:27.356381 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:27.356348 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:27.356540 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:27.356516 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:27.356635 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:27.356624 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls podName:3ef8e458-ef29-443c-8356-413b4256e95d nodeName:}" failed. No retries permitted until 2026-06-02 01:53:43.35660349 +0000 UTC m=+185.272734515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-dpv94" (UID: "3ef8e458-ef29-443c-8356-413b4256e95d") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:53:31.756063 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:31.756030 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:53:34.755927 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:34.755899 2559 scope.go:117] "RemoveContainer" containerID="11d3af6c482849191c059e85f18139d7cf7c4056d81c207749198d416b6e32c8" Jun 02 01:53:35.187235 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:35.187153 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 01:53:35.187235 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:35.187212 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" event={"ID":"6d4f73d5-17fc-444f-9beb-bb7474e3321d","Type":"ContainerStarted","Data":"1176e36d7d392656b2b19a44a054d0a8e5a474dfa730d3dcb5d046c2bd3b7eae"} Jun 02 01:53:35.187550 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:35.187528 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:35.204718 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:35.204680 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" podStartSLOduration=21.468326518 podStartE2EDuration="24.204669352s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="2026-06-02 01:53:11.958019817 +0000 UTC m=+153.874150823" lastFinishedPulling="2026-06-02 01:53:14.694362636 +0000 UTC m=+156.610493657" observedRunningTime="2026-06-02 01:53:35.20355246 +0000 UTC m=+177.119683489" watchObservedRunningTime="2026-06-02 01:53:35.204669352 +0000 UTC m=+177.120800379" Jun 02 01:53:35.271541 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:35.271516 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-9qdzw" Jun 02 01:53:40.364973 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.364933 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zgqkn"] Jun 02 01:53:40.367652 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.367628 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.370560 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.370539 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:53:40.370655 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.370580 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:53:40.371979 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.371958 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:53:40.372077 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.372005 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r9ggs\"" Jun 02 01:53:40.372077 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.372015 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:53:40.378750 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.378733 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zgqkn"] Jun 02 01:53:40.445088 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.445059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bn7g\" (UniqueName: \"kubernetes.io/projected/072516c5-a804-4601-9cf2-d816e433ac4e-kube-api-access-7bn7g\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.445244 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.445101 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/072516c5-a804-4601-9cf2-d816e433ac4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.445309 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.445245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/072516c5-a804-4601-9cf2-d816e433ac4e-crio-socket\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.445351 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.445309 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/072516c5-a804-4601-9cf2-d816e433ac4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.445351 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.445347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/072516c5-a804-4601-9cf2-d816e433ac4e-data-volume\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.545656 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.545621 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/072516c5-a804-4601-9cf2-d816e433ac4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.545824 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.545684 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/072516c5-a804-4601-9cf2-d816e433ac4e-data-volume\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.545824 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.545717 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bn7g\" (UniqueName: \"kubernetes.io/projected/072516c5-a804-4601-9cf2-d816e433ac4e-kube-api-access-7bn7g\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.545824 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.545748 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/072516c5-a804-4601-9cf2-d816e433ac4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.546075 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.546048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/072516c5-a804-4601-9cf2-d816e433ac4e-crio-socket\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.546233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.546170 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/072516c5-a804-4601-9cf2-d816e433ac4e-crio-socket\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.546295 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.546229 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/072516c5-a804-4601-9cf2-d816e433ac4e-data-volume\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.546328 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.546308 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/072516c5-a804-4601-9cf2-d816e433ac4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.548015 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.547995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/072516c5-a804-4601-9cf2-d816e433ac4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.560977 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.560946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bn7g\" (UniqueName: \"kubernetes.io/projected/072516c5-a804-4601-9cf2-d816e433ac4e-kube-api-access-7bn7g\") pod \"insights-runtime-extractor-zgqkn\" (UID: \"072516c5-a804-4601-9cf2-d816e433ac4e\") " pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.676293 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.676235 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zgqkn" Jun 02 01:53:40.793654 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:40.793624 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zgqkn"] Jun 02 01:53:40.796401 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:40.796379 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072516c5_a804_4601_9cf2_d816e433ac4e.slice/crio-d91504c20ad43ad62b8e9ba31761ae666ac393847a3ad5fb9f802df5c3b9b4fb WatchSource:0}: Error finding container d91504c20ad43ad62b8e9ba31761ae666ac393847a3ad5fb9f802df5c3b9b4fb: Status 404 returned error can't find the container with id d91504c20ad43ad62b8e9ba31761ae666ac393847a3ad5fb9f802df5c3b9b4fb Jun 02 01:53:41.201915 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:41.201876 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgqkn" event={"ID":"072516c5-a804-4601-9cf2-d816e433ac4e","Type":"ContainerStarted","Data":"3916d16ec1f70b864c783a7c793d291130ef3f00db6c1335fcbd1c5ac5a38cea"} Jun 02 01:53:41.201915 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:41.201912 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgqkn" event={"ID":"072516c5-a804-4601-9cf2-d816e433ac4e","Type":"ContainerStarted","Data":"d91504c20ad43ad62b8e9ba31761ae666ac393847a3ad5fb9f802df5c3b9b4fb"} Jun 02 01:53:42.206286 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:42.206244 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgqkn" event={"ID":"072516c5-a804-4601-9cf2-d816e433ac4e","Type":"ContainerStarted","Data":"a8a83454dc35c57b04729842db228476c7c2a8f0b16587fe3e1f4277f1a7723f"} Jun 02 01:53:43.268945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.268907 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:43.269600 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.269575 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c532827-81af-4e0f-b793-c7f9662ed2db-service-ca-bundle\") pod \"router-default-5b6bdcd6bc-h4mhx\" (UID: \"3c532827-81af-4e0f-b793-c7f9662ed2db\") " pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:43.370055 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.370030 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:43.371979 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.371960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ef8e458-ef29-443c-8356-413b4256e95d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-dpv94\" (UID: \"3ef8e458-ef29-443c-8356-413b4256e95d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:43.500862 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.500836 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wsfxw\"" Jun 02 01:53:43.508939 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.508913 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:43.608916 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.608892 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-67pqb\"" Jun 02 01:53:43.617071 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.617051 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" Jun 02 01:53:43.624756 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.624734 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b6bdcd6bc-h4mhx"] Jun 02 01:53:43.628072 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:43.628049 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c532827_81af_4e0f_b793_c7f9662ed2db.slice/crio-5411699dfae3c06128b43d7b5f2b0b8edb4c2760835723c6b80f4e9fe334eb10 WatchSource:0}: Error finding container 5411699dfae3c06128b43d7b5f2b0b8edb4c2760835723c6b80f4e9fe334eb10: Status 404 returned error can't find the container with id 5411699dfae3c06128b43d7b5f2b0b8edb4c2760835723c6b80f4e9fe334eb10 Jun 02 01:53:43.737406 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:43.736898 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94"] Jun 02 01:53:43.739929 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:43.739904 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef8e458_ef29_443c_8356_413b4256e95d.slice/crio-58bb9b91826eaaa26796aaa95ed6c41fd2d64eff68f4d9f219c7461a0524039b WatchSource:0}: Error finding container 58bb9b91826eaaa26796aaa95ed6c41fd2d64eff68f4d9f219c7461a0524039b: Status 404 returned error can't find the container with id 58bb9b91826eaaa26796aaa95ed6c41fd2d64eff68f4d9f219c7461a0524039b Jun 02 01:53:44.212615 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:44.212580 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zgqkn" event={"ID":"072516c5-a804-4601-9cf2-d816e433ac4e","Type":"ContainerStarted","Data":"ab0105dbb5ad8a8e3199ec0ecec357389299af96944fc6b36290c42cf824bb02"} Jun 02 01:53:44.213608 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:44.213584 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" event={"ID":"3ef8e458-ef29-443c-8356-413b4256e95d","Type":"ContainerStarted","Data":"58bb9b91826eaaa26796aaa95ed6c41fd2d64eff68f4d9f219c7461a0524039b"} Jun 02 01:53:44.214666 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:44.214643 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" event={"ID":"3c532827-81af-4e0f-b793-c7f9662ed2db","Type":"ContainerStarted","Data":"8cbab0a33b02112ac6ae4a893002aad8da1e6c4835f97f75423b65424a985d3c"} Jun 02 01:53:44.214741 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:44.214673 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" event={"ID":"3c532827-81af-4e0f-b793-c7f9662ed2db","Type":"ContainerStarted","Data":"5411699dfae3c06128b43d7b5f2b0b8edb4c2760835723c6b80f4e9fe334eb10"} Jun 02 01:53:44.229388 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:44.229349 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zgqkn" podStartSLOduration=1.770892881 podStartE2EDuration="4.229338069s" podCreationTimestamp="2026-06-02 01:53:40 +0000 UTC" firstStartedPulling="2026-06-02 01:53:40.845530896 +0000 UTC m=+182.761661902" lastFinishedPulling="2026-06-02 01:53:43.303976078 +0000 UTC m=+185.220107090" observedRunningTime="2026-06-02 01:53:44.228325986 +0000 UTC m=+186.144457013" watchObservedRunningTime="2026-06-02 01:53:44.229338069 +0000 UTC m=+186.145469096" Jun 02 01:53:44.245790 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:44.245749 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" podStartSLOduration=33.245736571 podStartE2EDuration="33.245736571s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:53:44.245712489 +0000 UTC m=+186.161843518" watchObservedRunningTime="2026-06-02 01:53:44.245736571 +0000 UTC m=+186.161867599" Jun 02 01:53:44.509820 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:44.509787 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:44.512182 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:44.512162 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:45.218282 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:45.218246 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:45.219496 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:45.219472 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b6bdcd6bc-h4mhx" Jun 02 01:53:45.939031 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:45.939000 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj"] Jun 02 01:53:45.941867 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:45.941852 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" Jun 02 01:53:45.946649 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:45.946621 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 01:53:45.946765 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:45.946738 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qrkp4\"" Jun 02 01:53:45.951746 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:45.951723 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj"] Jun 02 01:53:45.987324 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:45.987294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73576d50-6ef6-4dc7-9e27-b4ef4615362b-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9nctj\" (UID: \"73576d50-6ef6-4dc7-9e27-b4ef4615362b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" Jun 02 01:53:46.088658 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:46.088629 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73576d50-6ef6-4dc7-9e27-b4ef4615362b-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9nctj\" (UID: \"73576d50-6ef6-4dc7-9e27-b4ef4615362b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" Jun 02 01:53:46.088792 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:46.088753 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:53:46.088831 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:46.088810 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73576d50-6ef6-4dc7-9e27-b4ef4615362b-tls-certificates podName:73576d50-6ef6-4dc7-9e27-b4ef4615362b nodeName:}" failed. No retries permitted until 2026-06-02 01:53:46.588793079 +0000 UTC m=+188.504924086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/73576d50-6ef6-4dc7-9e27-b4ef4615362b-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-9nctj" (UID: "73576d50-6ef6-4dc7-9e27-b4ef4615362b") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:53:46.224945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:46.224907 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" event={"ID":"3ef8e458-ef29-443c-8356-413b4256e95d","Type":"ContainerStarted","Data":"fc0c65557a37022a90691691f54e31c99fccee89986fdac474e0ef2ee3a013e1"} Jun 02 01:53:46.247634 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:46.247589 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-dpv94" podStartSLOduration=33.584095239 podStartE2EDuration="35.247577361s" podCreationTimestamp="2026-06-02 01:53:11 +0000 UTC" firstStartedPulling="2026-06-02 01:53:43.741696299 +0000 UTC m=+185.657827305" lastFinishedPulling="2026-06-02 01:53:45.405178419 +0000 UTC m=+187.321309427" observedRunningTime="2026-06-02 01:53:46.246958117 +0000 UTC m=+188.163089145" watchObservedRunningTime="2026-06-02 01:53:46.247577361 +0000 UTC m=+188.163708388" Jun 02 01:53:46.592577 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:46.592475 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73576d50-6ef6-4dc7-9e27-b4ef4615362b-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9nctj\" (UID: \"73576d50-6ef6-4dc7-9e27-b4ef4615362b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" Jun 02 01:53:46.594796 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:46.594767 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/73576d50-6ef6-4dc7-9e27-b4ef4615362b-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9nctj\" (UID: \"73576d50-6ef6-4dc7-9e27-b4ef4615362b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" Jun 02 01:53:46.850315 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:46.850222 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" Jun 02 01:53:46.970678 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:46.970633 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj"] Jun 02 01:53:46.974207 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:46.974179 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73576d50_6ef6_4dc7_9e27_b4ef4615362b.slice/crio-e11787d9bd1b7a08652b5caa632a31247425a3088e1f43a4f774bc36331d4559 WatchSource:0}: Error finding container e11787d9bd1b7a08652b5caa632a31247425a3088e1f43a4f774bc36331d4559: Status 404 returned error can't find the container with id e11787d9bd1b7a08652b5caa632a31247425a3088e1f43a4f774bc36331d4559 Jun 02 01:53:47.228693 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:47.228656 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" event={"ID":"73576d50-6ef6-4dc7-9e27-b4ef4615362b","Type":"ContainerStarted","Data":"e11787d9bd1b7a08652b5caa632a31247425a3088e1f43a4f774bc36331d4559"} Jun 02 01:53:48.232868 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:48.232837 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" event={"ID":"73576d50-6ef6-4dc7-9e27-b4ef4615362b","Type":"ContainerStarted","Data":"9c8dad7087ce8f63a89b13548ee70c68121d4b9835854cb1b6a0d333234d465b"} Jun 02 01:53:48.233309 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:48.233046 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" Jun 02 01:53:48.237699 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:48.237676 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" Jun 02 01:53:48.248745 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:48.248711 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9nctj" podStartSLOduration=2.306111319 podStartE2EDuration="3.248699309s" podCreationTimestamp="2026-06-02 01:53:45 +0000 UTC" firstStartedPulling="2026-06-02 01:53:46.976344278 +0000 UTC m=+188.892475284" lastFinishedPulling="2026-06-02 01:53:47.918932264 +0000 UTC m=+189.835063274" observedRunningTime="2026-06-02 01:53:48.247710961 +0000 UTC m=+190.163842001" watchObservedRunningTime="2026-06-02 01:53:48.248699309 +0000 UTC m=+190.164830336" Jun 02 01:53:48.999634 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:48.999598 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4"] Jun 02 01:53:49.002905 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.002889 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.006588 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.006561 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 01:53:49.006588 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.006554 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 01:53:49.006762 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.006561 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:53:49.006762 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.006595 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kp9p5\"" Jun 02 01:53:49.011192 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.011172 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4"] Jun 02 01:53:49.113259 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.113217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.113388 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.113323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kft6f\" (UniqueName: \"kubernetes.io/projected/a4b024e1-1143-4181-858d-8f00d1d828ab-kube-api-access-kft6f\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.113388 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.113365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.113468 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.113420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4b024e1-1143-4181-858d-8f00d1d828ab-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.214196 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.214129 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4b024e1-1143-4181-858d-8f00d1d828ab-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.214196 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.214209 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.214405 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.214247 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kft6f\" (UniqueName: \"kubernetes.io/projected/a4b024e1-1143-4181-858d-8f00d1d828ab-kube-api-access-kft6f\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.214405 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.214289 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.214405 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:49.214371 2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 01:53:49.214531 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:49.214438 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-tls podName:a4b024e1-1143-4181-858d-8f00d1d828ab nodeName:}" failed. No retries permitted until 2026-06-02 01:53:49.714419213 +0000 UTC m=+191.630550220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-klmc4" (UID: "a4b024e1-1143-4181-858d-8f00d1d828ab") : secret "prometheus-operator-tls" not found Jun 02 01:53:49.214859 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.214829 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4b024e1-1143-4181-858d-8f00d1d828ab-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.216506 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.216485 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.224684 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.224663 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kft6f\" (UniqueName: \"kubernetes.io/projected/a4b024e1-1143-4181-858d-8f00d1d828ab-kube-api-access-kft6f\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.719377 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.719335 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.721557 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.721535 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a4b024e1-1143-4181-858d-8f00d1d828ab-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-klmc4\" (UID: \"a4b024e1-1143-4181-858d-8f00d1d828ab\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:49.911758 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:49.911725 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" Jun 02 01:53:50.033882 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:50.033852 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4"] Jun 02 01:53:50.037192 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:50.037167 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b024e1_1143_4181_858d_8f00d1d828ab.slice/crio-1b2929906a3de829798ad08cbab9cc2a21f9befc0e1e2e46e1d7eea269a5fa5d WatchSource:0}: Error finding container 1b2929906a3de829798ad08cbab9cc2a21f9befc0e1e2e46e1d7eea269a5fa5d: Status 404 returned error can't find the container with id 1b2929906a3de829798ad08cbab9cc2a21f9befc0e1e2e46e1d7eea269a5fa5d Jun 02 01:53:50.239679 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:50.239602 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" event={"ID":"a4b024e1-1143-4181-858d-8f00d1d828ab","Type":"ContainerStarted","Data":"1b2929906a3de829798ad08cbab9cc2a21f9befc0e1e2e46e1d7eea269a5fa5d"} Jun 02 01:53:51.244043 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:51.244006 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" event={"ID":"a4b024e1-1143-4181-858d-8f00d1d828ab","Type":"ContainerStarted","Data":"ac5842b47e7f88e9483f91230d4acada460083425726d1c7cf83f0a02791b5c7"} Jun 02 01:53:51.244043 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:51.244043 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" event={"ID":"a4b024e1-1143-4181-858d-8f00d1d828ab","Type":"ContainerStarted","Data":"88e11c9ca960a27adc604a9b0ad1f438019d39180b240916d3720a62d37b6deb"} Jun 02 01:53:51.262834 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:51.262793 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-klmc4" podStartSLOduration=2.226361653 podStartE2EDuration="3.262777947s" podCreationTimestamp="2026-06-02 01:53:48 +0000 UTC" firstStartedPulling="2026-06-02 01:53:50.038798511 +0000 UTC m=+191.954929518" lastFinishedPulling="2026-06-02 01:53:51.075214791 +0000 UTC m=+192.991345812" observedRunningTime="2026-06-02 01:53:51.261579931 +0000 UTC m=+193.177710959" watchObservedRunningTime="2026-06-02 01:53:51.262777947 +0000 UTC m=+193.178908978" Jun 02 01:53:53.482583 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.482546 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-7n9kj"] Jun 02 01:53:53.486131 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.486112 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.494836 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.494819 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pgth8\"" Jun 02 01:53:53.496122 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.496107 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 01:53:53.497575 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.497560 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 01:53:53.516384 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.516364 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-wt896"] Jun 02 01:53:53.519602 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.519580 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-7n9kj"] Jun 02 01:53:53.519714 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.519702 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.524712 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.524690 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mxl79"] Jun 02 01:53:53.524975 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.524955 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 01:53:53.524975 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.524967 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 01:53:53.525326 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.525308 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-f8cx5\"" Jun 02 01:53:53.525409 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.525337 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 01:53:53.528114 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.528096 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.537131 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.537116 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:53:53.539639 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.539622 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:53:53.539851 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.539830 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xd8pq\"" Jun 02 01:53:53.543717 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.543698 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:53:53.549092 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.549071 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-wt896"] Jun 02 01:53:53.550359 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550336 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.550442 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550370 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e7dd35-da04-451a-b5f5-05a6805b7292-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.550516 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550491 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/800652e7-98bb-45f6-b3ba-735e5c838587-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.550589 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550531 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6dgw\" (UniqueName: \"kubernetes.io/projected/800652e7-98bb-45f6-b3ba-735e5c838587-kube-api-access-m6dgw\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.550589 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550563 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.550749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550721 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.550812 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9zsn\" (UniqueName: \"kubernetes.io/projected/17e7dd35-da04-451a-b5f5-05a6805b7292-kube-api-access-h9zsn\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.550812 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550799 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.550919 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.550919 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.550850 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/800652e7-98bb-45f6-b3ba-735e5c838587-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.651897 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.651864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-textfile\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652066 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.651911 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.652066 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.651936 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e7dd35-da04-451a-b5f5-05a6805b7292-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.652066 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-sys\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652066 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:53.652023 2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 01:53:53.652066 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-root\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652360 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2znx\" (UniqueName: \"kubernetes.io/projected/4f4a3f81-7e66-4bbc-abde-71c17a651b33-kube-api-access-s2znx\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652360 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:53.652087 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-tls podName:17e7dd35-da04-451a-b5f5-05a6805b7292 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:54.152067271 +0000 UTC m=+196.068198295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-7n9kj" (UID: "17e7dd35-da04-451a-b5f5-05a6805b7292") : secret "openshift-state-metrics-tls" not found Jun 02 01:53:53.652360 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652132 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/800652e7-98bb-45f6-b3ba-735e5c838587-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.652360 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652182 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6dgw\" (UniqueName: \"kubernetes.io/projected/800652e7-98bb-45f6-b3ba-735e5c838587-kube-api-access-m6dgw\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.652360 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652213 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.652360 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652279 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.652360 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652312 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9zsn\" (UniqueName: \"kubernetes.io/projected/17e7dd35-da04-451a-b5f5-05a6805b7292-kube-api-access-h9zsn\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.652360 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652347 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.652749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652373 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.652749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652414 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-tls\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652513 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/800652e7-98bb-45f6-b3ba-735e5c838587-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.652749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f4a3f81-7e66-4bbc-abde-71c17a651b33-metrics-client-ca\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-wtmp\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.652749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e7dd35-da04-451a-b5f5-05a6805b7292-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.653070 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:53.652794 2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 02 01:53:53.653070 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:53.652854 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-tls podName:800652e7-98bb-45f6-b3ba-735e5c838587 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:54.15283818 +0000 UTC m=+196.068969192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-wt896" (UID: "800652e7-98bb-45f6-b3ba-735e5c838587") : secret "kube-state-metrics-tls" not found Jun 02 01:53:53.653070 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.653047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.653213 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.652583 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/800652e7-98bb-45f6-b3ba-735e5c838587-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.653460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.653436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/800652e7-98bb-45f6-b3ba-735e5c838587-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.654837 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.654814 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.655146 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.655114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.664162 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.664128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9zsn\" (UniqueName: \"kubernetes.io/projected/17e7dd35-da04-451a-b5f5-05a6805b7292-kube-api-access-h9zsn\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:53.664990 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.664960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6dgw\" (UniqueName: \"kubernetes.io/projected/800652e7-98bb-45f6-b3ba-735e5c838587-kube-api-access-m6dgw\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:53.753002 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.752933 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-tls\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753002 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.752965 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f4a3f81-7e66-4bbc-abde-71c17a651b33-metrics-client-ca\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753002 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.752985 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-wtmp\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753007 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-textfile\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753065 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-sys\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753084 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-root\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753105 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2znx\" (UniqueName: \"kubernetes.io/projected/4f4a3f81-7e66-4bbc-abde-71c17a651b33-kube-api-access-s2znx\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753169 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-sys\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753171 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-wtmp\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753205 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753175 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f4a3f81-7e66-4bbc-abde-71c17a651b33-root\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753231 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753229 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753618 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753577 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-textfile\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753820 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.753915 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.753805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f4a3f81-7e66-4bbc-abde-71c17a651b33-metrics-client-ca\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.755495 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.755475 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.755612 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.755593 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f4a3f81-7e66-4bbc-abde-71c17a651b33-node-exporter-tls\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.765120 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.765098 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2znx\" (UniqueName: \"kubernetes.io/projected/4f4a3f81-7e66-4bbc-abde-71c17a651b33-kube-api-access-s2znx\") pod \"node-exporter-mxl79\" (UID: \"4f4a3f81-7e66-4bbc-abde-71c17a651b33\") " pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.838279 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:53.838247 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxl79" Jun 02 01:53:53.846280 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:53.846240 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4a3f81_7e66_4bbc_abde_71c17a651b33.slice/crio-1443a6a6500ecb8c1330d1fe94c2330fa6cc08d9ad0454a830aaa29c8192a04e WatchSource:0}: Error finding container 1443a6a6500ecb8c1330d1fe94c2330fa6cc08d9ad0454a830aaa29c8192a04e: Status 404 returned error can't find the container with id 1443a6a6500ecb8c1330d1fe94c2330fa6cc08d9ad0454a830aaa29c8192a04e Jun 02 01:53:54.157558 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.157480 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:54.157558 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.157536 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:54.159730 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.159708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/800652e7-98bb-45f6-b3ba-735e5c838587-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-wt896\" (UID: \"800652e7-98bb-45f6-b3ba-735e5c838587\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:54.159836 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.159820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17e7dd35-da04-451a-b5f5-05a6805b7292-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-7n9kj\" (UID: \"17e7dd35-da04-451a-b5f5-05a6805b7292\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:54.253277 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.253243 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxl79" event={"ID":"4f4a3f81-7e66-4bbc-abde-71c17a651b33","Type":"ContainerStarted","Data":"1443a6a6500ecb8c1330d1fe94c2330fa6cc08d9ad0454a830aaa29c8192a04e"} Jun 02 01:53:54.395134 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.395096 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" Jun 02 01:53:54.431160 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.431086 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" Jun 02 01:53:54.647521 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.645910 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:53:54.650465 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.650384 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.653853 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.654060 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.654348 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.654555 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.654898 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gt9sz\"" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.655162 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.655352 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.655552 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 01:53:54.656233 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.655924 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 01:53:54.657047 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.656869 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 01:53:54.667116 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.667096 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:53:54.760586 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.760564 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-7n9kj"] Jun 02 01:53:54.761350 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:54.761318 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e7dd35_da04_451a_b5f5_05a6805b7292.slice/crio-7875097e54898bd3cd76334c2d0b785f1ffcc4fc06a800b02d91797fc52b7eae WatchSource:0}: Error finding container 7875097e54898bd3cd76334c2d0b785f1ffcc4fc06a800b02d91797fc52b7eae: Status 404 returned error can't find the container with id 7875097e54898bd3cd76334c2d0b785f1ffcc4fc06a800b02d91797fc52b7eae Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-web-config\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-config-out\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763788 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9tj\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-kube-api-access-jz9tj\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763899 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.763982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.764018 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.764319 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.764047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.778512 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.778492 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-wt896"] Jun 02 01:53:54.782430 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:54.782387 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800652e7_98bb_45f6_b3ba_735e5c838587.slice/crio-9678ce37bc23244c631bcd03cfebe811b68324373c175f8441394a7bd6f21b08 WatchSource:0}: Error finding container 9678ce37bc23244c631bcd03cfebe811b68324373c175f8441394a7bd6f21b08: Status 404 returned error can't find the container with id 9678ce37bc23244c631bcd03cfebe811b68324373c175f8441394a7bd6f21b08 Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865300 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-web-config\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865340 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-config-out\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865365 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9tj\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-kube-api-access-jz9tj\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865392 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865419 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865478 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865520 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865571 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865609 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865637 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865677 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865701 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.866542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.865752 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.867250 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.866841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.868957 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:54.867688 2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 01:53:54.868957 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:54.867751 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls podName:6dea8ad4-138b-4660-a91d-cc88022a9102 nodeName:}" failed. No retries permitted until 2026-06-02 01:53:55.367733667 +0000 UTC m=+197.283864688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102") : secret "alertmanager-main-tls" not found Jun 02 01:53:54.868957 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.868640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.869605 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.869578 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.874123 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.874074 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.874735 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.874571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-config-out\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.874735 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.874695 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-web-config\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.874735 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.874699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.875213 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.875172 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.875362 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.875340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.875681 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.875655 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-config-volume\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.877835 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.877815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:54.879697 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:54.879672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9tj\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-kube-api-access-jz9tj\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:55.258885 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.258852 2559 generic.go:358] "Generic (PLEG): container finished" podID="4f4a3f81-7e66-4bbc-abde-71c17a651b33" containerID="468dba9628b2ec68af15af23c7b58e10bedd30ce209d61e397dcb4498df73267" exitCode=0 Jun 02 01:53:55.259048 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.258934 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxl79" event={"ID":"4f4a3f81-7e66-4bbc-abde-71c17a651b33","Type":"ContainerDied","Data":"468dba9628b2ec68af15af23c7b58e10bedd30ce209d61e397dcb4498df73267"} Jun 02 01:53:55.260148 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.260106 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" event={"ID":"800652e7-98bb-45f6-b3ba-735e5c838587","Type":"ContainerStarted","Data":"9678ce37bc23244c631bcd03cfebe811b68324373c175f8441394a7bd6f21b08"} Jun 02 01:53:55.261824 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.261804 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" event={"ID":"17e7dd35-da04-451a-b5f5-05a6805b7292","Type":"ContainerStarted","Data":"6af9cb80aa56278dfbd1a90929b4fe0b0bbde1805e20a76a2f32e7803e4724c8"} Jun 02 01:53:55.261899 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.261829 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" event={"ID":"17e7dd35-da04-451a-b5f5-05a6805b7292","Type":"ContainerStarted","Data":"aac4285af8af4ab7daec8431e2d3f3088e01069e9eb84eb88b7456577507b970"} Jun 02 01:53:55.261899 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.261839 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" event={"ID":"17e7dd35-da04-451a-b5f5-05a6805b7292","Type":"ContainerStarted","Data":"7875097e54898bd3cd76334c2d0b785f1ffcc4fc06a800b02d91797fc52b7eae"} Jun 02 01:53:55.371077 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.370824 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:55.373692 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.373670 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:55.610372 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:55.610298 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:53:56.270882 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:56.270816 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxl79" event={"ID":"4f4a3f81-7e66-4bbc-abde-71c17a651b33","Type":"ContainerStarted","Data":"9b2643f0b1a417096c63a949b1376f714563947702e9c970c58aef8cdade6f64"} Jun 02 01:53:56.270882 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:56.270850 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxl79" event={"ID":"4f4a3f81-7e66-4bbc-abde-71c17a651b33","Type":"ContainerStarted","Data":"592eccb28559b1ea3335f310e2c77cf7020b29f262342aebde6917d1acd758fa"} Jun 02 01:53:56.275076 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:56.275033 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" event={"ID":"800652e7-98bb-45f6-b3ba-735e5c838587","Type":"ContainerStarted","Data":"1ec66d914b58d44f0accd619bde3f91f381f2d73ec371d5479b689ad41dee9bb"} Jun 02 01:53:56.277198 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:56.277090 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" event={"ID":"17e7dd35-da04-451a-b5f5-05a6805b7292","Type":"ContainerStarted","Data":"7045b305a28b964bb9428472700eac92661881a80555a3522cbd37b7c8287ed4"} Jun 02 01:53:56.297008 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:56.296968 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mxl79" podStartSLOduration=2.5084076360000003 podStartE2EDuration="3.296955891s" podCreationTimestamp="2026-06-02 01:53:53 +0000 UTC" firstStartedPulling="2026-06-02 01:53:53.848970567 +0000 UTC m=+195.765101586" lastFinishedPulling="2026-06-02 01:53:54.637518826 +0000 UTC m=+196.553649841" observedRunningTime="2026-06-02 01:53:56.296750617 +0000 UTC m=+198.212881645" watchObservedRunningTime="2026-06-02 01:53:56.296955891 +0000 UTC m=+198.213086917" Jun 02 01:53:56.317346 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:56.317325 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:53:56.317945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:56.317898 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-7n9kj" podStartSLOduration=2.098874854 podStartE2EDuration="3.317883009s" podCreationTimestamp="2026-06-02 01:53:53 +0000 UTC" firstStartedPulling="2026-06-02 01:53:54.950060622 +0000 UTC m=+196.866191628" lastFinishedPulling="2026-06-02 01:53:56.169068763 +0000 UTC m=+198.085199783" observedRunningTime="2026-06-02 01:53:56.316610581 +0000 UTC m=+198.232741636" watchObservedRunningTime="2026-06-02 01:53:56.317883009 +0000 UTC m=+198.234014037" Jun 02 01:53:57.281107 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:57.281077 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" event={"ID":"800652e7-98bb-45f6-b3ba-735e5c838587","Type":"ContainerStarted","Data":"238b1cf0a3cf5058cf4984384093dd2ffad40d1586591ab7fbb19c1298a30b12"} Jun 02 01:53:57.281107 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:57.281112 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" event={"ID":"800652e7-98bb-45f6-b3ba-735e5c838587","Type":"ContainerStarted","Data":"334e6473d8221cc7300fc054059a96fa56f49395ad597ee9cfbd442bef3e2516"} Jun 02 01:53:57.282155 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:57.282113 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerStarted","Data":"52f8518387855aa13fbbaecdd2733cbbfbbd7793a2e92f0ba00551c5b99c7bfb"} Jun 02 01:53:57.300335 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:57.300295 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-wt896" podStartSLOduration=2.9136642139999998 podStartE2EDuration="4.30028344s" podCreationTimestamp="2026-06-02 01:53:53 +0000 UTC" firstStartedPulling="2026-06-02 01:53:54.785018228 +0000 UTC m=+196.701149250" lastFinishedPulling="2026-06-02 01:53:56.17163747 +0000 UTC m=+198.087768476" observedRunningTime="2026-06-02 01:53:57.299032175 +0000 UTC m=+199.215163205" watchObservedRunningTime="2026-06-02 01:53:57.30028344 +0000 UTC m=+199.216414468" Jun 02 01:53:58.181286 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.181248 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk"] Jun 02 01:53:58.184539 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.184516 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" Jun 02 01:53:58.188060 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.188040 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 01:53:58.188149 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.188048 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-qrrj4\"" Jun 02 01:53:58.197129 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.197107 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk"] Jun 02 01:53:58.198802 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.198780 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-86765748b9-hbqct"] Jun 02 01:53:58.202166 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.202122 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.204817 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.204800 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:53:58.204900 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.204800 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:53:58.205206 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.205188 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:53:58.205294 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.205195 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:53:58.205381 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.205365 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:53:58.205445 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.205430 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:53:58.205507 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.205492 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-djqjw\"" Jun 02 01:53:58.206363 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.206348 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:53:58.210431 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.210413 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:53:58.215084 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.215065 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86765748b9-hbqct"] Jun 02 01:53:58.287082 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.287058 2559 generic.go:358] "Generic (PLEG): container finished" podID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerID="fd928d36182d4f41d69eb48798f68037470a8fffb33882639460ea553c64b3cd" exitCode=0 Jun 02 01:53:58.287510 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.287165 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerDied","Data":"fd928d36182d4f41d69eb48798f68037470a8fffb33882639460ea553c64b3cd"} Jun 02 01:53:58.294939 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.294918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-trusted-ca-bundle\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.295028 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.294960 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-config\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.295028 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.294989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-oauth-serving-cert\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.295028 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.295016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-service-ca\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.295154 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.295071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00608bea-03d7-48ee-890b-73fd91dc7f9e-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-6pzdk\" (UID: \"00608bea-03d7-48ee-890b-73fd91dc7f9e\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" Jun 02 01:53:58.295154 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.295100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-oauth-config\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.295221 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.295160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvpfn\" (UniqueName: \"kubernetes.io/projected/8607fca5-9c1b-4d4d-b119-9328d133a97c-kube-api-access-hvpfn\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.295221 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.295208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-serving-cert\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.395572 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.395548 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-serving-cert\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.395697 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.395657 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-trusted-ca-bundle\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.395767 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.395733 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-config\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.395823 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.395771 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-oauth-serving-cert\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.395823 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.395811 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-service-ca\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.395914 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.395891 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00608bea-03d7-48ee-890b-73fd91dc7f9e-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-6pzdk\" (UID: \"00608bea-03d7-48ee-890b-73fd91dc7f9e\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" Jun 02 01:53:58.395960 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.395940 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-oauth-config\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.396039 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.396017 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvpfn\" (UniqueName: \"kubernetes.io/projected/8607fca5-9c1b-4d4d-b119-9328d133a97c-kube-api-access-hvpfn\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.396613 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.396586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-trusted-ca-bundle\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.396613 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:58.396605 2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 01:53:58.396770 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:53:58.396658 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00608bea-03d7-48ee-890b-73fd91dc7f9e-monitoring-plugin-cert podName:00608bea-03d7-48ee-890b-73fd91dc7f9e nodeName:}" failed. No retries permitted until 2026-06-02 01:53:58.896641102 +0000 UTC m=+200.812772125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/00608bea-03d7-48ee-890b-73fd91dc7f9e-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-6pzdk" (UID: "00608bea-03d7-48ee-890b-73fd91dc7f9e") : secret "monitoring-plugin-cert" not found Jun 02 01:53:58.396883 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.396861 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-config\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.397253 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.397231 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-service-ca\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.397435 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.397417 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-oauth-serving-cert\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.398178 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.398156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-serving-cert\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.399156 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.399126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-oauth-config\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.404908 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.404885 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvpfn\" (UniqueName: \"kubernetes.io/projected/8607fca5-9c1b-4d4d-b119-9328d133a97c-kube-api-access-hvpfn\") pod \"console-86765748b9-hbqct\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.511193 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.511166 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:53:58.633754 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.633726 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86765748b9-hbqct"] Jun 02 01:53:58.636646 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:58.636624 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8607fca5_9c1b_4d4d_b119_9328d133a97c.slice/crio-93d563a0b8f58dc4d0ec9dd2facd59eeb2bbea973b8adae9408c1027afca66ca WatchSource:0}: Error finding container 93d563a0b8f58dc4d0ec9dd2facd59eeb2bbea973b8adae9408c1027afca66ca: Status 404 returned error can't find the container with id 93d563a0b8f58dc4d0ec9dd2facd59eeb2bbea973b8adae9408c1027afca66ca Jun 02 01:53:58.901562 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.901478 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00608bea-03d7-48ee-890b-73fd91dc7f9e-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-6pzdk\" (UID: \"00608bea-03d7-48ee-890b-73fd91dc7f9e\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" Jun 02 01:53:58.905182 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:58.905129 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00608bea-03d7-48ee-890b-73fd91dc7f9e-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-6pzdk\" (UID: \"00608bea-03d7-48ee-890b-73fd91dc7f9e\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" Jun 02 01:53:59.092776 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:59.092746 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" Jun 02 01:53:59.238190 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:59.238134 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk"] Jun 02 01:53:59.292290 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:53:59.292252 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86765748b9-hbqct" event={"ID":"8607fca5-9c1b-4d4d-b119-9328d133a97c","Type":"ContainerStarted","Data":"93d563a0b8f58dc4d0ec9dd2facd59eeb2bbea973b8adae9408c1027afca66ca"} Jun 02 01:53:59.586083 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:53:59.586046 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00608bea_03d7_48ee_890b_73fd91dc7f9e.slice/crio-f379e08573a9d13f1a084d684d9daa88be9de7459b2870ab2cbb4fa07e04238b WatchSource:0}: Error finding container f379e08573a9d13f1a084d684d9daa88be9de7459b2870ab2cbb4fa07e04238b: Status 404 returned error can't find the container with id f379e08573a9d13f1a084d684d9daa88be9de7459b2870ab2cbb4fa07e04238b Jun 02 01:54:00.301684 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:00.301574 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerStarted","Data":"148331e8e67d360ad431121ef442d43611afab35d48e23774fe7f654ed0a27b8"} Jun 02 01:54:00.301684 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:00.301618 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerStarted","Data":"3907b6f2895e8a155da737608465ff95d8120fffc836df4eacd6408b8875a499"} Jun 02 01:54:00.301684 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:00.301635 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerStarted","Data":"a77dbe9e844e69e455d6eeb71d434d5bb3b4ccd03cd2e0331155117d6d934bce"} Jun 02 01:54:00.301684 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:00.301646 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerStarted","Data":"2cdbd2b1cbbf105cd256f2a8e3390bf2499e4c0accb33d8bb1b2549d15014168"} Jun 02 01:54:00.301684 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:00.301658 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerStarted","Data":"ca6b73165f8e951ce7817407664b0b9e77e6e2542ed109ad97cefdc9f3009314"} Jun 02 01:54:00.303181 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:00.303125 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" event={"ID":"00608bea-03d7-48ee-890b-73fd91dc7f9e","Type":"ContainerStarted","Data":"f379e08573a9d13f1a084d684d9daa88be9de7459b2870ab2cbb4fa07e04238b"} Jun 02 01:54:02.313963 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:02.313880 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerStarted","Data":"c56f6a90f6083146aa37bbeac7348fc09ae390ce0cba711170239b6481480866"} Jun 02 01:54:02.315188 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:02.315164 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86765748b9-hbqct" event={"ID":"8607fca5-9c1b-4d4d-b119-9328d133a97c","Type":"ContainerStarted","Data":"dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c"} Jun 02 01:54:02.316368 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:02.316346 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" event={"ID":"00608bea-03d7-48ee-890b-73fd91dc7f9e","Type":"ContainerStarted","Data":"418d9b9e001c5817d165c069967aa6e1339e269cde2aa9b3ab459a076f16149e"} Jun 02 01:54:02.316539 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:02.316523 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" Jun 02 01:54:02.321451 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:02.321436 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" Jun 02 01:54:02.345089 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:02.345046 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.665376321 podStartE2EDuration="8.345035715s" podCreationTimestamp="2026-06-02 01:53:54 +0000 UTC" firstStartedPulling="2026-06-02 01:53:56.324740385 +0000 UTC m=+198.240871400" lastFinishedPulling="2026-06-02 01:54:02.004399787 +0000 UTC m=+203.920530794" observedRunningTime="2026-06-02 01:54:02.342490253 +0000 UTC m=+204.258621279" watchObservedRunningTime="2026-06-02 01:54:02.345035715 +0000 UTC m=+204.261166742" Jun 02 01:54:02.361585 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:02.361547 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-6pzdk" podStartSLOduration=1.945420517 podStartE2EDuration="4.361536273s" podCreationTimestamp="2026-06-02 01:53:58 +0000 UTC" firstStartedPulling="2026-06-02 01:53:59.588282721 +0000 UTC m=+201.504413730" lastFinishedPulling="2026-06-02 01:54:02.00439848 +0000 UTC m=+203.920529486" observedRunningTime="2026-06-02 01:54:02.360307276 +0000 UTC m=+204.276438305" watchObservedRunningTime="2026-06-02 01:54:02.361536273 +0000 UTC m=+204.277667301" Jun 02 01:54:02.379115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:02.379074 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-86765748b9-hbqct" podStartSLOduration=1.006492213 podStartE2EDuration="4.379062547s" podCreationTimestamp="2026-06-02 01:53:58 +0000 UTC" firstStartedPulling="2026-06-02 01:53:58.638380409 +0000 UTC m=+200.554511415" lastFinishedPulling="2026-06-02 01:54:02.010950743 +0000 UTC m=+203.927081749" observedRunningTime="2026-06-02 01:54:02.378654382 +0000 UTC m=+204.294785410" watchObservedRunningTime="2026-06-02 01:54:02.379062547 +0000 UTC m=+204.295193575" Jun 02 01:54:08.511255 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:08.511218 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:54:08.511585 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:08.511267 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:54:08.512621 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:08.512595 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:54:08.512724 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:08.512639 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:54:18.511733 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:18.511699 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:54:18.512157 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:18.511755 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:54:28.512432 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:28.512399 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:54:28.512794 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:28.512460 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:54:28.932198 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:28.932107 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dea8ad4-138b-4660-a91d-cc88022a9102/init-config-reloader/0.log" Jun 02 01:54:29.133216 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:29.133190 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dea8ad4-138b-4660-a91d-cc88022a9102/alertmanager/0.log" Jun 02 01:54:29.331936 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:29.331911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dea8ad4-138b-4660-a91d-cc88022a9102/config-reloader/0.log" Jun 02 01:54:29.531993 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:29.531968 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dea8ad4-138b-4660-a91d-cc88022a9102/kube-rbac-proxy-web/0.log" Jun 02 01:54:29.732424 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:29.732397 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dea8ad4-138b-4660-a91d-cc88022a9102/kube-rbac-proxy/0.log" Jun 02 01:54:29.932050 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:29.932025 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dea8ad4-138b-4660-a91d-cc88022a9102/kube-rbac-proxy-metric/0.log" Jun 02 01:54:30.133010 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:30.132940 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6dea8ad4-138b-4660-a91d-cc88022a9102/prom-label-proxy/0.log" Jun 02 01:54:30.333974 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:30.333951 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-dpv94_3ef8e458-ef29-443c-8356-413b4256e95d/cluster-monitoring-operator/0.log" Jun 02 01:54:30.532996 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:30.532962 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-wt896_800652e7-98bb-45f6-b3ba-735e5c838587/kube-state-metrics/0.log" Jun 02 01:54:30.733049 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:30.733024 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-wt896_800652e7-98bb-45f6-b3ba-735e5c838587/kube-rbac-proxy-main/0.log" Jun 02 01:54:30.932294 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:30.932215 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-wt896_800652e7-98bb-45f6-b3ba-735e5c838587/kube-rbac-proxy-self/0.log" Jun 02 01:54:31.332674 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:31.332648 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-6pzdk_00608bea-03d7-48ee-890b-73fd91dc7f9e/monitoring-plugin/0.log" Jun 02 01:54:32.133654 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:32.133630 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxl79_4f4a3f81-7e66-4bbc-abde-71c17a651b33/init-textfile/0.log" Jun 02 01:54:32.336350 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:32.336324 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxl79_4f4a3f81-7e66-4bbc-abde-71c17a651b33/node-exporter/0.log" Jun 02 01:54:32.532362 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:32.532339 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxl79_4f4a3f81-7e66-4bbc-abde-71c17a651b33/kube-rbac-proxy/0.log" Jun 02 01:54:33.333221 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:33.333191 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7n9kj_17e7dd35-da04-451a-b5f5-05a6805b7292/kube-rbac-proxy-main/0.log" Jun 02 01:54:33.533290 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:33.533256 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7n9kj_17e7dd35-da04-451a-b5f5-05a6805b7292/kube-rbac-proxy-self/0.log" Jun 02 01:54:33.739923 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:33.739900 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7n9kj_17e7dd35-da04-451a-b5f5-05a6805b7292/openshift-state-metrics/0.log" Jun 02 01:54:35.332987 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:35.332960 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-klmc4_a4b024e1-1143-4181-858d-8f00d1d828ab/prometheus-operator/0.log" Jun 02 01:54:35.532690 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:35.532660 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-klmc4_a4b024e1-1143-4181-858d-8f00d1d828ab/kube-rbac-proxy/0.log" Jun 02 01:54:35.732391 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:35.732365 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-9nctj_73576d50-6ef6-4dc7-9e27-b4ef4615362b/prometheus-operator-admission-webhook/0.log" Jun 02 01:54:37.332752 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:37.332720 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 01:54:37.534443 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:37.534414 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/2.log" Jun 02 01:54:37.935223 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:37.935194 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86765748b9-hbqct_8607fca5-9c1b-4d4d-b119-9328d133a97c/console/0.log" Jun 02 01:54:38.512304 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:38.512273 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:54:38.512661 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:38.512321 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:54:39.533827 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:39.533794 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9rrkx_937fac9e-c35b-4b3e-9f62-934a5fbb01bf/dns-node-resolver/0.log" Jun 02 01:54:40.932317 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:40.932289 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x82gn_c98e7568-2413-4bc9-8364-340bd4df48d0/node-ca/0.log" Jun 02 01:54:41.135110 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:41.135084 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b6bdcd6bc-h4mhx_3c532827-81af-4e0f-b793-c7f9662ed2db/router/0.log" Jun 02 01:54:48.512483 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:48.512449 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:54:48.512918 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:48.512509 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:54:50.450178 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:50.450132 2559 generic.go:358] "Generic (PLEG): container finished" podID="a52ef298-36bb-4174-a13a-dcead25e5f76" containerID="670d6c99cc86c98c9af003135e64ef58c2ac9cf98d7d8817d628fd63dcd311b1" exitCode=0 Jun 02 01:54:50.450529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:50.450204 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" event={"ID":"a52ef298-36bb-4174-a13a-dcead25e5f76","Type":"ContainerDied","Data":"670d6c99cc86c98c9af003135e64ef58c2ac9cf98d7d8817d628fd63dcd311b1"} Jun 02 01:54:50.450529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:50.450505 2559 scope.go:117] "RemoveContainer" containerID="670d6c99cc86c98c9af003135e64ef58c2ac9cf98d7d8817d628fd63dcd311b1" Jun 02 01:54:50.661250 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:50.661217 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:54:50.663372 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:50.663345 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7390b1f2-1a3d-48af-a481-196e75ec47d9-metrics-certs\") pod \"network-metrics-daemon-jkp2b\" (UID: \"7390b1f2-1a3d-48af-a481-196e75ec47d9\") " pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:54:50.961372 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:50.961288 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fsfrq\"" Jun 02 01:54:50.967473 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:50.967454 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkp2b" Jun 02 01:54:51.098215 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:51.098182 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkp2b"] Jun 02 01:54:51.101583 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:54:51.101558 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7390b1f2_1a3d_48af_a481_196e75ec47d9.slice/crio-4d2a3c4879665a69994078c3d38ce50e853e234e8735e3c8587c2c729a226e6a WatchSource:0}: Error finding container 4d2a3c4879665a69994078c3d38ce50e853e234e8735e3c8587c2c729a226e6a: Status 404 returned error can't find the container with id 4d2a3c4879665a69994078c3d38ce50e853e234e8735e3c8587c2c729a226e6a Jun 02 01:54:51.454336 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:51.454306 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkp2b" event={"ID":"7390b1f2-1a3d-48af-a481-196e75ec47d9","Type":"ContainerStarted","Data":"4d2a3c4879665a69994078c3d38ce50e853e234e8735e3c8587c2c729a226e6a"} Jun 02 01:54:51.455730 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:51.455707 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5cfgh" event={"ID":"a52ef298-36bb-4174-a13a-dcead25e5f76","Type":"ContainerStarted","Data":"3245b5615b39f88ec059f326f3a1f88769182cf25cbd35f5439e24a10361c30d"} Jun 02 01:54:52.461100 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:52.461006 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkp2b" event={"ID":"7390b1f2-1a3d-48af-a481-196e75ec47d9","Type":"ContainerStarted","Data":"8df9cc511451f37db1fd12d13ec75a31ba87141b09fc25f957d73eb17040d2a6"} Jun 02 01:54:52.461100 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:52.461045 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkp2b" event={"ID":"7390b1f2-1a3d-48af-a481-196e75ec47d9","Type":"ContainerStarted","Data":"8c4ab9865683689ad5e832e1785cb8701971016fe6b2a1f8bd2ad18c0469addf"} Jun 02 01:54:52.500169 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:52.500105 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jkp2b" podStartSLOduration=252.612990764 podStartE2EDuration="4m13.500091578s" podCreationTimestamp="2026-06-02 01:50:39 +0000 UTC" firstStartedPulling="2026-06-02 01:54:51.103337385 +0000 UTC m=+253.019468391" lastFinishedPulling="2026-06-02 01:54:51.990438199 +0000 UTC m=+253.906569205" observedRunningTime="2026-06-02 01:54:52.498889992 +0000 UTC m=+254.415021020" watchObservedRunningTime="2026-06-02 01:54:52.500091578 +0000 UTC m=+254.416222606" Jun 02 01:54:58.512180 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:58.512080 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:54:58.512180 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:54:58.512128 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:55:08.512000 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:08.511965 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:55:08.512412 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:08.512022 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:55:14.012960 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.012921 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:55:14.013449 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.013375 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="alertmanager" containerID="cri-o://ca6b73165f8e951ce7817407664b0b9e77e6e2542ed109ad97cefdc9f3009314" gracePeriod=120 Jun 02 01:55:14.013683 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.013429 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy-metric" containerID="cri-o://148331e8e67d360ad431121ef442d43611afab35d48e23774fe7f654ed0a27b8" gracePeriod=120 Jun 02 01:55:14.013775 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.013466 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="prom-label-proxy" containerID="cri-o://c56f6a90f6083146aa37bbeac7348fc09ae390ce0cba711170239b6481480866" gracePeriod=120 Jun 02 01:55:14.013775 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.013475 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="config-reloader" containerID="cri-o://2cdbd2b1cbbf105cd256f2a8e3390bf2499e4c0accb33d8bb1b2549d15014168" gracePeriod=120 Jun 02 01:55:14.013878 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.013475 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy-web" containerID="cri-o://a77dbe9e844e69e455d6eeb71d434d5bb3b4ccd03cd2e0331155117d6d934bce" gracePeriod=120 Jun 02 01:55:14.013878 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.013501 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy" containerID="cri-o://3907b6f2895e8a155da737608465ff95d8120fffc836df4eacd6408b8875a499" gracePeriod=120 Jun 02 01:55:14.525480 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.525449 2559 generic.go:358] "Generic (PLEG): container finished" podID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerID="c56f6a90f6083146aa37bbeac7348fc09ae390ce0cba711170239b6481480866" exitCode=0 Jun 02 01:55:14.525480 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.525474 2559 generic.go:358] "Generic (PLEG): container finished" podID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerID="3907b6f2895e8a155da737608465ff95d8120fffc836df4eacd6408b8875a499" exitCode=0 Jun 02 01:55:14.525480 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.525481 2559 generic.go:358] "Generic (PLEG): container finished" podID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerID="2cdbd2b1cbbf105cd256f2a8e3390bf2499e4c0accb33d8bb1b2549d15014168" exitCode=0 Jun 02 01:55:14.525480 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.525487 2559 generic.go:358] "Generic (PLEG): container finished" podID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerID="ca6b73165f8e951ce7817407664b0b9e77e6e2542ed109ad97cefdc9f3009314" exitCode=0 Jun 02 01:55:14.525747 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.525521 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerDied","Data":"c56f6a90f6083146aa37bbeac7348fc09ae390ce0cba711170239b6481480866"} Jun 02 01:55:14.525747 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.525557 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerDied","Data":"3907b6f2895e8a155da737608465ff95d8120fffc836df4eacd6408b8875a499"} Jun 02 01:55:14.525747 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.525572 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerDied","Data":"2cdbd2b1cbbf105cd256f2a8e3390bf2499e4c0accb33d8bb1b2549d15014168"} Jun 02 01:55:14.525747 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:14.525584 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerDied","Data":"ca6b73165f8e951ce7817407664b0b9e77e6e2542ed109ad97cefdc9f3009314"} Jun 02 01:55:15.531027 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.530998 2559 generic.go:358] "Generic (PLEG): container finished" podID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerID="148331e8e67d360ad431121ef442d43611afab35d48e23774fe7f654ed0a27b8" exitCode=0 Jun 02 01:55:15.531027 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.531024 2559 generic.go:358] "Generic (PLEG): container finished" podID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerID="a77dbe9e844e69e455d6eeb71d434d5bb3b4ccd03cd2e0331155117d6d934bce" exitCode=0 Jun 02 01:55:15.531426 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.531064 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerDied","Data":"148331e8e67d360ad431121ef442d43611afab35d48e23774fe7f654ed0a27b8"} Jun 02 01:55:15.531426 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.531092 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerDied","Data":"a77dbe9e844e69e455d6eeb71d434d5bb3b4ccd03cd2e0331155117d6d934bce"} Jun 02 01:55:15.750915 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.750888 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:15.874674 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.874640 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.874792 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.874701 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.874792 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.874734 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.874792 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.874771 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-main-db\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.874951 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.874883 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-metrics-client-ca\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.874951 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.874928 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-web\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.875046 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.874960 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-tls-assets\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.875046 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.874994 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-cluster-tls-config\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.875164 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875044 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-config-volume\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.875164 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875071 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-web-config\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.875164 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875097 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz9tj\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-kube-api-access-jz9tj\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.875164 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875130 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-trusted-ca-bundle\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.875164 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875152 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:55:15.875468 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875170 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-config-out\") pod \"6dea8ad4-138b-4660-a91d-cc88022a9102\" (UID: \"6dea8ad4-138b-4660-a91d-cc88022a9102\") " Jun 02 01:55:15.875524 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875489 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:55:15.875650 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875633 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-main-db\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.875711 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.875656 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-metrics-client-ca\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.876375 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.876266 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:55:15.877382 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.877352 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:55:15.878811 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.878784 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:55:15.878902 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.878861 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-config-volume" (OuterVolumeSpecName: "config-volume") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:55:15.879269 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.879244 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-config-out" (OuterVolumeSpecName: "config-out") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:55:15.879659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.879620 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:55:15.879945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.879913 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:55:15.879945 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.879926 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-kube-api-access-jz9tj" (OuterVolumeSpecName: "kube-api-access-jz9tj") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "kube-api-access-jz9tj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:55:15.880743 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.880723 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:55:15.884303 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.884276 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:55:15.889788 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.889769 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-web-config" (OuterVolumeSpecName: "web-config") pod "6dea8ad4-138b-4660-a91d-cc88022a9102" (UID: "6dea8ad4-138b-4660-a91d-cc88022a9102"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:55:15.976043 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976012 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976043 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976038 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-tls-assets\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976043 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976048 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-cluster-tls-config\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976278 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976058 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-config-volume\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976278 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976067 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-web-config\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976278 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976077 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz9tj\" (UniqueName: \"kubernetes.io/projected/6dea8ad4-138b-4660-a91d-cc88022a9102-kube-api-access-jz9tj\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976278 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976085 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dea8ad4-138b-4660-a91d-cc88022a9102-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976278 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976093 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dea8ad4-138b-4660-a91d-cc88022a9102-config-out\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976278 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976101 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976278 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976110 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-main-tls\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:15.976278 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:15.976119 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6dea8ad4-138b-4660-a91d-cc88022a9102-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:55:16.538987 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.538955 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6dea8ad4-138b-4660-a91d-cc88022a9102","Type":"ContainerDied","Data":"52f8518387855aa13fbbaecdd2733cbbfbbd7793a2e92f0ba00551c5b99c7bfb"} Jun 02 01:55:16.539358 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.539001 2559 scope.go:117] "RemoveContainer" containerID="c56f6a90f6083146aa37bbeac7348fc09ae390ce0cba711170239b6481480866" Jun 02 01:55:16.539358 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.539023 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.547067 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.547052 2559 scope.go:117] "RemoveContainer" containerID="148331e8e67d360ad431121ef442d43611afab35d48e23774fe7f654ed0a27b8" Jun 02 01:55:16.553616 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.553593 2559 scope.go:117] "RemoveContainer" containerID="3907b6f2895e8a155da737608465ff95d8120fffc836df4eacd6408b8875a499" Jun 02 01:55:16.559528 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.559512 2559 scope.go:117] "RemoveContainer" containerID="a77dbe9e844e69e455d6eeb71d434d5bb3b4ccd03cd2e0331155117d6d934bce" Jun 02 01:55:16.565853 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.565833 2559 scope.go:117] "RemoveContainer" containerID="2cdbd2b1cbbf105cd256f2a8e3390bf2499e4c0accb33d8bb1b2549d15014168" Jun 02 01:55:16.566418 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.566392 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:55:16.572187 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.572170 2559 scope.go:117] "RemoveContainer" containerID="ca6b73165f8e951ce7817407664b0b9e77e6e2542ed109ad97cefdc9f3009314" Jun 02 01:55:16.572311 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.572294 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:55:16.578276 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.578261 2559 scope.go:117] "RemoveContainer" containerID="fd928d36182d4f41d69eb48798f68037470a8fffb33882639460ea553c64b3cd" Jun 02 01:55:16.605025 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605000 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:55:16.605414 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605398 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy-metric" Jun 02 01:55:16.605460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605418 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy-metric" Jun 02 01:55:16.605460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605435 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="alertmanager" Jun 02 01:55:16.605460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605441 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="alertmanager" Jun 02 01:55:16.605460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605449 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy-web" Jun 02 01:55:16.605460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605454 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy-web" Jun 02 01:55:16.605460 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605461 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="prom-label-proxy" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605466 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="prom-label-proxy" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605474 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="init-config-reloader" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605479 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="init-config-reloader" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605484 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="config-reloader" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605489 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="config-reloader" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605498 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605503 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605548 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy-web" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605553 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy-metric" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605562 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="config-reloader" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605567 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="prom-label-proxy" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605573 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="alertmanager" Jun 02 01:55:16.605659 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.605579 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" containerName="kube-rbac-proxy" Jun 02 01:55:16.611349 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.611333 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.615177 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.614450 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 01:55:16.615177 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.614535 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 01:55:16.615177 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.614782 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gt9sz\"" Jun 02 01:55:16.615177 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.614952 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 01:55:16.615177 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.614967 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 01:55:16.615679 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.615318 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 01:55:16.615679 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.615560 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 01:55:16.615679 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.615610 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 01:55:16.615801 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.615723 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 01:55:16.623027 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.623005 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 01:55:16.625536 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.625514 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:55:16.681640 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681739 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e07d49-9a3f-492b-ad53-79e871f5cddc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681739 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681739 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-web-config\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681851 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681851 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2e07d49-9a3f-492b-ad53-79e871f5cddc-config-out\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681851 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2e07d49-9a3f-492b-ad53-79e871f5cddc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681851 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681987 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knz4d\" (UniqueName: \"kubernetes.io/projected/d2e07d49-9a3f-492b-ad53-79e871f5cddc-kube-api-access-knz4d\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681987 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681987 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681987 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e07d49-9a3f-492b-ad53-79e871f5cddc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.681987 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.681969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2e07d49-9a3f-492b-ad53-79e871f5cddc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.759228 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.759200 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dea8ad4-138b-4660-a91d-cc88022a9102" path="/var/lib/kubelet/pods/6dea8ad4-138b-4660-a91d-cc88022a9102/volumes" Jun 02 01:55:16.782834 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.782807 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e07d49-9a3f-492b-ad53-79e871f5cddc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.782934 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.782840 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2e07d49-9a3f-492b-ad53-79e871f5cddc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.782934 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.782875 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.782934 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.782900 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e07d49-9a3f-492b-ad53-79e871f5cddc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.782934 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.782926 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.782961 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-web-config\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.782998 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.783022 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2e07d49-9a3f-492b-ad53-79e871f5cddc-config-out\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.783048 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2e07d49-9a3f-492b-ad53-79e871f5cddc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.783107 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.783131 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-knz4d\" (UniqueName: \"kubernetes.io/projected/d2e07d49-9a3f-492b-ad53-79e871f5cddc-kube-api-access-knz4d\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783480 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.783183 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783480 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.783208 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.783701 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.783677 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e07d49-9a3f-492b-ad53-79e871f5cddc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.784789 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.784746 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e07d49-9a3f-492b-ad53-79e871f5cddc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.784886 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.784786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2e07d49-9a3f-492b-ad53-79e871f5cddc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.785803 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.785775 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2e07d49-9a3f-492b-ad53-79e871f5cddc-config-out\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.786235 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.786180 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.786235 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.786196 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2e07d49-9a3f-492b-ad53-79e871f5cddc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.786235 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.786204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.786423 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.786319 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.786555 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.786536 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-web-config\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.786606 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.786553 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.787214 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.787195 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.787826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.787811 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2e07d49-9a3f-492b-ad53-79e871f5cddc-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.794075 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.794026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knz4d\" (UniqueName: \"kubernetes.io/projected/d2e07d49-9a3f-492b-ad53-79e871f5cddc-kube-api-access-knz4d\") pod \"alertmanager-main-0\" (UID: \"d2e07d49-9a3f-492b-ad53-79e871f5cddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:16.924013 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:16.923988 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:55:17.075937 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:17.075909 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:55:17.077160 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:55:17.077117 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e07d49_9a3f_492b_ad53_79e871f5cddc.slice/crio-7669fbf4ce98af27e181163766994b23f5a01e9f18bf7c6ae4c8335532967a35 WatchSource:0}: Error finding container 7669fbf4ce98af27e181163766994b23f5a01e9f18bf7c6ae4c8335532967a35: Status 404 returned error can't find the container with id 7669fbf4ce98af27e181163766994b23f5a01e9f18bf7c6ae4c8335532967a35 Jun 02 01:55:17.544502 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:17.544468 2559 generic.go:358] "Generic (PLEG): container finished" podID="d2e07d49-9a3f-492b-ad53-79e871f5cddc" containerID="c8c2717a13d5784247e6cb14899522e6b93f7a1cfdcabfdf0207a000703dcf27" exitCode=0 Jun 02 01:55:17.544960 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:17.544510 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e07d49-9a3f-492b-ad53-79e871f5cddc","Type":"ContainerDied","Data":"c8c2717a13d5784247e6cb14899522e6b93f7a1cfdcabfdf0207a000703dcf27"} Jun 02 01:55:17.544960 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:17.544529 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e07d49-9a3f-492b-ad53-79e871f5cddc","Type":"ContainerStarted","Data":"7669fbf4ce98af27e181163766994b23f5a01e9f18bf7c6ae4c8335532967a35"} Jun 02 01:55:18.036749 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.036700 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-595475c87f-kgkvf"] Jun 02 01:55:18.040713 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.040688 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.044040 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.044006 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 01:55:18.045565 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.045535 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v8xxx\"" Jun 02 01:55:18.045676 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.045579 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 01:55:18.045807 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.045791 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 01:55:18.045807 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.045804 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 01:55:18.046018 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.046003 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 01:55:18.052803 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.052753 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 01:55:18.062195 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.062170 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-595475c87f-kgkvf"] Jun 02 01:55:18.094276 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.094239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-telemeter-client-tls\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.094413 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.094292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-federate-client-tls\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.094413 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.094324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-secret-telemeter-client\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.094413 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.094354 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v62vh\" (UniqueName: \"kubernetes.io/projected/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-kube-api-access-v62vh\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.094579 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.094442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-metrics-client-ca\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.094579 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.094469 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.094579 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.094508 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.094579 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.094537 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-serving-certs-ca-bundle\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.195657 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.195617 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v62vh\" (UniqueName: \"kubernetes.io/projected/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-kube-api-access-v62vh\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.195826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.195687 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-metrics-client-ca\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.195826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.195707 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.195826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.195730 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.195826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.195748 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-serving-certs-ca-bundle\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.195826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.195798 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-telemeter-client-tls\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.195826 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.195816 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-federate-client-tls\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.196074 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.195847 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-secret-telemeter-client\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.196955 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.196880 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-metrics-client-ca\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.203882 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.197388 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-serving-certs-ca-bundle\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.203882 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.199586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-federate-client-tls\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.203882 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.203592 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.205451 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.205428 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.206163 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.206114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-secret-telemeter-client\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.206371 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.206348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-telemeter-client-tls\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.207039 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.207004 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v62vh\" (UniqueName: \"kubernetes.io/projected/32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0-kube-api-access-v62vh\") pod \"telemeter-client-595475c87f-kgkvf\" (UID: \"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0\") " pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.353440 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.353367 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" Jun 02 01:55:18.507853 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.507823 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-595475c87f-kgkvf"] Jun 02 01:55:18.510126 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:55:18.510099 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32bb8e2a_1cb3_4dff_be6f_3e85afc9e4c0.slice/crio-6836226cf35ae8fbbdad4ae03794a13f103fbd96005d571e284748a0a5b3f1d7 WatchSource:0}: Error finding container 6836226cf35ae8fbbdad4ae03794a13f103fbd96005d571e284748a0a5b3f1d7: Status 404 returned error can't find the container with id 6836226cf35ae8fbbdad4ae03794a13f103fbd96005d571e284748a0a5b3f1d7 Jun 02 01:55:18.511501 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.511478 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:55:18.511627 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.511517 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:55:18.547976 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.547946 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" event={"ID":"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0","Type":"ContainerStarted","Data":"6836226cf35ae8fbbdad4ae03794a13f103fbd96005d571e284748a0a5b3f1d7"} Jun 02 01:55:18.551344 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.551292 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e07d49-9a3f-492b-ad53-79e871f5cddc","Type":"ContainerStarted","Data":"dfde4b2a76172a5a5456c71fb98e9b16f9419c007176fe31af812fa5d5c66240"} Jun 02 01:55:18.551344 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.551326 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e07d49-9a3f-492b-ad53-79e871f5cddc","Type":"ContainerStarted","Data":"9a2b25d9942e5f8c40c2963bf21a0262c93b28b62493017022515fd3e8b34ac0"} Jun 02 01:55:18.551344 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.551339 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e07d49-9a3f-492b-ad53-79e871f5cddc","Type":"ContainerStarted","Data":"d43286787fcfb512d07acac189f45aadef7f2fb4e549c9b89165355a1c26c205"} Jun 02 01:55:18.551526 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.551353 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e07d49-9a3f-492b-ad53-79e871f5cddc","Type":"ContainerStarted","Data":"24bfb8150c1136c3353e5cf6059da597d8587bbe42284ee279b34800f3da0952"} Jun 02 01:55:18.551526 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.551363 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e07d49-9a3f-492b-ad53-79e871f5cddc","Type":"ContainerStarted","Data":"0e89a404ec96e45abec8fc6530b8582c3b621571fe652756b7dd9b69ecd8b603"} Jun 02 01:55:18.551526 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.551373 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e07d49-9a3f-492b-ad53-79e871f5cddc","Type":"ContainerStarted","Data":"3a21558e237752171d0553ffd833089d1bb5938f20860c9f02eb3b16a9d29273"} Jun 02 01:55:18.605520 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:18.605432 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.605419548 podStartE2EDuration="2.605419548s" podCreationTimestamp="2026-06-02 01:55:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:55:18.604514283 +0000 UTC m=+280.520645313" watchObservedRunningTime="2026-06-02 01:55:18.605419548 +0000 UTC m=+280.521550623" Jun 02 01:55:19.135371 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:55:19.135332 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-75gv6" podUID="586260d8-1a00-4e53-97bb-7da92f4473ed" Jun 02 01:55:19.135371 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:55:19.135332 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2ls86" podUID="420f75c1-1c72-45e3-82af-19acef404dcf" Jun 02 01:55:19.554850 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:19.554814 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:55:19.554850 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:19.554837 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75gv6" Jun 02 01:55:21.562736 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.562703 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" event={"ID":"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0","Type":"ContainerStarted","Data":"93c7315ac1eb628b888be59f064d1a7c5968b5962cdfea3bf07f68a22930c1ad"} Jun 02 01:55:21.562736 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.562739 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" event={"ID":"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0","Type":"ContainerStarted","Data":"89f7b08982b4c445598e6976a84acd292805ecef8173903d25395c3b4aee338f"} Jun 02 01:55:21.563185 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.562749 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" event={"ID":"32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0","Type":"ContainerStarted","Data":"98e205afe3b3f5cf2fb67cc42bb923ecca3fb1913a7d25ddd062896e739641bc"} Jun 02 01:55:21.611484 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.611429 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-595475c87f-kgkvf" podStartSLOduration=1.457243775 podStartE2EDuration="3.611415431s" podCreationTimestamp="2026-06-02 01:55:18 +0000 UTC" firstStartedPulling="2026-06-02 01:55:18.512050195 +0000 UTC m=+280.428181201" lastFinishedPulling="2026-06-02 01:55:20.666221847 +0000 UTC m=+282.582352857" observedRunningTime="2026-06-02 01:55:21.609817864 +0000 UTC m=+283.525948926" watchObservedRunningTime="2026-06-02 01:55:21.611415431 +0000 UTC m=+283.527546459" Jun 02 01:55:21.800170 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.800122 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6544784f76-hzgk4"] Jun 02 01:55:21.803548 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.803531 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:21.837444 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.837377 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6544784f76-hzgk4"] Jun 02 01:55:21.931422 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.931383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh6bg\" (UniqueName: \"kubernetes.io/projected/1b00b713-4bf7-404b-9422-68c0b41f58c6-kube-api-access-bh6bg\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:21.931600 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.931517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-serving-cert\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:21.931600 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.931553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-service-ca\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:21.931600 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.931578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-oauth-config\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:21.931700 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.931616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-trusted-ca-bundle\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:21.931700 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.931643 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-config\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:21.931700 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:21.931670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-oauth-serving-cert\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.033150 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.033112 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-serving-cert\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.033322 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.033175 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-service-ca\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.033322 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.033195 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-oauth-config\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.033322 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.033220 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-trusted-ca-bundle\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.033322 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.033246 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-config\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.033322 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.033264 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-oauth-serving-cert\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.033322 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.033313 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bh6bg\" (UniqueName: \"kubernetes.io/projected/1b00b713-4bf7-404b-9422-68c0b41f58c6-kube-api-access-bh6bg\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.034103 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.034079 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-oauth-serving-cert\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.034238 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.034128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-service-ca\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.034349 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.034294 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-config\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.034517 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.034498 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-trusted-ca-bundle\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.035667 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.035645 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-oauth-config\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.035762 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.035736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-serving-cert\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.045519 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.045495 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh6bg\" (UniqueName: \"kubernetes.io/projected/1b00b713-4bf7-404b-9422-68c0b41f58c6-kube-api-access-bh6bg\") pod \"console-6544784f76-hzgk4\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.112737 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.112649 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:22.259901 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.259872 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6544784f76-hzgk4"] Jun 02 01:55:22.261763 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:55:22.261739 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b00b713_4bf7_404b_9422_68c0b41f58c6.slice/crio-7f5611d6a7709cf3b41ac0f1b998555a72b92da2338f0f556fed6a123c8f7b57 WatchSource:0}: Error finding container 7f5611d6a7709cf3b41ac0f1b998555a72b92da2338f0f556fed6a123c8f7b57: Status 404 returned error can't find the container with id 7f5611d6a7709cf3b41ac0f1b998555a72b92da2338f0f556fed6a123c8f7b57 Jun 02 01:55:22.436860 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.436765 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:55:22.436860 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.436857 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:55:22.439085 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.439061 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/586260d8-1a00-4e53-97bb-7da92f4473ed-metrics-tls\") pod \"dns-default-75gv6\" (UID: \"586260d8-1a00-4e53-97bb-7da92f4473ed\") " pod="openshift-dns/dns-default-75gv6" Jun 02 01:55:22.439227 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.439092 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/420f75c1-1c72-45e3-82af-19acef404dcf-cert\") pod \"ingress-canary-2ls86\" (UID: \"420f75c1-1c72-45e3-82af-19acef404dcf\") " pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:55:22.561356 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.561322 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqf6s\"" Jun 02 01:55:22.562341 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.562325 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jf6tl\"" Jun 02 01:55:22.566113 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.566093 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2ls86" Jun 02 01:55:22.566519 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.566128 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-75gv6" Jun 02 01:55:22.567323 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.567301 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6544784f76-hzgk4" event={"ID":"1b00b713-4bf7-404b-9422-68c0b41f58c6","Type":"ContainerStarted","Data":"ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a"} Jun 02 01:55:22.567413 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.567334 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6544784f76-hzgk4" event={"ID":"1b00b713-4bf7-404b-9422-68c0b41f58c6","Type":"ContainerStarted","Data":"7f5611d6a7709cf3b41ac0f1b998555a72b92da2338f0f556fed6a123c8f7b57"} Jun 02 01:55:22.597884 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.597647 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6544784f76-hzgk4" podStartSLOduration=1.597630272 podStartE2EDuration="1.597630272s" podCreationTimestamp="2026-06-02 01:55:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:55:22.596605188 +0000 UTC m=+284.512736215" watchObservedRunningTime="2026-06-02 01:55:22.597630272 +0000 UTC m=+284.513761303" Jun 02 01:55:22.726003 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.725975 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2ls86"] Jun 02 01:55:22.728971 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:55:22.728943 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420f75c1_1c72_45e3_82af_19acef404dcf.slice/crio-e411cc34b0848e6e3e61bef23433feada06acaf7846c72722475b5b3a92fa3f9 WatchSource:0}: Error finding container e411cc34b0848e6e3e61bef23433feada06acaf7846c72722475b5b3a92fa3f9: Status 404 returned error can't find the container with id e411cc34b0848e6e3e61bef23433feada06acaf7846c72722475b5b3a92fa3f9 Jun 02 01:55:22.735744 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:22.735722 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-75gv6"] Jun 02 01:55:22.741771 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:55:22.741749 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586260d8_1a00_4e53_97bb_7da92f4473ed.slice/crio-2a857ac37017fd8bde0a26f7b724d452921c385c7125c1efc701db4155384af2 WatchSource:0}: Error finding container 2a857ac37017fd8bde0a26f7b724d452921c385c7125c1efc701db4155384af2: Status 404 returned error can't find the container with id 2a857ac37017fd8bde0a26f7b724d452921c385c7125c1efc701db4155384af2 Jun 02 01:55:23.572481 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:23.572423 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2ls86" event={"ID":"420f75c1-1c72-45e3-82af-19acef404dcf","Type":"ContainerStarted","Data":"e411cc34b0848e6e3e61bef23433feada06acaf7846c72722475b5b3a92fa3f9"} Jun 02 01:55:23.573708 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:23.573661 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75gv6" event={"ID":"586260d8-1a00-4e53-97bb-7da92f4473ed","Type":"ContainerStarted","Data":"2a857ac37017fd8bde0a26f7b724d452921c385c7125c1efc701db4155384af2"} Jun 02 01:55:25.582765 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:25.582723 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75gv6" event={"ID":"586260d8-1a00-4e53-97bb-7da92f4473ed","Type":"ContainerStarted","Data":"0367e0a32adfa30dbd3a22df7be2f50f97520aca4923b4fad32eed1773c5c47d"} Jun 02 01:55:25.582765 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:25.582768 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-75gv6" event={"ID":"586260d8-1a00-4e53-97bb-7da92f4473ed","Type":"ContainerStarted","Data":"07a6a94766a419c865fcfee944583441a9a23f770b9c5512b69efb64680e1c79"} Jun 02 01:55:25.583280 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:25.582833 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-75gv6" Jun 02 01:55:25.584038 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:25.584018 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2ls86" event={"ID":"420f75c1-1c72-45e3-82af-19acef404dcf","Type":"ContainerStarted","Data":"c0bd01a56008b062a5d88a1292c4d273e548584cfcc7900c00ec65dd8df6ad2d"} Jun 02 01:55:25.616825 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:25.616784 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-75gv6" podStartSLOduration=251.797051298 podStartE2EDuration="4m13.616773502s" podCreationTimestamp="2026-06-02 01:51:12 +0000 UTC" firstStartedPulling="2026-06-02 01:55:22.743393201 +0000 UTC m=+284.659524208" lastFinishedPulling="2026-06-02 01:55:24.563115406 +0000 UTC m=+286.479246412" observedRunningTime="2026-06-02 01:55:25.614327009 +0000 UTC m=+287.530458037" watchObservedRunningTime="2026-06-02 01:55:25.616773502 +0000 UTC m=+287.532904529" Jun 02 01:55:25.641555 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:25.641506 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2ls86" podStartSLOduration=251.805464059 podStartE2EDuration="4m13.641492648s" podCreationTimestamp="2026-06-02 01:51:12 +0000 UTC" firstStartedPulling="2026-06-02 01:55:22.730759255 +0000 UTC m=+284.646890264" lastFinishedPulling="2026-06-02 01:55:24.566787836 +0000 UTC m=+286.482918853" observedRunningTime="2026-06-02 01:55:25.64064799 +0000 UTC m=+287.556779018" watchObservedRunningTime="2026-06-02 01:55:25.641492648 +0000 UTC m=+287.557623675" Jun 02 01:55:28.512506 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:28.512467 2559 patch_prober.go:28] interesting pod/console-86765748b9-hbqct container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jun 02 01:55:28.512891 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:28.512528 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jun 02 01:55:32.113623 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:32.113591 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:32.113623 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:32.113633 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:32.115047 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:32.115011 2559 patch_prober.go:28] interesting pod/console-6544784f76-hzgk4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" start-of-body= Jun 02 01:55:32.115174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:32.115062 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6544784f76-hzgk4" podUID="1b00b713-4bf7-404b-9422-68c0b41f58c6" containerName="console" probeResult="failure" output="Get \"https://10.132.0.25:8443/health\": dial tcp 10.132.0.25:8443: connect: connection refused" Jun 02 01:55:35.589680 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:35.589647 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-75gv6" Jun 02 01:55:38.515663 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:38.515627 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:55:38.519251 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:38.519233 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:55:38.671832 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:38.669090 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 01:55:38.671832 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:38.669906 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 01:55:38.688635 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:38.688608 2559 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 01:55:42.117129 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:42.117098 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:42.120737 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:42.120712 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:55:42.285919 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:55:42.285882 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86765748b9-hbqct"] Jun 02 01:56:07.304408 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.304349 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-86765748b9-hbqct" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" containerID="cri-o://dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c" gracePeriod=15 Jun 02 01:56:07.557766 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.557707 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86765748b9-hbqct_8607fca5-9c1b-4d4d-b119-9328d133a97c/console/0.log" Jun 02 01:56:07.557863 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.557770 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:56:07.621294 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621265 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvpfn\" (UniqueName: \"kubernetes.io/projected/8607fca5-9c1b-4d4d-b119-9328d133a97c-kube-api-access-hvpfn\") pod \"8607fca5-9c1b-4d4d-b119-9328d133a97c\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " Jun 02 01:56:07.621453 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621305 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-service-ca\") pod \"8607fca5-9c1b-4d4d-b119-9328d133a97c\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " Jun 02 01:56:07.621453 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621326 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-config\") pod \"8607fca5-9c1b-4d4d-b119-9328d133a97c\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " Jun 02 01:56:07.621453 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621372 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-trusted-ca-bundle\") pod \"8607fca5-9c1b-4d4d-b119-9328d133a97c\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " Jun 02 01:56:07.621670 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621522 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-serving-cert\") pod \"8607fca5-9c1b-4d4d-b119-9328d133a97c\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " Jun 02 01:56:07.621670 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621582 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-oauth-config\") pod \"8607fca5-9c1b-4d4d-b119-9328d133a97c\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " Jun 02 01:56:07.621670 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621644 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-oauth-serving-cert\") pod \"8607fca5-9c1b-4d4d-b119-9328d133a97c\" (UID: \"8607fca5-9c1b-4d4d-b119-9328d133a97c\") " Jun 02 01:56:07.621819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621678 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-config" (OuterVolumeSpecName: "console-config") pod "8607fca5-9c1b-4d4d-b119-9328d133a97c" (UID: "8607fca5-9c1b-4d4d-b119-9328d133a97c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:56:07.621819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621746 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8607fca5-9c1b-4d4d-b119-9328d133a97c" (UID: "8607fca5-9c1b-4d4d-b119-9328d133a97c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:56:07.621819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621775 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-service-ca" (OuterVolumeSpecName: "service-ca") pod "8607fca5-9c1b-4d4d-b119-9328d133a97c" (UID: "8607fca5-9c1b-4d4d-b119-9328d133a97c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:56:07.621967 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621898 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-service-ca\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:56:07.621967 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621917 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-config\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:56:07.621967 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.621931 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-trusted-ca-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:56:07.622183 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.622162 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8607fca5-9c1b-4d4d-b119-9328d133a97c" (UID: "8607fca5-9c1b-4d4d-b119-9328d133a97c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:56:07.623759 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.623730 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8607fca5-9c1b-4d4d-b119-9328d133a97c" (UID: "8607fca5-9c1b-4d4d-b119-9328d133a97c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:56:07.623845 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.623739 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8607fca5-9c1b-4d4d-b119-9328d133a97c" (UID: "8607fca5-9c1b-4d4d-b119-9328d133a97c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:56:07.623972 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.623947 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8607fca5-9c1b-4d4d-b119-9328d133a97c-kube-api-access-hvpfn" (OuterVolumeSpecName: "kube-api-access-hvpfn") pod "8607fca5-9c1b-4d4d-b119-9328d133a97c" (UID: "8607fca5-9c1b-4d4d-b119-9328d133a97c"). InnerVolumeSpecName "kube-api-access-hvpfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:56:07.718132 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.718103 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86765748b9-hbqct_8607fca5-9c1b-4d4d-b119-9328d133a97c/console/0.log" Jun 02 01:56:07.718291 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.718162 2559 generic.go:358] "Generic (PLEG): container finished" podID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerID="dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c" exitCode=2 Jun 02 01:56:07.718291 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.718257 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86765748b9-hbqct" event={"ID":"8607fca5-9c1b-4d4d-b119-9328d133a97c","Type":"ContainerDied","Data":"dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c"} Jun 02 01:56:07.718291 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.718278 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86765748b9-hbqct" event={"ID":"8607fca5-9c1b-4d4d-b119-9328d133a97c","Type":"ContainerDied","Data":"93d563a0b8f58dc4d0ec9dd2facd59eeb2bbea973b8adae9408c1027afca66ca"} Jun 02 01:56:07.718291 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.718291 2559 scope.go:117] "RemoveContainer" containerID="dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c" Jun 02 01:56:07.718417 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.718303 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86765748b9-hbqct" Jun 02 01:56:07.723246 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.723222 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8607fca5-9c1b-4d4d-b119-9328d133a97c-oauth-serving-cert\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:56:07.723337 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.723248 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvpfn\" (UniqueName: \"kubernetes.io/projected/8607fca5-9c1b-4d4d-b119-9328d133a97c-kube-api-access-hvpfn\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:56:07.723337 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.723262 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-serving-cert\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:56:07.723337 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.723276 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8607fca5-9c1b-4d4d-b119-9328d133a97c-console-oauth-config\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:56:07.726935 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.726920 2559 scope.go:117] "RemoveContainer" containerID="dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c" Jun 02 01:56:07.727201 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:56:07.727172 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c\": container with ID starting with dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c not found: ID does not exist" containerID="dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c" Jun 02 01:56:07.727288 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.727207 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c"} err="failed to get container status \"dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c\": rpc error: code = NotFound desc = could not find container \"dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c\": container with ID starting with dba5ab16cc9ddd469dd03748ca8bc5d40e0c5ee41bd94c59aa78a12cd787bf6c not found: ID does not exist" Jun 02 01:56:07.758789 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.758764 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86765748b9-hbqct"] Jun 02 01:56:07.815426 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:07.815375 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86765748b9-hbqct"] Jun 02 01:56:08.759588 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:08.759559 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" path="/var/lib/kubelet/pods/8607fca5-9c1b-4d4d-b119-9328d133a97c/volumes" Jun 02 01:56:35.492069 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.491973 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6744967664-q99b8"] Jun 02 01:56:35.492535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.492516 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" Jun 02 01:56:35.492622 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.492539 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" Jun 02 01:56:35.492671 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.492637 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="8607fca5-9c1b-4d4d-b119-9328d133a97c" containerName="console" Jun 02 01:56:35.495643 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.495621 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.514529 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.514498 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6744967664-q99b8"] Jun 02 01:56:35.652307 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.652267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-trusted-ca-bundle\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.652484 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.652315 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-serving-cert\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.652484 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.652334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-service-ca\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.652484 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.652407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stxxj\" (UniqueName: \"kubernetes.io/projected/b9d783d0-984e-4cf3-845f-809babb4d82e-kube-api-access-stxxj\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.652484 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.652463 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-oauth-serving-cert\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.652619 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.652486 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-oauth-config\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.652619 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.652529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-console-config\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.753517 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.753427 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-serving-cert\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.753517 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.753465 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-service-ca\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.753517 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.753513 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stxxj\" (UniqueName: \"kubernetes.io/projected/b9d783d0-984e-4cf3-845f-809babb4d82e-kube-api-access-stxxj\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.753763 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.753567 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-oauth-serving-cert\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.753763 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.753595 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-oauth-config\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.753763 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.753654 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-console-config\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.753763 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.753684 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-trusted-ca-bundle\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.754439 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.754383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-oauth-serving-cert\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.754439 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.754406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-service-ca\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.754439 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.754406 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-console-config\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.754661 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.754640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-trusted-ca-bundle\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.756026 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.756006 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-oauth-config\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.756152 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.756128 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-serving-cert\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.766371 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.766343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stxxj\" (UniqueName: \"kubernetes.io/projected/b9d783d0-984e-4cf3-845f-809babb4d82e-kube-api-access-stxxj\") pod \"console-6744967664-q99b8\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:35.805719 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:35.805691 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:36.157638 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:36.157603 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6744967664-q99b8"] Jun 02 01:56:36.159406 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:56:36.159382 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d783d0_984e_4cf3_845f_809babb4d82e.slice/crio-2c0f2fe7713a07a6975e88168a4ed9e7507a225a0aaf5d7b3122339d0ed791b3 WatchSource:0}: Error finding container 2c0f2fe7713a07a6975e88168a4ed9e7507a225a0aaf5d7b3122339d0ed791b3: Status 404 returned error can't find the container with id 2c0f2fe7713a07a6975e88168a4ed9e7507a225a0aaf5d7b3122339d0ed791b3 Jun 02 01:56:36.161226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:36.161210 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:56:36.803394 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:36.803357 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6744967664-q99b8" event={"ID":"b9d783d0-984e-4cf3-845f-809babb4d82e","Type":"ContainerStarted","Data":"c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df"} Jun 02 01:56:36.803394 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:36.803395 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6744967664-q99b8" event={"ID":"b9d783d0-984e-4cf3-845f-809babb4d82e","Type":"ContainerStarted","Data":"2c0f2fe7713a07a6975e88168a4ed9e7507a225a0aaf5d7b3122339d0ed791b3"} Jun 02 01:56:36.835370 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:36.835319 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6744967664-q99b8" podStartSLOduration=1.835306442 podStartE2EDuration="1.835306442s" podCreationTimestamp="2026-06-02 01:56:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:56:36.834077713 +0000 UTC m=+358.750208741" watchObservedRunningTime="2026-06-02 01:56:36.835306442 +0000 UTC m=+358.751437468" Jun 02 01:56:45.806015 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:45.805973 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:45.806489 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:45.806030 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:45.810744 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:45.810718 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:45.833799 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:45.833768 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6744967664-q99b8" Jun 02 01:56:45.888008 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:56:45.887976 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6544784f76-hzgk4"] Jun 02 01:57:10.910028 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:10.909983 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6544784f76-hzgk4" podUID="1b00b713-4bf7-404b-9422-68c0b41f58c6" containerName="console" containerID="cri-o://ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a" gracePeriod=15 Jun 02 01:57:11.168887 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.168810 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6544784f76-hzgk4_1b00b713-4bf7-404b-9422-68c0b41f58c6/console/0.log" Jun 02 01:57:11.169035 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.168891 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:57:11.258644 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.258606 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-oauth-config\") pod \"1b00b713-4bf7-404b-9422-68c0b41f58c6\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " Jun 02 01:57:11.258819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.258671 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh6bg\" (UniqueName: \"kubernetes.io/projected/1b00b713-4bf7-404b-9422-68c0b41f58c6-kube-api-access-bh6bg\") pod \"1b00b713-4bf7-404b-9422-68c0b41f58c6\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " Jun 02 01:57:11.258819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.258717 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-config\") pod \"1b00b713-4bf7-404b-9422-68c0b41f58c6\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " Jun 02 01:57:11.258819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.258747 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-service-ca\") pod \"1b00b713-4bf7-404b-9422-68c0b41f58c6\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " Jun 02 01:57:11.258819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.258782 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-oauth-serving-cert\") pod \"1b00b713-4bf7-404b-9422-68c0b41f58c6\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " Jun 02 01:57:11.259014 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.258823 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-trusted-ca-bundle\") pod \"1b00b713-4bf7-404b-9422-68c0b41f58c6\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " Jun 02 01:57:11.259014 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.258848 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-serving-cert\") pod \"1b00b713-4bf7-404b-9422-68c0b41f58c6\" (UID: \"1b00b713-4bf7-404b-9422-68c0b41f58c6\") " Jun 02 01:57:11.259354 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.259256 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "1b00b713-4bf7-404b-9422-68c0b41f58c6" (UID: "1b00b713-4bf7-404b-9422-68c0b41f58c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:57:11.259481 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.259265 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-config" (OuterVolumeSpecName: "console-config") pod "1b00b713-4bf7-404b-9422-68c0b41f58c6" (UID: "1b00b713-4bf7-404b-9422-68c0b41f58c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:57:11.259481 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.259323 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1b00b713-4bf7-404b-9422-68c0b41f58c6" (UID: "1b00b713-4bf7-404b-9422-68c0b41f58c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:57:11.259557 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.259481 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1b00b713-4bf7-404b-9422-68c0b41f58c6" (UID: "1b00b713-4bf7-404b-9422-68c0b41f58c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:57:11.260918 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.260896 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b00b713-4bf7-404b-9422-68c0b41f58c6-kube-api-access-bh6bg" (OuterVolumeSpecName: "kube-api-access-bh6bg") pod "1b00b713-4bf7-404b-9422-68c0b41f58c6" (UID: "1b00b713-4bf7-404b-9422-68c0b41f58c6"). InnerVolumeSpecName "kube-api-access-bh6bg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:57:11.260989 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.260920 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1b00b713-4bf7-404b-9422-68c0b41f58c6" (UID: "1b00b713-4bf7-404b-9422-68c0b41f58c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:57:11.260989 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.260930 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1b00b713-4bf7-404b-9422-68c0b41f58c6" (UID: "1b00b713-4bf7-404b-9422-68c0b41f58c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:57:11.360262 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.360224 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-oauth-config\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:57:11.360262 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.360257 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh6bg\" (UniqueName: \"kubernetes.io/projected/1b00b713-4bf7-404b-9422-68c0b41f58c6-kube-api-access-bh6bg\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:57:11.360262 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.360267 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-config\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:57:11.360490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.360277 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-service-ca\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:57:11.360490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.360285 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-oauth-serving-cert\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:57:11.360490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.360293 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b00b713-4bf7-404b-9422-68c0b41f58c6-trusted-ca-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:57:11.360490 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.360303 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b00b713-4bf7-404b-9422-68c0b41f58c6-console-serving-cert\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:57:11.901736 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.901710 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6544784f76-hzgk4_1b00b713-4bf7-404b-9422-68c0b41f58c6/console/0.log" Jun 02 01:57:11.901917 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.901747 2559 generic.go:358] "Generic (PLEG): container finished" podID="1b00b713-4bf7-404b-9422-68c0b41f58c6" containerID="ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a" exitCode=2 Jun 02 01:57:11.901917 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.901775 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6544784f76-hzgk4" event={"ID":"1b00b713-4bf7-404b-9422-68c0b41f58c6","Type":"ContainerDied","Data":"ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a"} Jun 02 01:57:11.901917 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.901809 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6544784f76-hzgk4" Jun 02 01:57:11.901917 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.901826 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6544784f76-hzgk4" event={"ID":"1b00b713-4bf7-404b-9422-68c0b41f58c6","Type":"ContainerDied","Data":"7f5611d6a7709cf3b41ac0f1b998555a72b92da2338f0f556fed6a123c8f7b57"} Jun 02 01:57:11.901917 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.901844 2559 scope.go:117] "RemoveContainer" containerID="ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a" Jun 02 01:57:11.910281 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.910260 2559 scope.go:117] "RemoveContainer" containerID="ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a" Jun 02 01:57:11.910581 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:57:11.910504 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a\": container with ID starting with ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a not found: ID does not exist" containerID="ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a" Jun 02 01:57:11.910581 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.910531 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a"} err="failed to get container status \"ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a\": rpc error: code = NotFound desc = could not find container \"ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a\": container with ID starting with ac68ca070519e279a5815032589c3fe48a01c4fc51ebf7007bdbe9b92ba4697a not found: ID does not exist" Jun 02 01:57:11.923384 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.923350 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6544784f76-hzgk4"] Jun 02 01:57:11.928654 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:11.928630 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6544784f76-hzgk4"] Jun 02 01:57:12.759963 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:12.759930 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b00b713-4bf7-404b-9422-68c0b41f58c6" path="/var/lib/kubelet/pods/1b00b713-4bf7-404b-9422-68c0b41f58c6/volumes" Jun 02 01:57:43.113580 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.113546 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j"] Jun 02 01:57:43.114009 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.113851 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b00b713-4bf7-404b-9422-68c0b41f58c6" containerName="console" Jun 02 01:57:43.114009 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.113861 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b00b713-4bf7-404b-9422-68c0b41f58c6" containerName="console" Jun 02 01:57:43.114009 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.113924 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="1b00b713-4bf7-404b-9422-68c0b41f58c6" containerName="console" Jun 02 01:57:43.118243 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.118226 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.121550 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.121521 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:57:43.122344 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.122321 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:57:43.122622 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.122607 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9x25v\"" Jun 02 01:57:43.130105 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.130081 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j"] Jun 02 01:57:43.216377 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.216329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.216377 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.216376 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t5d6\" (UniqueName: \"kubernetes.io/projected/873f8768-aca2-4658-980f-e41b82ef7be5-kube-api-access-6t5d6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.216610 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.216406 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.317243 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.317206 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.317243 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.317246 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6t5d6\" (UniqueName: \"kubernetes.io/projected/873f8768-aca2-4658-980f-e41b82ef7be5-kube-api-access-6t5d6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.317447 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.317432 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.317588 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.317570 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.317711 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.317697 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.326520 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.326490 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t5d6\" (UniqueName: \"kubernetes.io/projected/873f8768-aca2-4658-980f-e41b82ef7be5-kube-api-access-6t5d6\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.429833 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.429751 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:57:43.759750 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.759717 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j"] Jun 02 01:57:43.763403 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:57:43.763378 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod873f8768_aca2_4658_980f_e41b82ef7be5.slice/crio-965fbe442563d270ffc1ad45ef581c9ea969a922af2271c10f17d8d21b9afd1e WatchSource:0}: Error finding container 965fbe442563d270ffc1ad45ef581c9ea969a922af2271c10f17d8d21b9afd1e: Status 404 returned error can't find the container with id 965fbe442563d270ffc1ad45ef581c9ea969a922af2271c10f17d8d21b9afd1e Jun 02 01:57:44.000016 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:43.999984 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" event={"ID":"873f8768-aca2-4658-980f-e41b82ef7be5","Type":"ContainerStarted","Data":"965fbe442563d270ffc1ad45ef581c9ea969a922af2271c10f17d8d21b9afd1e"} Jun 02 01:57:50.019193 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:50.019157 2559 generic.go:358] "Generic (PLEG): container finished" podID="873f8768-aca2-4658-980f-e41b82ef7be5" containerID="8fde8d2bacc9d42f6159e5cd36c1961b5312fbb5c9a0b210bdcfa22944e9ccba" exitCode=0 Jun 02 01:57:50.019557 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:50.019233 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" event={"ID":"873f8768-aca2-4658-980f-e41b82ef7be5","Type":"ContainerDied","Data":"8fde8d2bacc9d42f6159e5cd36c1961b5312fbb5c9a0b210bdcfa22944e9ccba"} Jun 02 01:57:53.034041 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:53.034003 2559 generic.go:358] "Generic (PLEG): container finished" podID="873f8768-aca2-4658-980f-e41b82ef7be5" containerID="f40cc2da9096052bb7c8e0f0a133ef6921084f371dc40f6441b6d542b63c75c7" exitCode=0 Jun 02 01:57:53.034431 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:57:53.034091 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" event={"ID":"873f8768-aca2-4658-980f-e41b82ef7be5","Type":"ContainerDied","Data":"f40cc2da9096052bb7c8e0f0a133ef6921084f371dc40f6441b6d542b63c75c7"} Jun 02 01:58:00.057720 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:00.057686 2559 generic.go:358] "Generic (PLEG): container finished" podID="873f8768-aca2-4658-980f-e41b82ef7be5" containerID="4aafeaf8ceda01a70867fd0988ae10f019ae013c390dd311c228b8137835704c" exitCode=0 Jun 02 01:58:00.058018 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:00.057752 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" event={"ID":"873f8768-aca2-4658-980f-e41b82ef7be5","Type":"ContainerDied","Data":"4aafeaf8ceda01a70867fd0988ae10f019ae013c390dd311c228b8137835704c"} Jun 02 01:58:01.200819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.200794 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:58:01.276016 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.275979 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-bundle\") pod \"873f8768-aca2-4658-980f-e41b82ef7be5\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " Jun 02 01:58:01.276210 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.276054 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-util\") pod \"873f8768-aca2-4658-980f-e41b82ef7be5\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " Jun 02 01:58:01.276210 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.276109 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6t5d6\" (UniqueName: \"kubernetes.io/projected/873f8768-aca2-4658-980f-e41b82ef7be5-kube-api-access-6t5d6\") pod \"873f8768-aca2-4658-980f-e41b82ef7be5\" (UID: \"873f8768-aca2-4658-980f-e41b82ef7be5\") " Jun 02 01:58:01.276647 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.276620 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-bundle" (OuterVolumeSpecName: "bundle") pod "873f8768-aca2-4658-980f-e41b82ef7be5" (UID: "873f8768-aca2-4658-980f-e41b82ef7be5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:58:01.278162 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.278131 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/873f8768-aca2-4658-980f-e41b82ef7be5-kube-api-access-6t5d6" (OuterVolumeSpecName: "kube-api-access-6t5d6") pod "873f8768-aca2-4658-980f-e41b82ef7be5" (UID: "873f8768-aca2-4658-980f-e41b82ef7be5"). InnerVolumeSpecName "kube-api-access-6t5d6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:58:01.281222 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.281199 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-util" (OuterVolumeSpecName: "util") pod "873f8768-aca2-4658-980f-e41b82ef7be5" (UID: "873f8768-aca2-4658-980f-e41b82ef7be5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:58:01.377253 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.377167 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:01.377253 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.377198 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/873f8768-aca2-4658-980f-e41b82ef7be5-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:01.377253 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:01.377210 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6t5d6\" (UniqueName: \"kubernetes.io/projected/873f8768-aca2-4658-980f-e41b82ef7be5-kube-api-access-6t5d6\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:02.066037 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:02.066004 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" event={"ID":"873f8768-aca2-4658-980f-e41b82ef7be5","Type":"ContainerDied","Data":"965fbe442563d270ffc1ad45ef581c9ea969a922af2271c10f17d8d21b9afd1e"} Jun 02 01:58:02.066037 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:02.066037 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="965fbe442563d270ffc1ad45ef581c9ea969a922af2271c10f17d8d21b9afd1e" Jun 02 01:58:02.066243 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:02.066044 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkfg4j" Jun 02 01:58:06.234055 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.234022 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb"] Jun 02 01:58:06.234553 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.234396 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="873f8768-aca2-4658-980f-e41b82ef7be5" containerName="pull" Jun 02 01:58:06.234553 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.234409 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="873f8768-aca2-4658-980f-e41b82ef7be5" containerName="pull" Jun 02 01:58:06.234553 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.234416 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="873f8768-aca2-4658-980f-e41b82ef7be5" containerName="util" Jun 02 01:58:06.234553 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.234421 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="873f8768-aca2-4658-980f-e41b82ef7be5" containerName="util" Jun 02 01:58:06.234553 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.234434 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="873f8768-aca2-4658-980f-e41b82ef7be5" containerName="extract" Jun 02 01:58:06.234553 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.234439 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="873f8768-aca2-4658-980f-e41b82ef7be5" containerName="extract" Jun 02 01:58:06.234553 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.234491 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="873f8768-aca2-4658-980f-e41b82ef7be5" containerName="extract" Jun 02 01:58:06.238229 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.238213 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" Jun 02 01:58:06.241009 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.240993 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:58:06.241333 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.241314 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 01:58:06.241995 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.241979 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jfkzc\"" Jun 02 01:58:06.253777 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.253751 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb"] Jun 02 01:58:06.321023 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.320987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl4xj\" (UniqueName: \"kubernetes.io/projected/200432e8-018d-4ddd-9fc3-b0c326549181-kube-api-access-bl4xj\") pod \"cert-manager-operator-controller-manager-54b9655956-67lwb\" (UID: \"200432e8-018d-4ddd-9fc3-b0c326549181\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" Jun 02 01:58:06.321222 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.321050 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/200432e8-018d-4ddd-9fc3-b0c326549181-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-67lwb\" (UID: \"200432e8-018d-4ddd-9fc3-b0c326549181\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" Jun 02 01:58:06.422354 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.422298 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bl4xj\" (UniqueName: \"kubernetes.io/projected/200432e8-018d-4ddd-9fc3-b0c326549181-kube-api-access-bl4xj\") pod \"cert-manager-operator-controller-manager-54b9655956-67lwb\" (UID: \"200432e8-018d-4ddd-9fc3-b0c326549181\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" Jun 02 01:58:06.422547 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.422400 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/200432e8-018d-4ddd-9fc3-b0c326549181-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-67lwb\" (UID: \"200432e8-018d-4ddd-9fc3-b0c326549181\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" Jun 02 01:58:06.422819 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.422796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/200432e8-018d-4ddd-9fc3-b0c326549181-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-67lwb\" (UID: \"200432e8-018d-4ddd-9fc3-b0c326549181\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" Jun 02 01:58:06.431478 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.431443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl4xj\" (UniqueName: \"kubernetes.io/projected/200432e8-018d-4ddd-9fc3-b0c326549181-kube-api-access-bl4xj\") pod \"cert-manager-operator-controller-manager-54b9655956-67lwb\" (UID: \"200432e8-018d-4ddd-9fc3-b0c326549181\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" Jun 02 01:58:06.547058 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.546967 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" Jun 02 01:58:06.891906 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:06.891832 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb"] Jun 02 01:58:06.894945 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:58:06.894908 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200432e8_018d_4ddd_9fc3_b0c326549181.slice/crio-1fe9ee8988291ce0e5bda29cc69af1853d2b66776f8126c5a9a848b25c35c221 WatchSource:0}: Error finding container 1fe9ee8988291ce0e5bda29cc69af1853d2b66776f8126c5a9a848b25c35c221: Status 404 returned error can't find the container with id 1fe9ee8988291ce0e5bda29cc69af1853d2b66776f8126c5a9a848b25c35c221 Jun 02 01:58:07.083028 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:07.082992 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" event={"ID":"200432e8-018d-4ddd-9fc3-b0c326549181","Type":"ContainerStarted","Data":"1fe9ee8988291ce0e5bda29cc69af1853d2b66776f8126c5a9a848b25c35c221"} Jun 02 01:58:09.092658 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:09.092618 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" event={"ID":"200432e8-018d-4ddd-9fc3-b0c326549181","Type":"ContainerStarted","Data":"ae332eedbc3eae93e5a83243d457fa1ce91168f0bbaffb86c4b7d664607dad23"} Jun 02 01:58:09.136569 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:09.136500 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-67lwb" podStartSLOduration=1.443713302 podStartE2EDuration="3.136480717s" podCreationTimestamp="2026-06-02 01:58:06 +0000 UTC" firstStartedPulling="2026-06-02 01:58:06.897306059 +0000 UTC m=+448.813437065" lastFinishedPulling="2026-06-02 01:58:08.590073472 +0000 UTC m=+450.506204480" observedRunningTime="2026-06-02 01:58:09.13398125 +0000 UTC m=+451.050112288" watchObservedRunningTime="2026-06-02 01:58:09.136480717 +0000 UTC m=+451.052611755" Jun 02 01:58:10.261356 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.261319 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5"] Jun 02 01:58:10.263907 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.263892 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.267175 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.267123 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9x25v\"" Jun 02 01:58:10.267287 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.267249 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:58:10.268076 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.268055 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:58:10.273884 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.273860 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5"] Jun 02 01:58:10.359883 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.359835 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.359883 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.359884 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.360115 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.359966 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tblcd\" (UniqueName: \"kubernetes.io/projected/dc114e3b-885d-4659-98f1-fe38c1971348-kube-api-access-tblcd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.461217 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.461174 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.461217 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.461220 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.461466 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.461266 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tblcd\" (UniqueName: \"kubernetes.io/projected/dc114e3b-885d-4659-98f1-fe38c1971348-kube-api-access-tblcd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.461563 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.461541 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.461612 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.461575 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.471914 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.471891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tblcd\" (UniqueName: \"kubernetes.io/projected/dc114e3b-885d-4659-98f1-fe38c1971348-kube-api-access-tblcd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.573908 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.573826 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:10.704041 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.704011 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5"] Jun 02 01:58:10.707167 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:58:10.707126 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc114e3b_885d_4659_98f1_fe38c1971348.slice/crio-3f8dd2d2f43f7c02a38ce8537dc7f8c03885a4fac1a712f284dbd5367f9cf3f1 WatchSource:0}: Error finding container 3f8dd2d2f43f7c02a38ce8537dc7f8c03885a4fac1a712f284dbd5367f9cf3f1: Status 404 returned error can't find the container with id 3f8dd2d2f43f7c02a38ce8537dc7f8c03885a4fac1a712f284dbd5367f9cf3f1 Jun 02 01:58:10.843763 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.843697 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v6lcc"] Jun 02 01:58:10.847843 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.847792 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:10.867335 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.867302 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-w8r24\"" Jun 02 01:58:10.868597 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.868576 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 01:58:10.868794 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.868773 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 01:58:10.870056 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.870032 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v6lcc"] Jun 02 01:58:10.964352 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.964305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hpzr\" (UniqueName: \"kubernetes.io/projected/8ca9ce10-5dfe-4434-809e-2145abb1f2e6-kube-api-access-9hpzr\") pod \"cert-manager-webhook-587ccfb98-v6lcc\" (UID: \"8ca9ce10-5dfe-4434-809e-2145abb1f2e6\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:10.964558 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:10.964433 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ca9ce10-5dfe-4434-809e-2145abb1f2e6-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v6lcc\" (UID: \"8ca9ce10-5dfe-4434-809e-2145abb1f2e6\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:11.065127 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.065087 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9hpzr\" (UniqueName: \"kubernetes.io/projected/8ca9ce10-5dfe-4434-809e-2145abb1f2e6-kube-api-access-9hpzr\") pod \"cert-manager-webhook-587ccfb98-v6lcc\" (UID: \"8ca9ce10-5dfe-4434-809e-2145abb1f2e6\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:11.065315 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.065194 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ca9ce10-5dfe-4434-809e-2145abb1f2e6-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v6lcc\" (UID: \"8ca9ce10-5dfe-4434-809e-2145abb1f2e6\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:11.077964 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.077936 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8ca9ce10-5dfe-4434-809e-2145abb1f2e6-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-v6lcc\" (UID: \"8ca9ce10-5dfe-4434-809e-2145abb1f2e6\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:11.088206 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.088181 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hpzr\" (UniqueName: \"kubernetes.io/projected/8ca9ce10-5dfe-4434-809e-2145abb1f2e6-kube-api-access-9hpzr\") pod \"cert-manager-webhook-587ccfb98-v6lcc\" (UID: \"8ca9ce10-5dfe-4434-809e-2145abb1f2e6\") " pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:11.100915 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.100853 2559 generic.go:358] "Generic (PLEG): container finished" podID="dc114e3b-885d-4659-98f1-fe38c1971348" containerID="2459923a96b9e34df91998a8fe795f1da0683bc55ba816b22e22ca539144985e" exitCode=0 Jun 02 01:58:11.101014 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.100938 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" event={"ID":"dc114e3b-885d-4659-98f1-fe38c1971348","Type":"ContainerDied","Data":"2459923a96b9e34df91998a8fe795f1da0683bc55ba816b22e22ca539144985e"} Jun 02 01:58:11.101014 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.100972 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" event={"ID":"dc114e3b-885d-4659-98f1-fe38c1971348","Type":"ContainerStarted","Data":"3f8dd2d2f43f7c02a38ce8537dc7f8c03885a4fac1a712f284dbd5367f9cf3f1"} Jun 02 01:58:11.195390 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.195356 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:11.322046 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:11.322020 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-v6lcc"] Jun 02 01:58:11.324502 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:58:11.324473 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ca9ce10_5dfe_4434_809e_2145abb1f2e6.slice/crio-17ec5c31e79e67c5b45a821e74d9f707c723e163f3bd74fdf3fe5f98c2945675 WatchSource:0}: Error finding container 17ec5c31e79e67c5b45a821e74d9f707c723e163f3bd74fdf3fe5f98c2945675: Status 404 returned error can't find the container with id 17ec5c31e79e67c5b45a821e74d9f707c723e163f3bd74fdf3fe5f98c2945675 Jun 02 01:58:12.105948 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:12.105915 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" event={"ID":"8ca9ce10-5dfe-4434-809e-2145abb1f2e6","Type":"ContainerStarted","Data":"17ec5c31e79e67c5b45a821e74d9f707c723e163f3bd74fdf3fe5f98c2945675"} Jun 02 01:58:15.119049 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:15.119008 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" event={"ID":"8ca9ce10-5dfe-4434-809e-2145abb1f2e6","Type":"ContainerStarted","Data":"730bbaed113a5f779439186850b8e0a9970c5e26f613d9b4c5a456c61435654b"} Jun 02 01:58:15.119049 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:15.119052 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:15.120531 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:15.120509 2559 generic.go:358] "Generic (PLEG): container finished" podID="dc114e3b-885d-4659-98f1-fe38c1971348" containerID="9ecdeefab8a5826512054c7180074bb554118bd6724d77a9b80908a5fb082f94" exitCode=0 Jun 02 01:58:15.120642 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:15.120567 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" event={"ID":"dc114e3b-885d-4659-98f1-fe38c1971348","Type":"ContainerDied","Data":"9ecdeefab8a5826512054c7180074bb554118bd6724d77a9b80908a5fb082f94"} Jun 02 01:58:15.136806 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:15.136744 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" podStartSLOduration=2.15056509 podStartE2EDuration="5.136731134s" podCreationTimestamp="2026-06-02 01:58:10 +0000 UTC" firstStartedPulling="2026-06-02 01:58:11.326266769 +0000 UTC m=+453.242397780" lastFinishedPulling="2026-06-02 01:58:14.312432816 +0000 UTC m=+456.228563824" observedRunningTime="2026-06-02 01:58:15.136551173 +0000 UTC m=+457.052682202" watchObservedRunningTime="2026-06-02 01:58:15.136731134 +0000 UTC m=+457.052862163" Jun 02 01:58:16.126708 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:16.126621 2559 generic.go:358] "Generic (PLEG): container finished" podID="dc114e3b-885d-4659-98f1-fe38c1971348" containerID="aa526a000b43c21520935932f12a3388c4056f6c860ec5bad9efedce3ec04ac0" exitCode=0 Jun 02 01:58:16.127064 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:16.126704 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" event={"ID":"dc114e3b-885d-4659-98f1-fe38c1971348","Type":"ContainerDied","Data":"aa526a000b43c21520935932f12a3388c4056f6c860ec5bad9efedce3ec04ac0"} Jun 02 01:58:17.254355 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.254329 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:17.423385 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.423299 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tblcd\" (UniqueName: \"kubernetes.io/projected/dc114e3b-885d-4659-98f1-fe38c1971348-kube-api-access-tblcd\") pod \"dc114e3b-885d-4659-98f1-fe38c1971348\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " Jun 02 01:58:17.423385 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.423375 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-util\") pod \"dc114e3b-885d-4659-98f1-fe38c1971348\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " Jun 02 01:58:17.423595 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.423399 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-bundle\") pod \"dc114e3b-885d-4659-98f1-fe38c1971348\" (UID: \"dc114e3b-885d-4659-98f1-fe38c1971348\") " Jun 02 01:58:17.423850 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.423825 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-bundle" (OuterVolumeSpecName: "bundle") pod "dc114e3b-885d-4659-98f1-fe38c1971348" (UID: "dc114e3b-885d-4659-98f1-fe38c1971348"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:58:17.425355 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.425332 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc114e3b-885d-4659-98f1-fe38c1971348-kube-api-access-tblcd" (OuterVolumeSpecName: "kube-api-access-tblcd") pod "dc114e3b-885d-4659-98f1-fe38c1971348" (UID: "dc114e3b-885d-4659-98f1-fe38c1971348"). InnerVolumeSpecName "kube-api-access-tblcd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:58:17.428277 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.428240 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-util" (OuterVolumeSpecName: "util") pod "dc114e3b-885d-4659-98f1-fe38c1971348" (UID: "dc114e3b-885d-4659-98f1-fe38c1971348"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:58:17.524100 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.524059 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tblcd\" (UniqueName: \"kubernetes.io/projected/dc114e3b-885d-4659-98f1-fe38c1971348-kube-api-access-tblcd\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:17.524100 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.524092 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:17.524100 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:17.524103 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc114e3b-885d-4659-98f1-fe38c1971348-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:18.134925 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:18.134887 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" event={"ID":"dc114e3b-885d-4659-98f1-fe38c1971348","Type":"ContainerDied","Data":"3f8dd2d2f43f7c02a38ce8537dc7f8c03885a4fac1a712f284dbd5367f9cf3f1"} Jun 02 01:58:18.134925 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:18.134924 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f8dd2d2f43f7c02a38ce8537dc7f8c03885a4fac1a712f284dbd5367f9cf3f1" Jun 02 01:58:18.135132 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:18.134946 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dcv5" Jun 02 01:58:21.132745 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:21.132707 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-v6lcc" Jun 02 01:58:28.054627 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.054594 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq"] Jun 02 01:58:28.054986 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.054910 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc114e3b-885d-4659-98f1-fe38c1971348" containerName="extract" Jun 02 01:58:28.054986 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.054920 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc114e3b-885d-4659-98f1-fe38c1971348" containerName="extract" Jun 02 01:58:28.054986 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.054930 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc114e3b-885d-4659-98f1-fe38c1971348" containerName="pull" Jun 02 01:58:28.054986 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.054936 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc114e3b-885d-4659-98f1-fe38c1971348" containerName="pull" Jun 02 01:58:28.054986 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.054964 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc114e3b-885d-4659-98f1-fe38c1971348" containerName="util" Jun 02 01:58:28.054986 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.054971 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc114e3b-885d-4659-98f1-fe38c1971348" containerName="util" Jun 02 01:58:28.055211 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.055024 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc114e3b-885d-4659-98f1-fe38c1971348" containerName="extract" Jun 02 01:58:28.058258 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.058230 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" Jun 02 01:58:28.061151 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.061120 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 01:58:28.062111 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.062092 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-8q6jc\"" Jun 02 01:58:28.062232 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.062157 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:58:28.065804 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.065783 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq"] Jun 02 01:58:28.219226 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.219186 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qsdc\" (UniqueName: \"kubernetes.io/projected/1b770d04-2a68-48d8-8a1c-0f0497dbe836-kube-api-access-9qsdc\") pod \"openshift-lws-operator-bfc7f696d-z7vqq\" (UID: \"1b770d04-2a68-48d8-8a1c-0f0497dbe836\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" Jun 02 01:58:28.219403 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.219274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b770d04-2a68-48d8-8a1c-0f0497dbe836-tmp\") pod \"openshift-lws-operator-bfc7f696d-z7vqq\" (UID: \"1b770d04-2a68-48d8-8a1c-0f0497dbe836\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" Jun 02 01:58:28.320656 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.320561 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b770d04-2a68-48d8-8a1c-0f0497dbe836-tmp\") pod \"openshift-lws-operator-bfc7f696d-z7vqq\" (UID: \"1b770d04-2a68-48d8-8a1c-0f0497dbe836\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" Jun 02 01:58:28.320656 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.320628 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qsdc\" (UniqueName: \"kubernetes.io/projected/1b770d04-2a68-48d8-8a1c-0f0497dbe836-kube-api-access-9qsdc\") pod \"openshift-lws-operator-bfc7f696d-z7vqq\" (UID: \"1b770d04-2a68-48d8-8a1c-0f0497dbe836\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" Jun 02 01:58:28.320991 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.320968 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b770d04-2a68-48d8-8a1c-0f0497dbe836-tmp\") pod \"openshift-lws-operator-bfc7f696d-z7vqq\" (UID: \"1b770d04-2a68-48d8-8a1c-0f0497dbe836\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" Jun 02 01:58:28.328908 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.328871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qsdc\" (UniqueName: \"kubernetes.io/projected/1b770d04-2a68-48d8-8a1c-0f0497dbe836-kube-api-access-9qsdc\") pod \"openshift-lws-operator-bfc7f696d-z7vqq\" (UID: \"1b770d04-2a68-48d8-8a1c-0f0497dbe836\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" Jun 02 01:58:28.368572 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.368536 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" Jun 02 01:58:28.493454 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:28.493428 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq"] Jun 02 01:58:28.495659 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:58:28.495631 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b770d04_2a68_48d8_8a1c_0f0497dbe836.slice/crio-ba6df1e81f53d00bdc5cbd0d174de48ac678eef59865f63e763fbc55c9003f24 WatchSource:0}: Error finding container ba6df1e81f53d00bdc5cbd0d174de48ac678eef59865f63e763fbc55c9003f24: Status 404 returned error can't find the container with id ba6df1e81f53d00bdc5cbd0d174de48ac678eef59865f63e763fbc55c9003f24 Jun 02 01:58:29.173382 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:29.173336 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" event={"ID":"1b770d04-2a68-48d8-8a1c-0f0497dbe836","Type":"ContainerStarted","Data":"ba6df1e81f53d00bdc5cbd0d174de48ac678eef59865f63e763fbc55c9003f24"} Jun 02 01:58:32.185581 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:32.185537 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" event={"ID":"1b770d04-2a68-48d8-8a1c-0f0497dbe836","Type":"ContainerStarted","Data":"810d943e31693e83dc90c853f1748ad0cbb5e557e8777444cdaf412103adcadf"} Jun 02 01:58:32.202778 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:32.202714 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-z7vqq" podStartSLOduration=0.650189296 podStartE2EDuration="4.202698265s" podCreationTimestamp="2026-06-02 01:58:28 +0000 UTC" firstStartedPulling="2026-06-02 01:58:28.497695254 +0000 UTC m=+470.413826264" lastFinishedPulling="2026-06-02 01:58:32.050204212 +0000 UTC m=+473.966335233" observedRunningTime="2026-06-02 01:58:32.201374594 +0000 UTC m=+474.117505623" watchObservedRunningTime="2026-06-02 01:58:32.202698265 +0000 UTC m=+474.118829295" Jun 02 01:58:35.675927 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.675897 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9"] Jun 02 01:58:35.678629 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.678613 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.681579 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.681555 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:58:35.682694 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.682677 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:58:35.682755 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.682676 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9x25v\"" Jun 02 01:58:35.687534 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.687512 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9"] Jun 02 01:58:35.781596 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.781565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2xfw\" (UniqueName: \"kubernetes.io/projected/c657f8b8-0129-46c3-affc-a888fdfd4bd4-kube-api-access-k2xfw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.781771 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.781609 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.781771 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.781759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.882937 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.882905 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.883094 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.882951 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2xfw\" (UniqueName: \"kubernetes.io/projected/c657f8b8-0129-46c3-affc-a888fdfd4bd4-kube-api-access-k2xfw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.883094 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.882973 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.883311 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.883294 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.883355 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.883309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.891181 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.891154 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2xfw\" (UniqueName: \"kubernetes.io/projected/c657f8b8-0129-46c3-affc-a888fdfd4bd4-kube-api-access-k2xfw\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:35.988413 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:35.988378 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:36.117208 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:36.117184 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9"] Jun 02 01:58:36.117576 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:58:36.117554 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc657f8b8_0129_46c3_affc_a888fdfd4bd4.slice/crio-b2fbbd20227e7d5324190bc5f0c60eb4de0c2e41775f5c6ab3b284a285157974 WatchSource:0}: Error finding container b2fbbd20227e7d5324190bc5f0c60eb4de0c2e41775f5c6ab3b284a285157974: Status 404 returned error can't find the container with id b2fbbd20227e7d5324190bc5f0c60eb4de0c2e41775f5c6ab3b284a285157974 Jun 02 01:58:36.199868 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:36.199839 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" event={"ID":"c657f8b8-0129-46c3-affc-a888fdfd4bd4","Type":"ContainerStarted","Data":"9298c64788f420ce038ca41f682d28fcbc8740575fd33a7bdbbfb66f9a76bf1c"} Jun 02 01:58:36.199868 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:36.199877 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" event={"ID":"c657f8b8-0129-46c3-affc-a888fdfd4bd4","Type":"ContainerStarted","Data":"b2fbbd20227e7d5324190bc5f0c60eb4de0c2e41775f5c6ab3b284a285157974"} Jun 02 01:58:37.204566 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:37.204484 2559 generic.go:358] "Generic (PLEG): container finished" podID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerID="9298c64788f420ce038ca41f682d28fcbc8740575fd33a7bdbbfb66f9a76bf1c" exitCode=0 Jun 02 01:58:37.204902 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:37.204569 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" event={"ID":"c657f8b8-0129-46c3-affc-a888fdfd4bd4","Type":"ContainerDied","Data":"9298c64788f420ce038ca41f682d28fcbc8740575fd33a7bdbbfb66f9a76bf1c"} Jun 02 01:58:38.209777 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:38.209689 2559 generic.go:358] "Generic (PLEG): container finished" podID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerID="af325c5f6a8a7ec97edbd9e4ee8c326a8553e90f8ae5b5b1663930bb34dbaf62" exitCode=0 Jun 02 01:58:38.210131 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:38.209771 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" event={"ID":"c657f8b8-0129-46c3-affc-a888fdfd4bd4","Type":"ContainerDied","Data":"af325c5f6a8a7ec97edbd9e4ee8c326a8553e90f8ae5b5b1663930bb34dbaf62"} Jun 02 01:58:39.214829 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:39.214791 2559 generic.go:358] "Generic (PLEG): container finished" podID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerID="8af4802f4a5bf44c324476a11baebd7a2fd5b2e78bb28296b00c29f27758dee0" exitCode=0 Jun 02 01:58:39.215270 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:39.214877 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" event={"ID":"c657f8b8-0129-46c3-affc-a888fdfd4bd4","Type":"ContainerDied","Data":"8af4802f4a5bf44c324476a11baebd7a2fd5b2e78bb28296b00c29f27758dee0"} Jun 02 01:58:40.337467 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.337446 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:40.422570 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.422530 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-util\") pod \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " Jun 02 01:58:40.422753 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.422616 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-bundle\") pod \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " Jun 02 01:58:40.422753 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.422703 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2xfw\" (UniqueName: \"kubernetes.io/projected/c657f8b8-0129-46c3-affc-a888fdfd4bd4-kube-api-access-k2xfw\") pod \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\" (UID: \"c657f8b8-0129-46c3-affc-a888fdfd4bd4\") " Jun 02 01:58:40.423398 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.423374 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-bundle" (OuterVolumeSpecName: "bundle") pod "c657f8b8-0129-46c3-affc-a888fdfd4bd4" (UID: "c657f8b8-0129-46c3-affc-a888fdfd4bd4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:58:40.424735 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.424703 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c657f8b8-0129-46c3-affc-a888fdfd4bd4-kube-api-access-k2xfw" (OuterVolumeSpecName: "kube-api-access-k2xfw") pod "c657f8b8-0129-46c3-affc-a888fdfd4bd4" (UID: "c657f8b8-0129-46c3-affc-a888fdfd4bd4"). InnerVolumeSpecName "kube-api-access-k2xfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:58:40.430661 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.430620 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-util" (OuterVolumeSpecName: "util") pod "c657f8b8-0129-46c3-affc-a888fdfd4bd4" (UID: "c657f8b8-0129-46c3-affc-a888fdfd4bd4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:58:40.523833 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.523789 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:40.523833 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.523832 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2xfw\" (UniqueName: \"kubernetes.io/projected/c657f8b8-0129-46c3-affc-a888fdfd4bd4-kube-api-access-k2xfw\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:40.523833 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:40.523842 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c657f8b8-0129-46c3-affc-a888fdfd4bd4-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:58:41.223207 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:41.223176 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" event={"ID":"c657f8b8-0129-46c3-affc-a888fdfd4bd4","Type":"ContainerDied","Data":"b2fbbd20227e7d5324190bc5f0c60eb4de0c2e41775f5c6ab3b284a285157974"} Jun 02 01:58:41.223207 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:41.223208 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2fbbd20227e7d5324190bc5f0c60eb4de0c2e41775f5c6ab3b284a285157974" Jun 02 01:58:41.223420 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:41.223225 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdbcrl9" Jun 02 01:58:48.313723 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.313693 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs"] Jun 02 01:58:48.314183 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.314037 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerName="util" Jun 02 01:58:48.314183 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.314050 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerName="util" Jun 02 01:58:48.314183 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.314067 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerName="pull" Jun 02 01:58:48.314183 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.314072 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerName="pull" Jun 02 01:58:48.314183 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.314081 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerName="extract" Jun 02 01:58:48.314183 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.314086 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerName="extract" Jun 02 01:58:48.314183 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.314151 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="c657f8b8-0129-46c3-affc-a888fdfd4bd4" containerName="extract" Jun 02 01:58:48.318056 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.318038 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.322080 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.322055 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 01:58:48.322192 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.322172 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 01:58:48.322441 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.322417 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pb8p4\"" Jun 02 01:58:48.322535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.322443 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 01:58:48.322535 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.322474 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 01:58:48.337307 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.337284 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs"] Jun 02 01:58:48.393185 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.393130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.393321 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.393190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.393321 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.393240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.393321 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.393256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.393422 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.393323 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hscln\" (UniqueName: \"kubernetes.io/projected/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-kube-api-access-hscln\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.494625 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.494594 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.494625 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.494628 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.494843 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.494656 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hscln\" (UniqueName: \"kubernetes.io/projected/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-kube-api-access-hscln\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.494843 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.494690 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.494843 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.494713 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.495090 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.495067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-manifests\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.496799 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.496778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-tmp\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.497011 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.496995 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.497076 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.497031 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.526255 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.526226 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hscln\" (UniqueName: \"kubernetes.io/projected/3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a-kube-api-access-hscln\") pod \"opendatahub-operator-controller-manager-6c568bd5f7-xpxfs\" (UID: \"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a\") " pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.628112 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.628029 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:48.764128 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:48.764102 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs"] Jun 02 01:58:48.766457 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:58:48.766423 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3eddee_e4d8_4d8e_bee5_6c5f2a4f8c6a.slice/crio-751ca7162162b61b5d858985a3d85c189ae542426fdfbce5efa36179aaa1c331 WatchSource:0}: Error finding container 751ca7162162b61b5d858985a3d85c189ae542426fdfbce5efa36179aaa1c331: Status 404 returned error can't find the container with id 751ca7162162b61b5d858985a3d85c189ae542426fdfbce5efa36179aaa1c331 Jun 02 01:58:49.251542 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:49.251505 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" event={"ID":"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a","Type":"ContainerStarted","Data":"751ca7162162b61b5d858985a3d85c189ae542426fdfbce5efa36179aaa1c331"} Jun 02 01:58:52.267404 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:52.267364 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" event={"ID":"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a","Type":"ContainerStarted","Data":"e2dfd3cc30401e30d85c4ae4ae6e5ff2bc8314e2dd308bc25e73b8d11c1fdaf6"} Jun 02 01:58:53.272361 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:53.272323 2559 generic.go:358] "Generic (PLEG): container finished" podID="3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a" containerID="e2dfd3cc30401e30d85c4ae4ae6e5ff2bc8314e2dd308bc25e73b8d11c1fdaf6" exitCode=0 Jun 02 01:58:53.272793 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:53.272380 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" event={"ID":"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a","Type":"ContainerDied","Data":"e2dfd3cc30401e30d85c4ae4ae6e5ff2bc8314e2dd308bc25e73b8d11c1fdaf6"} Jun 02 01:58:54.277567 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:54.277527 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" event={"ID":"3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a","Type":"ContainerStarted","Data":"ff06044dc983dc7522294177017fce7ae2ad005ea9eb56eea3ec7453bc84680b"} Jun 02 01:58:54.277943 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:54.277604 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:58:54.340302 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:58:54.340237 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" podStartSLOduration=1.5467459890000002 podStartE2EDuration="6.340217886s" podCreationTimestamp="2026-06-02 01:58:48 +0000 UTC" firstStartedPulling="2026-06-02 01:58:48.768018732 +0000 UTC m=+490.684149738" lastFinishedPulling="2026-06-02 01:58:53.561490629 +0000 UTC m=+495.477621635" observedRunningTime="2026-06-02 01:58:54.334718143 +0000 UTC m=+496.250849219" watchObservedRunningTime="2026-06-02 01:58:54.340217886 +0000 UTC m=+496.256348914" Jun 02 01:59:05.283719 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:05.283680 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c568bd5f7-xpxfs" Jun 02 01:59:08.090691 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.090656 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-zc8fk"] Jun 02 01:59:08.095965 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.095947 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:08.100570 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.100553 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 01:59:08.102607 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.102584 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-t94s5\"" Jun 02 01:59:08.107251 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.107229 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-zc8fk"] Jun 02 01:59:08.273066 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.273030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fb84100-b99e-455e-8929-3593639aba8c-cert\") pod \"odh-model-controller-76588b95-zc8fk\" (UID: \"6fb84100-b99e-455e-8929-3593639aba8c\") " pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:08.273232 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.273133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8dfb\" (UniqueName: \"kubernetes.io/projected/6fb84100-b99e-455e-8929-3593639aba8c-kube-api-access-m8dfb\") pod \"odh-model-controller-76588b95-zc8fk\" (UID: \"6fb84100-b99e-455e-8929-3593639aba8c\") " pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:08.374418 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.374323 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8dfb\" (UniqueName: \"kubernetes.io/projected/6fb84100-b99e-455e-8929-3593639aba8c-kube-api-access-m8dfb\") pod \"odh-model-controller-76588b95-zc8fk\" (UID: \"6fb84100-b99e-455e-8929-3593639aba8c\") " pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:08.374418 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.374399 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fb84100-b99e-455e-8929-3593639aba8c-cert\") pod \"odh-model-controller-76588b95-zc8fk\" (UID: \"6fb84100-b99e-455e-8929-3593639aba8c\") " pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:08.374637 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:59:08.374487 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 01:59:08.374637 ip-10-0-135-96 kubenswrapper[2559]: E0602 01:59:08.374558 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fb84100-b99e-455e-8929-3593639aba8c-cert podName:6fb84100-b99e-455e-8929-3593639aba8c nodeName:}" failed. No retries permitted until 2026-06-02 01:59:08.874542414 +0000 UTC m=+510.790673420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6fb84100-b99e-455e-8929-3593639aba8c-cert") pod "odh-model-controller-76588b95-zc8fk" (UID: "6fb84100-b99e-455e-8929-3593639aba8c") : secret "odh-model-controller-webhook-cert" not found Jun 02 01:59:08.404550 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.404518 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8dfb\" (UniqueName: \"kubernetes.io/projected/6fb84100-b99e-455e-8929-3593639aba8c-kube-api-access-m8dfb\") pod \"odh-model-controller-76588b95-zc8fk\" (UID: \"6fb84100-b99e-455e-8929-3593639aba8c\") " pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:08.814561 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.814527 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv"] Jun 02 01:59:08.818425 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.818399 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:08.823096 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.823076 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 01:59:08.823096 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.823080 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zz9cz\"" Jun 02 01:59:08.824368 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.824348 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 01:59:08.824455 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.824348 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 01:59:08.842275 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.842249 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv"] Jun 02 01:59:08.879047 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.879016 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fb84100-b99e-455e-8929-3593639aba8c-cert\") pod \"odh-model-controller-76588b95-zc8fk\" (UID: \"6fb84100-b99e-455e-8929-3593639aba8c\") " pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:08.881309 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.881284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fb84100-b99e-455e-8929-3593639aba8c-cert\") pod \"odh-model-controller-76588b95-zc8fk\" (UID: \"6fb84100-b99e-455e-8929-3593639aba8c\") " pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:08.980318 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.980277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e374532-7258-484c-ae71-c6edc4c95c5e-manager-config\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:08.980318 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.980313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e374532-7258-484c-ae71-c6edc4c95c5e-metrics-cert\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:08.980556 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.980401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt2xz\" (UniqueName: \"kubernetes.io/projected/4e374532-7258-484c-ae71-c6edc4c95c5e-kube-api-access-nt2xz\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:08.980556 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:08.980430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e374532-7258-484c-ae71-c6edc4c95c5e-cert\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.006009 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.005973 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:09.081775 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.081693 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e374532-7258-484c-ae71-c6edc4c95c5e-manager-config\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.081775 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.081744 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e374532-7258-484c-ae71-c6edc4c95c5e-metrics-cert\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.081939 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.081822 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nt2xz\" (UniqueName: \"kubernetes.io/projected/4e374532-7258-484c-ae71-c6edc4c95c5e-kube-api-access-nt2xz\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.081939 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.081867 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e374532-7258-484c-ae71-c6edc4c95c5e-cert\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.082498 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.082473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e374532-7258-484c-ae71-c6edc4c95c5e-manager-config\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.084861 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.084837 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e374532-7258-484c-ae71-c6edc4c95c5e-cert\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.085174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.085153 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e374532-7258-484c-ae71-c6edc4c95c5e-metrics-cert\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.096521 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.096495 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt2xz\" (UniqueName: \"kubernetes.io/projected/4e374532-7258-484c-ae71-c6edc4c95c5e-kube-api-access-nt2xz\") pod \"lws-controller-manager-f66fcb844-k7qtv\" (UID: \"4e374532-7258-484c-ae71-c6edc4c95c5e\") " pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.128120 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.128093 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:09.148300 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.148276 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-zc8fk"] Jun 02 01:59:09.150405 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:59:09.150378 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb84100_b99e_455e_8929_3593639aba8c.slice/crio-3dd7ad707e731208ae1a5743a0858602b7e846b2205e59e5fda5d5a129e53fe5 WatchSource:0}: Error finding container 3dd7ad707e731208ae1a5743a0858602b7e846b2205e59e5fda5d5a129e53fe5: Status 404 returned error can't find the container with id 3dd7ad707e731208ae1a5743a0858602b7e846b2205e59e5fda5d5a129e53fe5 Jun 02 01:59:09.266461 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.266433 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv"] Jun 02 01:59:09.267693 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:59:09.267664 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e374532_7258_484c_ae71_c6edc4c95c5e.slice/crio-3891b07ea3196d5d43ce7a242a0b2f45a1855c894ee082b5cb04c21e0003b219 WatchSource:0}: Error finding container 3891b07ea3196d5d43ce7a242a0b2f45a1855c894ee082b5cb04c21e0003b219: Status 404 returned error can't find the container with id 3891b07ea3196d5d43ce7a242a0b2f45a1855c894ee082b5cb04c21e0003b219 Jun 02 01:59:09.333132 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.333029 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-zc8fk" event={"ID":"6fb84100-b99e-455e-8929-3593639aba8c","Type":"ContainerStarted","Data":"3dd7ad707e731208ae1a5743a0858602b7e846b2205e59e5fda5d5a129e53fe5"} Jun 02 01:59:09.333948 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.333923 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" event={"ID":"4e374532-7258-484c-ae71-c6edc4c95c5e","Type":"ContainerStarted","Data":"3891b07ea3196d5d43ce7a242a0b2f45a1855c894ee082b5cb04c21e0003b219"} Jun 02 01:59:09.520747 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.520710 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd"] Jun 02 01:59:09.526112 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.526091 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.529091 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.529071 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9x25v\"" Jun 02 01:59:09.529222 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.529073 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:59:09.529222 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.529169 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:59:09.532845 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.532819 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd"] Jun 02 01:59:09.688063 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.687970 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.688063 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.688028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.688063 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.688058 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gsdx\" (UniqueName: \"kubernetes.io/projected/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-kube-api-access-8gsdx\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.788796 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.788761 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.788952 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.788812 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.788952 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.788832 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gsdx\" (UniqueName: \"kubernetes.io/projected/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-kube-api-access-8gsdx\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.789150 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.789121 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.789190 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.789157 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.819044 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.819005 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gsdx\" (UniqueName: \"kubernetes.io/projected/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-kube-api-access-8gsdx\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:09.836214 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:09.836183 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:10.039044 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:10.039005 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd"] Jun 02 01:59:10.041276 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:59:10.041243 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97aa430b_1c74_4ac2_915a_ff6a2d218ba2.slice/crio-44212a6bc67149f9248d3583222bbf7f14fa0f01d21b569c064bf87330d9d5ad WatchSource:0}: Error finding container 44212a6bc67149f9248d3583222bbf7f14fa0f01d21b569c064bf87330d9d5ad: Status 404 returned error can't find the container with id 44212a6bc67149f9248d3583222bbf7f14fa0f01d21b569c064bf87330d9d5ad Jun 02 01:59:10.340300 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:10.340262 2559 generic.go:358] "Generic (PLEG): container finished" podID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerID="85dd9b1389dd8ad7b0585a2413525284b8b591c0164bdc4687fc12bd8f10c942" exitCode=0 Jun 02 01:59:10.340735 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:10.340406 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" event={"ID":"97aa430b-1c74-4ac2-915a-ff6a2d218ba2","Type":"ContainerDied","Data":"85dd9b1389dd8ad7b0585a2413525284b8b591c0164bdc4687fc12bd8f10c942"} Jun 02 01:59:10.340735 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:10.340435 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" event={"ID":"97aa430b-1c74-4ac2-915a-ff6a2d218ba2","Type":"ContainerStarted","Data":"44212a6bc67149f9248d3583222bbf7f14fa0f01d21b569c064bf87330d9d5ad"} Jun 02 01:59:13.353672 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:13.353635 2559 generic.go:358] "Generic (PLEG): container finished" podID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerID="cbe2adb8a757366473ca9adcd6aa7edc2c15b917540490a81e012ce587e30156" exitCode=0 Jun 02 01:59:13.354060 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:13.353717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" event={"ID":"97aa430b-1c74-4ac2-915a-ff6a2d218ba2","Type":"ContainerDied","Data":"cbe2adb8a757366473ca9adcd6aa7edc2c15b917540490a81e012ce587e30156"} Jun 02 01:59:13.355174 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:13.355129 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-zc8fk" event={"ID":"6fb84100-b99e-455e-8929-3593639aba8c","Type":"ContainerStarted","Data":"7849efe0be2d5016dd2ea37301985fbf0cfc3ec8c6717326c5ba637e19d48529"} Jun 02 01:59:13.355301 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:13.355187 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:13.356389 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:13.356369 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" event={"ID":"4e374532-7258-484c-ae71-c6edc4c95c5e","Type":"ContainerStarted","Data":"9ee81e3680305361532553aaa696ea3cd1e7b021e3549d9d958612e89ef53df7"} Jun 02 01:59:13.358692 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:13.358672 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:13.398256 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:13.398199 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" podStartSLOduration=2.171855125 podStartE2EDuration="5.398181576s" podCreationTimestamp="2026-06-02 01:59:08 +0000 UTC" firstStartedPulling="2026-06-02 01:59:09.269647256 +0000 UTC m=+511.185778263" lastFinishedPulling="2026-06-02 01:59:12.495973703 +0000 UTC m=+514.412104714" observedRunningTime="2026-06-02 01:59:13.398128356 +0000 UTC m=+515.314259411" watchObservedRunningTime="2026-06-02 01:59:13.398181576 +0000 UTC m=+515.314312597" Jun 02 01:59:13.430428 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:13.430379 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-zc8fk" podStartSLOduration=2.090514373 podStartE2EDuration="5.430363186s" podCreationTimestamp="2026-06-02 01:59:08 +0000 UTC" firstStartedPulling="2026-06-02 01:59:09.152049867 +0000 UTC m=+511.068180874" lastFinishedPulling="2026-06-02 01:59:12.491898668 +0000 UTC m=+514.408029687" observedRunningTime="2026-06-02 01:59:13.427534295 +0000 UTC m=+515.343665329" watchObservedRunningTime="2026-06-02 01:59:13.430363186 +0000 UTC m=+515.346494213" Jun 02 01:59:14.361390 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:14.361350 2559 generic.go:358] "Generic (PLEG): container finished" podID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerID="068086c4370977c5ca95590ed2291e23064cda5a0e3951134b59487e02f1804a" exitCode=0 Jun 02 01:59:14.361785 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:14.361425 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" event={"ID":"97aa430b-1c74-4ac2-915a-ff6a2d218ba2","Type":"ContainerDied","Data":"068086c4370977c5ca95590ed2291e23064cda5a0e3951134b59487e02f1804a"} Jun 02 01:59:15.495075 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.495053 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:15.543546 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.543491 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-bundle\") pod \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " Jun 02 01:59:15.543849 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.543678 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gsdx\" (UniqueName: \"kubernetes.io/projected/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-kube-api-access-8gsdx\") pod \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " Jun 02 01:59:15.543976 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.543894 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-util\") pod \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\" (UID: \"97aa430b-1c74-4ac2-915a-ff6a2d218ba2\") " Jun 02 01:59:15.545739 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.545696 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-bundle" (OuterVolumeSpecName: "bundle") pod "97aa430b-1c74-4ac2-915a-ff6a2d218ba2" (UID: "97aa430b-1c74-4ac2-915a-ff6a2d218ba2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:59:15.546912 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.546890 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-kube-api-access-8gsdx" (OuterVolumeSpecName: "kube-api-access-8gsdx") pod "97aa430b-1c74-4ac2-915a-ff6a2d218ba2" (UID: "97aa430b-1c74-4ac2-915a-ff6a2d218ba2"). InnerVolumeSpecName "kube-api-access-8gsdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:59:15.549492 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.549466 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-util" (OuterVolumeSpecName: "util") pod "97aa430b-1c74-4ac2-915a-ff6a2d218ba2" (UID: "97aa430b-1c74-4ac2-915a-ff6a2d218ba2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:59:15.645854 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.645777 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:59:15.645854 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.645810 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gsdx\" (UniqueName: \"kubernetes.io/projected/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-kube-api-access-8gsdx\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:59:15.645854 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:15.645821 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97aa430b-1c74-4ac2-915a-ff6a2d218ba2-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:59:16.370333 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:16.370299 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" event={"ID":"97aa430b-1c74-4ac2-915a-ff6a2d218ba2","Type":"ContainerDied","Data":"44212a6bc67149f9248d3583222bbf7f14fa0f01d21b569c064bf87330d9d5ad"} Jun 02 01:59:16.370333 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:16.370332 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c483558wvd" Jun 02 01:59:16.370527 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:16.370336 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44212a6bc67149f9248d3583222bbf7f14fa0f01d21b569c064bf87330d9d5ad" Jun 02 01:59:24.363558 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:24.363522 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f66fcb844-k7qtv" Jun 02 01:59:24.364078 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:24.363582 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-zc8fk" Jun 02 01:59:30.617838 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.617752 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q"] Jun 02 01:59:30.618202 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.618089 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerName="extract" Jun 02 01:59:30.618202 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.618101 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerName="extract" Jun 02 01:59:30.618202 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.618127 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerName="pull" Jun 02 01:59:30.618202 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.618132 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerName="pull" Jun 02 01:59:30.618202 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.618161 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerName="util" Jun 02 01:59:30.618202 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.618166 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerName="util" Jun 02 01:59:30.618384 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.618221 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="97aa430b-1c74-4ac2-915a-ff6a2d218ba2" containerName="extract" Jun 02 01:59:30.621393 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.621376 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.625369 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.625348 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:59:30.626405 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.626389 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:59:30.626468 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.626394 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9x25v\"" Jun 02 01:59:30.640228 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.640203 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q"] Jun 02 01:59:30.675515 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.675485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.675649 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.675561 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.675695 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.675680 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwmrq\" (UniqueName: \"kubernetes.io/projected/9fbff13b-4409-4688-aff9-157e506e8ae6-kube-api-access-zwmrq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.776485 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.776451 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwmrq\" (UniqueName: \"kubernetes.io/projected/9fbff13b-4409-4688-aff9-157e506e8ae6-kube-api-access-zwmrq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.776640 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.776497 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.776640 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.776523 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.776840 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.776825 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.776896 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.776884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.792656 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.792634 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwmrq\" (UniqueName: \"kubernetes.io/projected/9fbff13b-4409-4688-aff9-157e506e8ae6-kube-api-access-zwmrq\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:30.930094 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:30.930014 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:31.082254 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:31.082231 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q"] Jun 02 01:59:31.084233 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:59:31.084200 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbff13b_4409_4688_aff9_157e506e8ae6.slice/crio-1623debca74e76cece4c62d324e912b241fb66a4ed176410926c98c0d61f7dae WatchSource:0}: Error finding container 1623debca74e76cece4c62d324e912b241fb66a4ed176410926c98c0d61f7dae: Status 404 returned error can't find the container with id 1623debca74e76cece4c62d324e912b241fb66a4ed176410926c98c0d61f7dae Jun 02 01:59:31.425725 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:31.425682 2559 generic.go:358] "Generic (PLEG): container finished" podID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerID="6fe0d18083319e463416aece6220b53b0dedfddca26cfb8c43677db7d516403f" exitCode=0 Jun 02 01:59:31.425894 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:31.425741 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" event={"ID":"9fbff13b-4409-4688-aff9-157e506e8ae6","Type":"ContainerDied","Data":"6fe0d18083319e463416aece6220b53b0dedfddca26cfb8c43677db7d516403f"} Jun 02 01:59:31.425894 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:31.425766 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" event={"ID":"9fbff13b-4409-4688-aff9-157e506e8ae6","Type":"ContainerStarted","Data":"1623debca74e76cece4c62d324e912b241fb66a4ed176410926c98c0d61f7dae"} Jun 02 01:59:32.432058 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:32.432018 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" event={"ID":"9fbff13b-4409-4688-aff9-157e506e8ae6","Type":"ContainerStarted","Data":"5de7e7205ed2b80ce92f9ab21c6d03855246de788cd5cb64f550956f5bb0e476"} Jun 02 01:59:33.436640 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:33.436609 2559 generic.go:358] "Generic (PLEG): container finished" podID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerID="5de7e7205ed2b80ce92f9ab21c6d03855246de788cd5cb64f550956f5bb0e476" exitCode=0 Jun 02 01:59:33.437011 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:33.436695 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" event={"ID":"9fbff13b-4409-4688-aff9-157e506e8ae6","Type":"ContainerDied","Data":"5de7e7205ed2b80ce92f9ab21c6d03855246de788cd5cb64f550956f5bb0e476"} Jun 02 01:59:34.441527 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:34.441485 2559 generic.go:358] "Generic (PLEG): container finished" podID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerID="3022159387feebb1baa1888244319bc23b51247249e95350a6b86eadb4418a16" exitCode=0 Jun 02 01:59:34.441900 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:34.441572 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" event={"ID":"9fbff13b-4409-4688-aff9-157e506e8ae6","Type":"ContainerDied","Data":"3022159387feebb1baa1888244319bc23b51247249e95350a6b86eadb4418a16"} Jun 02 01:59:35.583032 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.583009 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:35.726185 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.726158 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwmrq\" (UniqueName: \"kubernetes.io/projected/9fbff13b-4409-4688-aff9-157e506e8ae6-kube-api-access-zwmrq\") pod \"9fbff13b-4409-4688-aff9-157e506e8ae6\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " Jun 02 01:59:35.726329 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.726200 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-bundle\") pod \"9fbff13b-4409-4688-aff9-157e506e8ae6\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " Jun 02 01:59:35.726329 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.726229 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-util\") pod \"9fbff13b-4409-4688-aff9-157e506e8ae6\" (UID: \"9fbff13b-4409-4688-aff9-157e506e8ae6\") " Jun 02 01:59:35.726972 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.726947 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-bundle" (OuterVolumeSpecName: "bundle") pod "9fbff13b-4409-4688-aff9-157e506e8ae6" (UID: "9fbff13b-4409-4688-aff9-157e506e8ae6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:59:35.728202 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.728174 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fbff13b-4409-4688-aff9-157e506e8ae6-kube-api-access-zwmrq" (OuterVolumeSpecName: "kube-api-access-zwmrq") pod "9fbff13b-4409-4688-aff9-157e506e8ae6" (UID: "9fbff13b-4409-4688-aff9-157e506e8ae6"). InnerVolumeSpecName "kube-api-access-zwmrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:59:35.731741 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.731720 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-util" (OuterVolumeSpecName: "util") pod "9fbff13b-4409-4688-aff9-157e506e8ae6" (UID: "9fbff13b-4409-4688-aff9-157e506e8ae6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:59:35.827814 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.827610 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwmrq\" (UniqueName: \"kubernetes.io/projected/9fbff13b-4409-4688-aff9-157e506e8ae6-kube-api-access-zwmrq\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:59:35.827814 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.827646 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:59:35.827814 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:35.827662 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9fbff13b-4409-4688-aff9-157e506e8ae6-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 01:59:36.450122 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:36.450093 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" Jun 02 01:59:36.450122 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:36.450117 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762anrt9q" event={"ID":"9fbff13b-4409-4688-aff9-157e506e8ae6","Type":"ContainerDied","Data":"1623debca74e76cece4c62d324e912b241fb66a4ed176410926c98c0d61f7dae"} Jun 02 01:59:36.450349 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:36.450167 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1623debca74e76cece4c62d324e912b241fb66a4ed176410926c98c0d61f7dae" Jun 02 01:59:43.618043 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.618014 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5ffbc658cc-88pp4"] Jun 02 01:59:43.618411 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.618386 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerName="pull" Jun 02 01:59:43.618411 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.618400 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerName="pull" Jun 02 01:59:43.618411 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.618411 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerName="util" Jun 02 01:59:43.618508 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.618417 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerName="util" Jun 02 01:59:43.618508 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.618427 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerName="extract" Jun 02 01:59:43.618508 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.618432 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerName="extract" Jun 02 01:59:43.618508 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.618485 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="9fbff13b-4409-4688-aff9-157e506e8ae6" containerName="extract" Jun 02 01:59:43.623170 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.623126 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" Jun 02 01:59:43.626057 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.626033 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 01:59:43.626209 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.626191 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cn584\"" Jun 02 01:59:43.633866 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.633845 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5ffbc658cc-88pp4"] Jun 02 01:59:43.699747 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.699714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ef797bd2-4756-4326-a730-811adab2db3c-redirect-config\") pod \"dashboard-redirect-5ffbc658cc-88pp4\" (UID: \"ef797bd2-4756-4326-a730-811adab2db3c\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" Jun 02 01:59:43.699747 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.699748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48sx2\" (UniqueName: \"kubernetes.io/projected/ef797bd2-4756-4326-a730-811adab2db3c-kube-api-access-48sx2\") pod \"dashboard-redirect-5ffbc658cc-88pp4\" (UID: \"ef797bd2-4756-4326-a730-811adab2db3c\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" Jun 02 01:59:43.801081 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.801052 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ef797bd2-4756-4326-a730-811adab2db3c-redirect-config\") pod \"dashboard-redirect-5ffbc658cc-88pp4\" (UID: \"ef797bd2-4756-4326-a730-811adab2db3c\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" Jun 02 01:59:43.801277 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.801091 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48sx2\" (UniqueName: \"kubernetes.io/projected/ef797bd2-4756-4326-a730-811adab2db3c-kube-api-access-48sx2\") pod \"dashboard-redirect-5ffbc658cc-88pp4\" (UID: \"ef797bd2-4756-4326-a730-811adab2db3c\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" Jun 02 01:59:43.801723 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.801705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ef797bd2-4756-4326-a730-811adab2db3c-redirect-config\") pod \"dashboard-redirect-5ffbc658cc-88pp4\" (UID: \"ef797bd2-4756-4326-a730-811adab2db3c\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" Jun 02 01:59:43.810558 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.810532 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48sx2\" (UniqueName: \"kubernetes.io/projected/ef797bd2-4756-4326-a730-811adab2db3c-kube-api-access-48sx2\") pod \"dashboard-redirect-5ffbc658cc-88pp4\" (UID: \"ef797bd2-4756-4326-a730-811adab2db3c\") " pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" Jun 02 01:59:43.933744 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:43.933661 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" Jun 02 01:59:44.061770 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:44.061744 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5ffbc658cc-88pp4"] Jun 02 01:59:44.064089 ip-10-0-135-96 kubenswrapper[2559]: W0602 01:59:44.064064 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef797bd2_4756_4326_a730_811adab2db3c.slice/crio-fa553007c2d097b2a8d9696d066c599bdcc4532b95a48562a2df8360deca794d WatchSource:0}: Error finding container fa553007c2d097b2a8d9696d066c599bdcc4532b95a48562a2df8360deca794d: Status 404 returned error can't find the container with id fa553007c2d097b2a8d9696d066c599bdcc4532b95a48562a2df8360deca794d Jun 02 01:59:44.478232 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:44.478198 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" event={"ID":"ef797bd2-4756-4326-a730-811adab2db3c","Type":"ContainerStarted","Data":"fa553007c2d097b2a8d9696d066c599bdcc4532b95a48562a2df8360deca794d"} Jun 02 01:59:46.486818 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:46.486775 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" event={"ID":"ef797bd2-4756-4326-a730-811adab2db3c","Type":"ContainerStarted","Data":"1880900a6078e048c17743c9d877b978973ecb26939d81910773ec1f14c30f81"} Jun 02 01:59:46.504624 ip-10-0-135-96 kubenswrapper[2559]: I0602 01:59:46.504578 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5ffbc658cc-88pp4" podStartSLOduration=1.6205024049999999 podStartE2EDuration="3.50456424s" podCreationTimestamp="2026-06-02 01:59:43 +0000 UTC" firstStartedPulling="2026-06-02 01:59:44.06538657 +0000 UTC m=+545.981517576" lastFinishedPulling="2026-06-02 01:59:45.949448402 +0000 UTC m=+547.865579411" observedRunningTime="2026-06-02 01:59:46.503259944 +0000 UTC m=+548.419390971" watchObservedRunningTime="2026-06-02 01:59:46.50456424 +0000 UTC m=+548.420695268" Jun 02 02:00:02.828605 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.828574 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb"] Jun 02 02:00:02.831898 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.831880 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.835996 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.835973 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c6wjs\"" Jun 02 02:00:02.836212 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.836199 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 02:00:02.847095 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.847067 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb"] Jun 02 02:00:02.865019 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.864991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.865019 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.865027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90effe07-9ccc-44fd-b81d-3283678e7eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.865251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.865052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xghgc\" (UniqueName: \"kubernetes.io/projected/90effe07-9ccc-44fd-b81d-3283678e7eaf-kube-api-access-xghgc\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.865251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.865078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.865251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.865118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.865251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.865189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.865251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.865213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.865251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.865238 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.865559 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.865351 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966400 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966361 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966580 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966452 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966580 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966475 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90effe07-9ccc-44fd-b81d-3283678e7eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966580 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966499 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xghgc\" (UniqueName: \"kubernetes.io/projected/90effe07-9ccc-44fd-b81d-3283678e7eaf-kube-api-access-xghgc\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966755 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966695 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966818 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966766 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966818 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966776 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966920 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966834 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966920 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966871 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966920 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966897 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.966920 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.966905 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.967226 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.967209 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.967292 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.967269 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90effe07-9ccc-44fd-b81d-3283678e7eaf-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.967327 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.967291 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.969088 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.969069 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.969258 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.969242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.974719 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.974689 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xghgc\" (UniqueName: \"kubernetes.io/projected/90effe07-9ccc-44fd-b81d-3283678e7eaf-kube-api-access-xghgc\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:02.975292 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:02.975271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90effe07-9ccc-44fd-b81d-3283678e7eaf-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb\" (UID: \"90effe07-9ccc-44fd-b81d-3283678e7eaf\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:03.142724 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:03.142640 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:03.268065 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:03.268042 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb"] Jun 02 02:00:03.270787 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:03.270725 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90effe07_9ccc_44fd_b81d_3283678e7eaf.slice/crio-842a6817b5eb1fca9806223874ae6175490a7849649e605c9740c0a5c4f4cbff WatchSource:0}: Error finding container 842a6817b5eb1fca9806223874ae6175490a7849649e605c9740c0a5c4f4cbff: Status 404 returned error can't find the container with id 842a6817b5eb1fca9806223874ae6175490a7849649e605c9740c0a5c4f4cbff Jun 02 02:00:03.549646 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:03.549605 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" event={"ID":"90effe07-9ccc-44fd-b81d-3283678e7eaf","Type":"ContainerStarted","Data":"842a6817b5eb1fca9806223874ae6175490a7849649e605c9740c0a5c4f4cbff"} Jun 02 02:00:08.366692 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.366654 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 02:00:08.366949 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.366747 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 02:00:08.366949 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.366780 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 02:00:08.567800 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.567761 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" event={"ID":"90effe07-9ccc-44fd-b81d-3283678e7eaf","Type":"ContainerStarted","Data":"1f7bc266c61a0c2024c2844009aa33b669ba0f93bfc363f5f47117a62457ccf0"} Jun 02 02:00:08.590590 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.590544 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" podStartSLOduration=1.497044776 podStartE2EDuration="6.590527657s" podCreationTimestamp="2026-06-02 02:00:02 +0000 UTC" firstStartedPulling="2026-06-02 02:00:03.272909449 +0000 UTC m=+565.189040459" lastFinishedPulling="2026-06-02 02:00:08.366392324 +0000 UTC m=+570.282523340" observedRunningTime="2026-06-02 02:00:08.588783572 +0000 UTC m=+570.504914599" watchObservedRunningTime="2026-06-02 02:00:08.590527657 +0000 UTC m=+570.506658685" Jun 02 02:00:08.857522 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.857483 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mhvg"] Jun 02 02:00:08.861695 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.861673 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" Jun 02 02:00:08.864533 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.864508 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-96bxs\"" Jun 02 02:00:08.864641 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.864513 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 02:00:08.865088 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.864967 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 02:00:08.870019 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.869996 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mhvg"] Jun 02 02:00:08.923427 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:08.923400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5n5q\" (UniqueName: \"kubernetes.io/projected/b7a3b727-edca-4749-ba39-ef328688ea35-kube-api-access-g5n5q\") pod \"kuadrant-operator-catalog-5mhvg\" (UID: \"b7a3b727-edca-4749-ba39-ef328688ea35\") " pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" Jun 02 02:00:09.024007 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.023973 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5n5q\" (UniqueName: \"kubernetes.io/projected/b7a3b727-edca-4749-ba39-ef328688ea35-kube-api-access-g5n5q\") pod \"kuadrant-operator-catalog-5mhvg\" (UID: \"b7a3b727-edca-4749-ba39-ef328688ea35\") " pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" Jun 02 02:00:09.032736 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.032708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5n5q\" (UniqueName: \"kubernetes.io/projected/b7a3b727-edca-4749-ba39-ef328688ea35-kube-api-access-g5n5q\") pod \"kuadrant-operator-catalog-5mhvg\" (UID: \"b7a3b727-edca-4749-ba39-ef328688ea35\") " pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" Jun 02 02:00:09.143286 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.143201 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:09.147905 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.147880 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:09.172489 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.172459 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" Jun 02 02:00:09.217510 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.217477 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mhvg"] Jun 02 02:00:09.297931 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.297905 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mhvg"] Jun 02 02:00:09.299690 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:09.299663 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a3b727_edca_4749_ba39_ef328688ea35.slice/crio-6f41af4df87654d041ade9460164de6a75312b42cf41c3e12073c36e464a94d8 WatchSource:0}: Error finding container 6f41af4df87654d041ade9460164de6a75312b42cf41c3e12073c36e464a94d8: Status 404 returned error can't find the container with id 6f41af4df87654d041ade9460164de6a75312b42cf41c3e12073c36e464a94d8 Jun 02 02:00:09.428576 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.428503 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9q7km"] Jun 02 02:00:09.433421 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.433404 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:09.441855 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.441835 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9q7km"] Jun 02 02:00:09.528992 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.528954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqk6t\" (UniqueName: \"kubernetes.io/projected/eda52b0a-4d15-462f-aa66-744b498bc179-kube-api-access-rqk6t\") pod \"kuadrant-operator-catalog-9q7km\" (UID: \"eda52b0a-4d15-462f-aa66-744b498bc179\") " pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:09.574275 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.574235 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" event={"ID":"b7a3b727-edca-4749-ba39-ef328688ea35","Type":"ContainerStarted","Data":"6f41af4df87654d041ade9460164de6a75312b42cf41c3e12073c36e464a94d8"} Jun 02 02:00:09.574507 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.574491 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:09.575633 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.575619 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb" Jun 02 02:00:09.630557 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.630517 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rqk6t\" (UniqueName: \"kubernetes.io/projected/eda52b0a-4d15-462f-aa66-744b498bc179-kube-api-access-rqk6t\") pod \"kuadrant-operator-catalog-9q7km\" (UID: \"eda52b0a-4d15-462f-aa66-744b498bc179\") " pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:09.643104 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.643075 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqk6t\" (UniqueName: \"kubernetes.io/projected/eda52b0a-4d15-462f-aa66-744b498bc179-kube-api-access-rqk6t\") pod \"kuadrant-operator-catalog-9q7km\" (UID: \"eda52b0a-4d15-462f-aa66-744b498bc179\") " pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:09.743250 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.743217 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:09.876202 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:09.876167 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9q7km"] Jun 02 02:00:09.904316 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:09.904284 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda52b0a_4d15_462f_aa66_744b498bc179.slice/crio-61d8a8516974a762c51d00e60469209bde90129cfa072e00a0c424e3535efbf0 WatchSource:0}: Error finding container 61d8a8516974a762c51d00e60469209bde90129cfa072e00a0c424e3535efbf0: Status 404 returned error can't find the container with id 61d8a8516974a762c51d00e60469209bde90129cfa072e00a0c424e3535efbf0 Jun 02 02:00:10.580309 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:10.580262 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" event={"ID":"eda52b0a-4d15-462f-aa66-744b498bc179","Type":"ContainerStarted","Data":"61d8a8516974a762c51d00e60469209bde90129cfa072e00a0c424e3535efbf0"} Jun 02 02:00:12.588982 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.588947 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" event={"ID":"b7a3b727-edca-4749-ba39-ef328688ea35","Type":"ContainerStarted","Data":"efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1"} Jun 02 02:00:12.589392 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.589034 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" podUID="b7a3b727-edca-4749-ba39-ef328688ea35" containerName="registry-server" containerID="cri-o://efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1" gracePeriod=2 Jun 02 02:00:12.590537 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.590512 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" event={"ID":"eda52b0a-4d15-462f-aa66-744b498bc179","Type":"ContainerStarted","Data":"5ed78acc404bb10e5a883b3cc76b791321629ba95073d18f51894b5f33804382"} Jun 02 02:00:12.605674 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.605617 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" podStartSLOduration=2.355612516 podStartE2EDuration="4.605601358s" podCreationTimestamp="2026-06-02 02:00:08 +0000 UTC" firstStartedPulling="2026-06-02 02:00:09.300992493 +0000 UTC m=+571.217123499" lastFinishedPulling="2026-06-02 02:00:11.550981322 +0000 UTC m=+573.467112341" observedRunningTime="2026-06-02 02:00:12.605218882 +0000 UTC m=+574.521349915" watchObservedRunningTime="2026-06-02 02:00:12.605601358 +0000 UTC m=+574.521732392" Jun 02 02:00:12.621695 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.621654 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" podStartSLOduration=1.973166139 podStartE2EDuration="3.621640813s" podCreationTimestamp="2026-06-02 02:00:09 +0000 UTC" firstStartedPulling="2026-06-02 02:00:09.905814675 +0000 UTC m=+571.821945695" lastFinishedPulling="2026-06-02 02:00:11.554289362 +0000 UTC m=+573.470420369" observedRunningTime="2026-06-02 02:00:12.620530618 +0000 UTC m=+574.536661645" watchObservedRunningTime="2026-06-02 02:00:12.621640813 +0000 UTC m=+574.537771841" Jun 02 02:00:12.827870 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.827846 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" Jun 02 02:00:12.865198 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.865111 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5n5q\" (UniqueName: \"kubernetes.io/projected/b7a3b727-edca-4749-ba39-ef328688ea35-kube-api-access-g5n5q\") pod \"b7a3b727-edca-4749-ba39-ef328688ea35\" (UID: \"b7a3b727-edca-4749-ba39-ef328688ea35\") " Jun 02 02:00:12.867178 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.867133 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a3b727-edca-4749-ba39-ef328688ea35-kube-api-access-g5n5q" (OuterVolumeSpecName: "kube-api-access-g5n5q") pod "b7a3b727-edca-4749-ba39-ef328688ea35" (UID: "b7a3b727-edca-4749-ba39-ef328688ea35"). InnerVolumeSpecName "kube-api-access-g5n5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:00:12.966449 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:12.966417 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5n5q\" (UniqueName: \"kubernetes.io/projected/b7a3b727-edca-4749-ba39-ef328688ea35-kube-api-access-g5n5q\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:13.595537 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.595501 2559 generic.go:358] "Generic (PLEG): container finished" podID="b7a3b727-edca-4749-ba39-ef328688ea35" containerID="efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1" exitCode=0 Jun 02 02:00:13.595946 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.595545 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" event={"ID":"b7a3b727-edca-4749-ba39-ef328688ea35","Type":"ContainerDied","Data":"efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1"} Jun 02 02:00:13.595946 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.595579 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" event={"ID":"b7a3b727-edca-4749-ba39-ef328688ea35","Type":"ContainerDied","Data":"6f41af4df87654d041ade9460164de6a75312b42cf41c3e12073c36e464a94d8"} Jun 02 02:00:13.595946 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.595595 2559 scope.go:117] "RemoveContainer" containerID="efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1" Jun 02 02:00:13.595946 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.595555 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5mhvg" Jun 02 02:00:13.605008 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.604940 2559 scope.go:117] "RemoveContainer" containerID="efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1" Jun 02 02:00:13.605491 ip-10-0-135-96 kubenswrapper[2559]: E0602 02:00:13.605424 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1\": container with ID starting with efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1 not found: ID does not exist" containerID="efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1" Jun 02 02:00:13.605491 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.605460 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1"} err="failed to get container status \"efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1\": rpc error: code = NotFound desc = could not find container \"efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1\": container with ID starting with efde39c7bcd400b537aa884f262de0d62691a84a7ac9b43b893bbb31777159b1 not found: ID does not exist" Jun 02 02:00:13.620379 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.620353 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mhvg"] Jun 02 02:00:13.624765 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:13.624745 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5mhvg"] Jun 02 02:00:14.760050 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:14.760016 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7a3b727-edca-4749-ba39-ef328688ea35" path="/var/lib/kubelet/pods/b7a3b727-edca-4749-ba39-ef328688ea35/volumes" Jun 02 02:00:19.744189 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:19.744149 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:19.744655 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:19.744262 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:19.766598 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:19.766571 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:20.642355 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:20.642328 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9q7km" Jun 02 02:00:24.866718 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.866680 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh"] Jun 02 02:00:24.867084 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.867071 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3b727-edca-4749-ba39-ef328688ea35" containerName="registry-server" Jun 02 02:00:24.867084 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.867085 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3b727-edca-4749-ba39-ef328688ea35" containerName="registry-server" Jun 02 02:00:24.867184 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.867174 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7a3b727-edca-4749-ba39-ef328688ea35" containerName="registry-server" Jun 02 02:00:24.877594 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.877562 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh"] Jun 02 02:00:24.877732 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.877670 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:24.880319 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.880296 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dvzkm\"" Jun 02 02:00:24.975873 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.975839 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:24.975873 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.975883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl9p4\" (UniqueName: \"kubernetes.io/projected/3bd1a213-7d90-41a6-9458-246700734af9-kube-api-access-cl9p4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:24.976090 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:24.975938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:25.077446 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.077407 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:25.077446 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.077449 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cl9p4\" (UniqueName: \"kubernetes.io/projected/3bd1a213-7d90-41a6-9458-246700734af9-kube-api-access-cl9p4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:25.077708 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.077484 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:25.077874 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.077850 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:25.077930 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.077862 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:25.086395 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.086367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl9p4\" (UniqueName: \"kubernetes.io/projected/3bd1a213-7d90-41a6-9458-246700734af9-kube-api-access-cl9p4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:25.187329 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.187235 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:25.322759 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.322733 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh"] Jun 02 02:00:25.325185 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:25.325132 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd1a213_7d90_41a6_9458_246700734af9.slice/crio-b626511425d1321bc8d18cf21366605a2d2c37b53cb6249f4edae87615bc5322 WatchSource:0}: Error finding container b626511425d1321bc8d18cf21366605a2d2c37b53cb6249f4edae87615bc5322: Status 404 returned error can't find the container with id b626511425d1321bc8d18cf21366605a2d2c37b53cb6249f4edae87615bc5322 Jun 02 02:00:25.469267 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.469242 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms"] Jun 02 02:00:25.472823 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.472807 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.478656 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.478633 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms"] Jun 02 02:00:25.582874 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.582831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.582874 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.582878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpbg9\" (UniqueName: \"kubernetes.io/projected/03e52002-c224-4e6d-89b2-2691455cca8d-kube-api-access-wpbg9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.583084 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.582983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.640825 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.640788 2559 generic.go:358] "Generic (PLEG): container finished" podID="3bd1a213-7d90-41a6-9458-246700734af9" containerID="cbaeefcb8620e8f275ea2e0c8c9b59dab091d8f6de1494aba201d356af3287ce" exitCode=0 Jun 02 02:00:25.640960 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.640846 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" event={"ID":"3bd1a213-7d90-41a6-9458-246700734af9","Type":"ContainerDied","Data":"cbaeefcb8620e8f275ea2e0c8c9b59dab091d8f6de1494aba201d356af3287ce"} Jun 02 02:00:25.640960 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.640867 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" event={"ID":"3bd1a213-7d90-41a6-9458-246700734af9","Type":"ContainerStarted","Data":"b626511425d1321bc8d18cf21366605a2d2c37b53cb6249f4edae87615bc5322"} Jun 02 02:00:25.683669 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.683633 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.683860 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.683683 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpbg9\" (UniqueName: \"kubernetes.io/projected/03e52002-c224-4e6d-89b2-2691455cca8d-kube-api-access-wpbg9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.683860 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.683742 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.684101 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.684078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.684184 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.684078 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.692361 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.692343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpbg9\" (UniqueName: \"kubernetes.io/projected/03e52002-c224-4e6d-89b2-2691455cca8d-kube-api-access-wpbg9\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.800945 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.800869 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:25.874670 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.874631 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw"] Jun 02 02:00:25.880603 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.880579 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:25.886329 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.884860 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw"] Jun 02 02:00:25.940192 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.940169 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms"] Jun 02 02:00:25.942886 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:25.942862 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e52002_c224_4e6d_89b2_2691455cca8d.slice/crio-301b8cf36cdd95a4e45ef2438e2b81a591811b1c329cb448d71600c1f454dfa9 WatchSource:0}: Error finding container 301b8cf36cdd95a4e45ef2438e2b81a591811b1c329cb448d71600c1f454dfa9: Status 404 returned error can't find the container with id 301b8cf36cdd95a4e45ef2438e2b81a591811b1c329cb448d71600c1f454dfa9 Jun 02 02:00:25.986688 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.986658 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:25.986799 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.986727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr9ss\" (UniqueName: \"kubernetes.io/projected/f6ea96af-f7df-4ade-a6f4-856d09010ebd-kube-api-access-sr9ss\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:25.986799 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:25.986756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:26.087527 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.087428 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:26.087527 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.087503 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sr9ss\" (UniqueName: \"kubernetes.io/projected/f6ea96af-f7df-4ade-a6f4-856d09010ebd-kube-api-access-sr9ss\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:26.087744 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.087533 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:26.087820 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.087797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:26.087873 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.087854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:26.096953 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.096928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr9ss\" (UniqueName: \"kubernetes.io/projected/f6ea96af-f7df-4ade-a6f4-856d09010ebd-kube-api-access-sr9ss\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:26.194440 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.194406 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:26.265993 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.265957 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr"] Jun 02 02:00:26.274834 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.274807 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.278454 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.278429 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr"] Jun 02 02:00:26.345484 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.345460 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw"] Jun 02 02:00:26.347835 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:26.347810 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ea96af_f7df_4ade_a6f4_856d09010ebd.slice/crio-83ab7c814ac61dfdead5d435e8e7093d45e564a92b17535249bee6f5eb7f62b9 WatchSource:0}: Error finding container 83ab7c814ac61dfdead5d435e8e7093d45e564a92b17535249bee6f5eb7f62b9: Status 404 returned error can't find the container with id 83ab7c814ac61dfdead5d435e8e7093d45e564a92b17535249bee6f5eb7f62b9 Jun 02 02:00:26.391418 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.391347 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qjs2\" (UniqueName: \"kubernetes.io/projected/4625e8d1-bc27-4925-8b12-923432def909-kube-api-access-2qjs2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.391418 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.391389 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.391674 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.391458 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.492220 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.492193 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2qjs2\" (UniqueName: \"kubernetes.io/projected/4625e8d1-bc27-4925-8b12-923432def909-kube-api-access-2qjs2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.492293 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.492225 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.492293 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.492254 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.492574 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.492556 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.492636 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.492616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.501063 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.501042 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qjs2\" (UniqueName: \"kubernetes.io/projected/4625e8d1-bc27-4925-8b12-923432def909-kube-api-access-2qjs2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.586918 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.586890 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:26.646549 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.646523 2559 generic.go:358] "Generic (PLEG): container finished" podID="3bd1a213-7d90-41a6-9458-246700734af9" containerID="e71e2b2ad32944149a1e2b3bea67af82579f28df09ce43e07495093623912b67" exitCode=0 Jun 02 02:00:26.646682 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.646554 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" event={"ID":"3bd1a213-7d90-41a6-9458-246700734af9","Type":"ContainerDied","Data":"e71e2b2ad32944149a1e2b3bea67af82579f28df09ce43e07495093623912b67"} Jun 02 02:00:26.648501 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.648477 2559 generic.go:358] "Generic (PLEG): container finished" podID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerID="6f6235e458741a4bd27561dc15613105cdaf87346ca369644200cc631717b28c" exitCode=0 Jun 02 02:00:26.648582 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.648560 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" event={"ID":"f6ea96af-f7df-4ade-a6f4-856d09010ebd","Type":"ContainerDied","Data":"6f6235e458741a4bd27561dc15613105cdaf87346ca369644200cc631717b28c"} Jun 02 02:00:26.648644 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.648605 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" event={"ID":"f6ea96af-f7df-4ade-a6f4-856d09010ebd","Type":"ContainerStarted","Data":"83ab7c814ac61dfdead5d435e8e7093d45e564a92b17535249bee6f5eb7f62b9"} Jun 02 02:00:26.650319 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.650220 2559 generic.go:358] "Generic (PLEG): container finished" podID="03e52002-c224-4e6d-89b2-2691455cca8d" containerID="0607a31a683b155584c6fe9692029da6346708ccb9a65670ed19e65c6d103172" exitCode=0 Jun 02 02:00:26.650319 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.650273 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" event={"ID":"03e52002-c224-4e6d-89b2-2691455cca8d","Type":"ContainerDied","Data":"0607a31a683b155584c6fe9692029da6346708ccb9a65670ed19e65c6d103172"} Jun 02 02:00:26.650319 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.650313 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" event={"ID":"03e52002-c224-4e6d-89b2-2691455cca8d","Type":"ContainerStarted","Data":"301b8cf36cdd95a4e45ef2438e2b81a591811b1c329cb448d71600c1f454dfa9"} Jun 02 02:00:26.726520 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:26.726488 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr"] Jun 02 02:00:26.728785 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:26.728755 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4625e8d1_bc27_4925_8b12_923432def909.slice/crio-6acb61f94d6687ba2b0e74e1d80fd59b3cb15621f5becef48e4916e6ce18d1cd WatchSource:0}: Error finding container 6acb61f94d6687ba2b0e74e1d80fd59b3cb15621f5becef48e4916e6ce18d1cd: Status 404 returned error can't find the container with id 6acb61f94d6687ba2b0e74e1d80fd59b3cb15621f5becef48e4916e6ce18d1cd Jun 02 02:00:27.655832 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.655803 2559 generic.go:358] "Generic (PLEG): container finished" podID="03e52002-c224-4e6d-89b2-2691455cca8d" containerID="e7954e45d78ccafa328730fb96220248a790426531d80755530d1d581c7ca52d" exitCode=0 Jun 02 02:00:27.656162 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.655889 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" event={"ID":"03e52002-c224-4e6d-89b2-2691455cca8d","Type":"ContainerDied","Data":"e7954e45d78ccafa328730fb96220248a790426531d80755530d1d581c7ca52d"} Jun 02 02:00:27.657824 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.657805 2559 generic.go:358] "Generic (PLEG): container finished" podID="3bd1a213-7d90-41a6-9458-246700734af9" containerID="c862a8daf63b4b8ce8089fbb0e7b70091a44d2d1aa7e75a38bf74336f1098571" exitCode=0 Jun 02 02:00:27.657916 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.657886 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" event={"ID":"3bd1a213-7d90-41a6-9458-246700734af9","Type":"ContainerDied","Data":"c862a8daf63b4b8ce8089fbb0e7b70091a44d2d1aa7e75a38bf74336f1098571"} Jun 02 02:00:27.659038 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.659019 2559 generic.go:358] "Generic (PLEG): container finished" podID="4625e8d1-bc27-4925-8b12-923432def909" containerID="bcedf9b725b588ecf170102669260ea4f4d1f09d85cbfe91443f92d86d62cd81" exitCode=0 Jun 02 02:00:27.659128 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.659099 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" event={"ID":"4625e8d1-bc27-4925-8b12-923432def909","Type":"ContainerDied","Data":"bcedf9b725b588ecf170102669260ea4f4d1f09d85cbfe91443f92d86d62cd81"} Jun 02 02:00:27.659211 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.659130 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" event={"ID":"4625e8d1-bc27-4925-8b12-923432def909","Type":"ContainerStarted","Data":"6acb61f94d6687ba2b0e74e1d80fd59b3cb15621f5becef48e4916e6ce18d1cd"} Jun 02 02:00:27.660809 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.660788 2559 generic.go:358] "Generic (PLEG): container finished" podID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerID="03e0e78f9d6c676a4282c5deea6dd8ffe999d781e5bfefccb371748d45b7d37f" exitCode=0 Jun 02 02:00:27.660904 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:27.660834 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" event={"ID":"f6ea96af-f7df-4ade-a6f4-856d09010ebd","Type":"ContainerDied","Data":"03e0e78f9d6c676a4282c5deea6dd8ffe999d781e5bfefccb371748d45b7d37f"} Jun 02 02:00:28.666880 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.666844 2559 generic.go:358] "Generic (PLEG): container finished" podID="4625e8d1-bc27-4925-8b12-923432def909" containerID="eed75cda247f851c989fc9e52b99babeea8e88308d4cf23ff90079d97a7e3944" exitCode=0 Jun 02 02:00:28.667318 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.666925 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" event={"ID":"4625e8d1-bc27-4925-8b12-923432def909","Type":"ContainerDied","Data":"eed75cda247f851c989fc9e52b99babeea8e88308d4cf23ff90079d97a7e3944"} Jun 02 02:00:28.668926 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.668905 2559 generic.go:358] "Generic (PLEG): container finished" podID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerID="d819e8b35378c0cc70aad2374a7e51b9b935367588f4bff1b97d52dccf291708" exitCode=0 Jun 02 02:00:28.669033 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.668983 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" event={"ID":"f6ea96af-f7df-4ade-a6f4-856d09010ebd","Type":"ContainerDied","Data":"d819e8b35378c0cc70aad2374a7e51b9b935367588f4bff1b97d52dccf291708"} Jun 02 02:00:28.670878 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.670859 2559 generic.go:358] "Generic (PLEG): container finished" podID="03e52002-c224-4e6d-89b2-2691455cca8d" containerID="f68a0c54d1eddc68887fa7b36526b2475528d98df340d173296770c223d7ee9d" exitCode=0 Jun 02 02:00:28.670984 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.670941 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" event={"ID":"03e52002-c224-4e6d-89b2-2691455cca8d","Type":"ContainerDied","Data":"f68a0c54d1eddc68887fa7b36526b2475528d98df340d173296770c223d7ee9d"} Jun 02 02:00:28.804315 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.804279 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:28.914257 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.914224 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-bundle\") pod \"3bd1a213-7d90-41a6-9458-246700734af9\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " Jun 02 02:00:28.914409 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.914267 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-util\") pod \"3bd1a213-7d90-41a6-9458-246700734af9\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " Jun 02 02:00:28.914409 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.914294 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl9p4\" (UniqueName: \"kubernetes.io/projected/3bd1a213-7d90-41a6-9458-246700734af9-kube-api-access-cl9p4\") pod \"3bd1a213-7d90-41a6-9458-246700734af9\" (UID: \"3bd1a213-7d90-41a6-9458-246700734af9\") " Jun 02 02:00:28.914914 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.914882 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-bundle" (OuterVolumeSpecName: "bundle") pod "3bd1a213-7d90-41a6-9458-246700734af9" (UID: "3bd1a213-7d90-41a6-9458-246700734af9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:00:28.916475 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.916454 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd1a213-7d90-41a6-9458-246700734af9-kube-api-access-cl9p4" (OuterVolumeSpecName: "kube-api-access-cl9p4") pod "3bd1a213-7d90-41a6-9458-246700734af9" (UID: "3bd1a213-7d90-41a6-9458-246700734af9"). InnerVolumeSpecName "kube-api-access-cl9p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:00:28.919456 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:28.919427 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-util" (OuterVolumeSpecName: "util") pod "3bd1a213-7d90-41a6-9458-246700734af9" (UID: "3bd1a213-7d90-41a6-9458-246700734af9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:00:29.015505 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.015476 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:29.015505 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.015502 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd1a213-7d90-41a6-9458-246700734af9-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:29.015505 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.015511 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl9p4\" (UniqueName: \"kubernetes.io/projected/3bd1a213-7d90-41a6-9458-246700734af9-kube-api-access-cl9p4\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:29.676111 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.676074 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" event={"ID":"3bd1a213-7d90-41a6-9458-246700734af9","Type":"ContainerDied","Data":"b626511425d1321bc8d18cf21366605a2d2c37b53cb6249f4edae87615bc5322"} Jun 02 02:00:29.676111 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.676095 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh" Jun 02 02:00:29.676568 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.676117 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b626511425d1321bc8d18cf21366605a2d2c37b53cb6249f4edae87615bc5322" Jun 02 02:00:29.678008 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.677972 2559 generic.go:358] "Generic (PLEG): container finished" podID="4625e8d1-bc27-4925-8b12-923432def909" containerID="dfbc4dbe2e0274ad1725f0aa4501d238732f08893b21b3d57503604cd95c09d0" exitCode=0 Jun 02 02:00:29.678118 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.678058 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" event={"ID":"4625e8d1-bc27-4925-8b12-923432def909","Type":"ContainerDied","Data":"dfbc4dbe2e0274ad1725f0aa4501d238732f08893b21b3d57503604cd95c09d0"} Jun 02 02:00:29.809215 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.809193 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:29.840603 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.840581 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:29.923864 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.923831 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpbg9\" (UniqueName: \"kubernetes.io/projected/03e52002-c224-4e6d-89b2-2691455cca8d-kube-api-access-wpbg9\") pod \"03e52002-c224-4e6d-89b2-2691455cca8d\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " Jun 02 02:00:29.923864 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.923865 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-util\") pod \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " Jun 02 02:00:29.924116 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.923972 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-bundle\") pod \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " Jun 02 02:00:29.924116 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.924070 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr9ss\" (UniqueName: \"kubernetes.io/projected/f6ea96af-f7df-4ade-a6f4-856d09010ebd-kube-api-access-sr9ss\") pod \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\" (UID: \"f6ea96af-f7df-4ade-a6f4-856d09010ebd\") " Jun 02 02:00:29.924116 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.924105 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-bundle\") pod \"03e52002-c224-4e6d-89b2-2691455cca8d\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " Jun 02 02:00:29.924298 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.924119 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-util\") pod \"03e52002-c224-4e6d-89b2-2691455cca8d\" (UID: \"03e52002-c224-4e6d-89b2-2691455cca8d\") " Jun 02 02:00:29.924605 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.924582 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-bundle" (OuterVolumeSpecName: "bundle") pod "f6ea96af-f7df-4ade-a6f4-856d09010ebd" (UID: "f6ea96af-f7df-4ade-a6f4-856d09010ebd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:00:29.924687 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.924582 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-bundle" (OuterVolumeSpecName: "bundle") pod "03e52002-c224-4e6d-89b2-2691455cca8d" (UID: "03e52002-c224-4e6d-89b2-2691455cca8d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:00:29.926251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.926195 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ea96af-f7df-4ade-a6f4-856d09010ebd-kube-api-access-sr9ss" (OuterVolumeSpecName: "kube-api-access-sr9ss") pod "f6ea96af-f7df-4ade-a6f4-856d09010ebd" (UID: "f6ea96af-f7df-4ade-a6f4-856d09010ebd"). InnerVolumeSpecName "kube-api-access-sr9ss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:00:29.926502 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.926488 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03e52002-c224-4e6d-89b2-2691455cca8d-kube-api-access-wpbg9" (OuterVolumeSpecName: "kube-api-access-wpbg9") pod "03e52002-c224-4e6d-89b2-2691455cca8d" (UID: "03e52002-c224-4e6d-89b2-2691455cca8d"). InnerVolumeSpecName "kube-api-access-wpbg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:00:29.929963 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.929943 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-util" (OuterVolumeSpecName: "util") pod "f6ea96af-f7df-4ade-a6f4-856d09010ebd" (UID: "f6ea96af-f7df-4ade-a6f4-856d09010ebd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:00:29.930273 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:29.930251 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-util" (OuterVolumeSpecName: "util") pod "03e52002-c224-4e6d-89b2-2691455cca8d" (UID: "03e52002-c224-4e6d-89b2-2691455cca8d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:00:30.025790 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.025757 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr9ss\" (UniqueName: \"kubernetes.io/projected/f6ea96af-f7df-4ade-a6f4-856d09010ebd-kube-api-access-sr9ss\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:30.025790 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.025788 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:30.025790 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.025797 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03e52002-c224-4e6d-89b2-2691455cca8d-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:30.026035 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.025805 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpbg9\" (UniqueName: \"kubernetes.io/projected/03e52002-c224-4e6d-89b2-2691455cca8d-kube-api-access-wpbg9\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:30.026035 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.025815 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:30.026035 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.025824 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f6ea96af-f7df-4ade-a6f4-856d09010ebd-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:30.683529 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.683482 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" event={"ID":"f6ea96af-f7df-4ade-a6f4-856d09010ebd","Type":"ContainerDied","Data":"83ab7c814ac61dfdead5d435e8e7093d45e564a92b17535249bee6f5eb7f62b9"} Jun 02 02:00:30.683529 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.683534 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83ab7c814ac61dfdead5d435e8e7093d45e564a92b17535249bee6f5eb7f62b9" Jun 02 02:00:30.683969 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.683537 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw" Jun 02 02:00:30.685187 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.685161 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" event={"ID":"03e52002-c224-4e6d-89b2-2691455cca8d","Type":"ContainerDied","Data":"301b8cf36cdd95a4e45ef2438e2b81a591811b1c329cb448d71600c1f454dfa9"} Jun 02 02:00:30.685187 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.685189 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="301b8cf36cdd95a4e45ef2438e2b81a591811b1c329cb448d71600c1f454dfa9" Jun 02 02:00:30.685361 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.685171 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms" Jun 02 02:00:30.818471 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.818447 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:30.931907 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.931874 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-bundle\") pod \"4625e8d1-bc27-4925-8b12-923432def909\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " Jun 02 02:00:30.932048 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.931941 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qjs2\" (UniqueName: \"kubernetes.io/projected/4625e8d1-bc27-4925-8b12-923432def909-kube-api-access-2qjs2\") pod \"4625e8d1-bc27-4925-8b12-923432def909\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " Jun 02 02:00:30.932048 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.932010 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-util\") pod \"4625e8d1-bc27-4925-8b12-923432def909\" (UID: \"4625e8d1-bc27-4925-8b12-923432def909\") " Jun 02 02:00:30.932498 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.932475 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-bundle" (OuterVolumeSpecName: "bundle") pod "4625e8d1-bc27-4925-8b12-923432def909" (UID: "4625e8d1-bc27-4925-8b12-923432def909"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:00:30.934078 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.934008 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4625e8d1-bc27-4925-8b12-923432def909-kube-api-access-2qjs2" (OuterVolumeSpecName: "kube-api-access-2qjs2") pod "4625e8d1-bc27-4925-8b12-923432def909" (UID: "4625e8d1-bc27-4925-8b12-923432def909"). InnerVolumeSpecName "kube-api-access-2qjs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:00:30.937030 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:30.937009 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-util" (OuterVolumeSpecName: "util") pod "4625e8d1-bc27-4925-8b12-923432def909" (UID: "4625e8d1-bc27-4925-8b12-923432def909"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:00:31.033217 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:31.033180 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qjs2\" (UniqueName: \"kubernetes.io/projected/4625e8d1-bc27-4925-8b12-923432def909-kube-api-access-2qjs2\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:31.033217 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:31.033212 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:31.033217 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:31.033222 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4625e8d1-bc27-4925-8b12-923432def909-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:00:31.690880 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:31.690847 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" Jun 02 02:00:31.690880 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:31.690862 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr" event={"ID":"4625e8d1-bc27-4925-8b12-923432def909","Type":"ContainerDied","Data":"6acb61f94d6687ba2b0e74e1d80fd59b3cb15621f5becef48e4916e6ce18d1cd"} Jun 02 02:00:31.691292 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:31.690897 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6acb61f94d6687ba2b0e74e1d80fd59b3cb15621f5becef48e4916e6ce18d1cd" Jun 02 02:00:36.261221 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261185 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-684cb67c7f-8z9gq"] Jun 02 02:00:36.261708 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261656 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e52002-c224-4e6d-89b2-2691455cca8d" containerName="pull" Jun 02 02:00:36.261708 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261673 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e52002-c224-4e6d-89b2-2691455cca8d" containerName="pull" Jun 02 02:00:36.261708 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261693 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e52002-c224-4e6d-89b2-2691455cca8d" containerName="extract" Jun 02 02:00:36.261708 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261701 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e52002-c224-4e6d-89b2-2691455cca8d" containerName="extract" Jun 02 02:00:36.261708 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261709 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4625e8d1-bc27-4925-8b12-923432def909" containerName="util" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261715 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4625e8d1-bc27-4925-8b12-923432def909" containerName="util" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261726 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerName="pull" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261730 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerName="pull" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261739 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261744 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261749 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4625e8d1-bc27-4925-8b12-923432def909" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261754 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4625e8d1-bc27-4925-8b12-923432def909" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261763 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4625e8d1-bc27-4925-8b12-923432def909" containerName="pull" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261770 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4625e8d1-bc27-4925-8b12-923432def909" containerName="pull" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261780 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e52002-c224-4e6d-89b2-2691455cca8d" containerName="util" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261785 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e52002-c224-4e6d-89b2-2691455cca8d" containerName="util" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261792 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerName="util" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261796 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerName="util" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261802 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd1a213-7d90-41a6-9458-246700734af9" containerName="pull" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261806 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd1a213-7d90-41a6-9458-246700734af9" containerName="pull" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261814 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd1a213-7d90-41a6-9458-246700734af9" containerName="util" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261818 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd1a213-7d90-41a6-9458-246700734af9" containerName="util" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261823 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd1a213-7d90-41a6-9458-246700734af9" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261828 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd1a213-7d90-41a6-9458-246700734af9" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261906 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="3bd1a213-7d90-41a6-9458-246700734af9" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261920 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="f6ea96af-f7df-4ade-a6f4-856d09010ebd" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261928 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="03e52002-c224-4e6d-89b2-2691455cca8d" containerName="extract" Jun 02 02:00:36.261928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.261942 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="4625e8d1-bc27-4925-8b12-923432def909" containerName="extract" Jun 02 02:00:36.266897 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.266878 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.274059 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.273108 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684cb67c7f-8z9gq"] Jun 02 02:00:36.379864 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.379830 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-trusted-ca-bundle\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.379864 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.379866 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-oauth-config\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.380048 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.379985 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-config\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.380048 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.380011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g82n6\" (UniqueName: \"kubernetes.io/projected/95728bb5-84b3-410d-b338-fd8c369a2f6b-kube-api-access-g82n6\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.380048 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.380034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-service-ca\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.380165 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.380050 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-serving-cert\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.380165 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.380071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-oauth-serving-cert\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.481393 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.481352 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-service-ca\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.481393 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.481397 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-serving-cert\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.481582 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.481413 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-oauth-serving-cert\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.481582 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.481470 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-trusted-ca-bundle\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.481582 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.481496 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-oauth-config\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.481582 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.481572 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-config\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.481765 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.481601 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g82n6\" (UniqueName: \"kubernetes.io/projected/95728bb5-84b3-410d-b338-fd8c369a2f6b-kube-api-access-g82n6\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.482195 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.482132 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-service-ca\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.482337 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.482167 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-oauth-serving-cert\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.482410 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.482343 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-trusted-ca-bundle\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.482410 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.482351 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-config\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.483865 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.483843 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-serving-cert\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.484050 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.484030 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/95728bb5-84b3-410d-b338-fd8c369a2f6b-console-oauth-config\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.489814 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.489796 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g82n6\" (UniqueName: \"kubernetes.io/projected/95728bb5-84b3-410d-b338-fd8c369a2f6b-kube-api-access-g82n6\") pod \"console-684cb67c7f-8z9gq\" (UID: \"95728bb5-84b3-410d-b338-fd8c369a2f6b\") " pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.577625 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.577542 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:36.712296 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:36.712274 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684cb67c7f-8z9gq"] Jun 02 02:00:36.713935 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:36.713912 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95728bb5_84b3_410d_b338_fd8c369a2f6b.slice/crio-f302998e824b921b2ad2a96763ec91c7932d1bfd218e0388bb4b326729279ab2 WatchSource:0}: Error finding container f302998e824b921b2ad2a96763ec91c7932d1bfd218e0388bb4b326729279ab2: Status 404 returned error can't find the container with id f302998e824b921b2ad2a96763ec91c7932d1bfd218e0388bb4b326729279ab2 Jun 02 02:00:37.716524 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:37.716486 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684cb67c7f-8z9gq" event={"ID":"95728bb5-84b3-410d-b338-fd8c369a2f6b","Type":"ContainerStarted","Data":"48a34076a56ca4bfbe7359ee1513fd1b68cd95590440e76b6c271aeefe27aa4b"} Jun 02 02:00:37.716524 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:37.716525 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684cb67c7f-8z9gq" event={"ID":"95728bb5-84b3-410d-b338-fd8c369a2f6b","Type":"ContainerStarted","Data":"f302998e824b921b2ad2a96763ec91c7932d1bfd218e0388bb4b326729279ab2"} Jun 02 02:00:37.735119 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:37.735073 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-684cb67c7f-8z9gq" podStartSLOduration=1.7350567300000002 podStartE2EDuration="1.73505673s" podCreationTimestamp="2026-06-02 02:00:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:00:37.734414749 +0000 UTC m=+599.650545778" watchObservedRunningTime="2026-06-02 02:00:37.73505673 +0000 UTC m=+599.651187757" Jun 02 02:00:38.721907 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:38.717255 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 02:00:38.721907 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:38.720400 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 02:00:41.204078 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.204046 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf"] Jun 02 02:00:41.214684 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.214661 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" Jun 02 02:00:41.224117 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.224096 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 02:00:41.224220 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.224161 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-b2w9j\"" Jun 02 02:00:41.236407 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.236376 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf"] Jun 02 02:00:41.327282 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.327235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fglkx\" (UniqueName: \"kubernetes.io/projected/b9208abe-55c5-42b4-874d-6b341fac55f7-kube-api-access-fglkx\") pod \"dns-operator-controller-manager-648d5c98bc-5msrf\" (UID: \"b9208abe-55c5-42b4-874d-6b341fac55f7\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" Jun 02 02:00:41.427924 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.427879 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fglkx\" (UniqueName: \"kubernetes.io/projected/b9208abe-55c5-42b4-874d-6b341fac55f7-kube-api-access-fglkx\") pod \"dns-operator-controller-manager-648d5c98bc-5msrf\" (UID: \"b9208abe-55c5-42b4-874d-6b341fac55f7\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" Jun 02 02:00:41.443976 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.443913 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fglkx\" (UniqueName: \"kubernetes.io/projected/b9208abe-55c5-42b4-874d-6b341fac55f7-kube-api-access-fglkx\") pod \"dns-operator-controller-manager-648d5c98bc-5msrf\" (UID: \"b9208abe-55c5-42b4-874d-6b341fac55f7\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" Jun 02 02:00:41.524708 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.524664 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" Jun 02 02:00:41.667853 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.667821 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf"] Jun 02 02:00:41.671607 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:41.671574 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9208abe_55c5_42b4_874d_6b341fac55f7.slice/crio-a606979ad03768dc1839fe58e0ba8a5a1db4d46c96b7bb0bed279034652bbc2e WatchSource:0}: Error finding container a606979ad03768dc1839fe58e0ba8a5a1db4d46c96b7bb0bed279034652bbc2e: Status 404 returned error can't find the container with id a606979ad03768dc1839fe58e0ba8a5a1db4d46c96b7bb0bed279034652bbc2e Jun 02 02:00:41.734673 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:41.734638 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" event={"ID":"b9208abe-55c5-42b4-874d-6b341fac55f7","Type":"ContainerStarted","Data":"a606979ad03768dc1839fe58e0ba8a5a1db4d46c96b7bb0bed279034652bbc2e"} Jun 02 02:00:44.654190 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.654151 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq"] Jun 02 02:00:44.656510 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.656496 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:00:44.659424 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.659406 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kkc9n\"" Jun 02 02:00:44.662289 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.662268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdhtw\" (UniqueName: \"kubernetes.io/projected/7bdf18be-53fd-4377-a1a2-72ec17661d81-kube-api-access-vdhtw\") pod \"limitador-operator-controller-manager-85c4996f8c-2vmzq\" (UID: \"7bdf18be-53fd-4377-a1a2-72ec17661d81\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:00:44.673240 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.673215 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq"] Jun 02 02:00:44.749498 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.749464 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" event={"ID":"b9208abe-55c5-42b4-874d-6b341fac55f7","Type":"ContainerStarted","Data":"9510831177d9332cf985baf34a3c64a5307cfa89029afb1e97ae57bb0d064fd9"} Jun 02 02:00:44.749675 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.749552 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" Jun 02 02:00:44.763338 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.763251 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdhtw\" (UniqueName: \"kubernetes.io/projected/7bdf18be-53fd-4377-a1a2-72ec17661d81-kube-api-access-vdhtw\") pod \"limitador-operator-controller-manager-85c4996f8c-2vmzq\" (UID: \"7bdf18be-53fd-4377-a1a2-72ec17661d81\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:00:44.800615 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.800553 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" podStartSLOduration=0.969212214 podStartE2EDuration="3.800534842s" podCreationTimestamp="2026-06-02 02:00:41 +0000 UTC" firstStartedPulling="2026-06-02 02:00:41.673637783 +0000 UTC m=+603.589768789" lastFinishedPulling="2026-06-02 02:00:44.504960396 +0000 UTC m=+606.421091417" observedRunningTime="2026-06-02 02:00:44.797908945 +0000 UTC m=+606.714039985" watchObservedRunningTime="2026-06-02 02:00:44.800534842 +0000 UTC m=+606.716665872" Jun 02 02:00:44.801757 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.801729 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdhtw\" (UniqueName: \"kubernetes.io/projected/7bdf18be-53fd-4377-a1a2-72ec17661d81-kube-api-access-vdhtw\") pod \"limitador-operator-controller-manager-85c4996f8c-2vmzq\" (UID: \"7bdf18be-53fd-4377-a1a2-72ec17661d81\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:00:44.966010 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:44.965978 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:00:45.163580 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:45.163557 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq"] Jun 02 02:00:45.165324 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:45.165298 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdf18be_53fd_4377_a1a2_72ec17661d81.slice/crio-7c199f9d5a05dec10ee4cd0179589b9644d0c085a069ff05f0353a62cf758612 WatchSource:0}: Error finding container 7c199f9d5a05dec10ee4cd0179589b9644d0c085a069ff05f0353a62cf758612: Status 404 returned error can't find the container with id 7c199f9d5a05dec10ee4cd0179589b9644d0c085a069ff05f0353a62cf758612 Jun 02 02:00:45.756817 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:45.756777 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" event={"ID":"7bdf18be-53fd-4377-a1a2-72ec17661d81","Type":"ContainerStarted","Data":"7c199f9d5a05dec10ee4cd0179589b9644d0c085a069ff05f0353a62cf758612"} Jun 02 02:00:46.578418 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:46.578378 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:46.578683 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:46.578662 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:46.583971 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:46.583940 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:46.767102 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:46.766441 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684cb67c7f-8z9gq" Jun 02 02:00:46.852153 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:46.852042 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6744967664-q99b8"] Jun 02 02:00:47.766497 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:47.766464 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" event={"ID":"7bdf18be-53fd-4377-a1a2-72ec17661d81","Type":"ContainerStarted","Data":"d042c8274bcd264677a95af087c23a92f68d36e2588c5963ccfc754d80473f55"} Jun 02 02:00:47.766743 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:47.766725 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:00:47.793965 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:47.793898 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" podStartSLOduration=2.006055091 podStartE2EDuration="3.793881965s" podCreationTimestamp="2026-06-02 02:00:44 +0000 UTC" firstStartedPulling="2026-06-02 02:00:45.16762458 +0000 UTC m=+607.083755586" lastFinishedPulling="2026-06-02 02:00:46.95545145 +0000 UTC m=+608.871582460" observedRunningTime="2026-06-02 02:00:47.79119474 +0000 UTC m=+609.707325769" watchObservedRunningTime="2026-06-02 02:00:47.793881965 +0000 UTC m=+609.710012993" Jun 02 02:00:49.862320 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:49.862288 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn"] Jun 02 02:00:49.864810 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:49.864795 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:49.870553 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:49.870533 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s6xgs\"" Jun 02 02:00:49.881607 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:49.881582 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn"] Jun 02 02:00:49.913568 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:49.913536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e61b914-b1dc-479f-93f3-15388fa87422-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" (UID: \"2e61b914-b1dc-479f-93f3-15388fa87422\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:49.913743 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:49.913651 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdd6p\" (UniqueName: \"kubernetes.io/projected/2e61b914-b1dc-479f-93f3-15388fa87422-kube-api-access-fdd6p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" (UID: \"2e61b914-b1dc-479f-93f3-15388fa87422\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:50.014927 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:50.014868 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdd6p\" (UniqueName: \"kubernetes.io/projected/2e61b914-b1dc-479f-93f3-15388fa87422-kube-api-access-fdd6p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" (UID: \"2e61b914-b1dc-479f-93f3-15388fa87422\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:50.015124 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:50.014957 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e61b914-b1dc-479f-93f3-15388fa87422-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" (UID: \"2e61b914-b1dc-479f-93f3-15388fa87422\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:50.015384 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:50.015364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e61b914-b1dc-479f-93f3-15388fa87422-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" (UID: \"2e61b914-b1dc-479f-93f3-15388fa87422\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:50.024634 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:50.024615 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdd6p\" (UniqueName: \"kubernetes.io/projected/2e61b914-b1dc-479f-93f3-15388fa87422-kube-api-access-fdd6p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" (UID: \"2e61b914-b1dc-479f-93f3-15388fa87422\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:50.174632 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:50.174540 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:50.323166 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:50.323119 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn"] Jun 02 02:00:50.323607 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:00:50.323574 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e61b914_b1dc_479f_93f3_15388fa87422.slice/crio-e4f627c13d6466b013df05444be7f341efe35148787586cc9b061b95b3f652f4 WatchSource:0}: Error finding container e4f627c13d6466b013df05444be7f341efe35148787586cc9b061b95b3f652f4: Status 404 returned error can't find the container with id e4f627c13d6466b013df05444be7f341efe35148787586cc9b061b95b3f652f4 Jun 02 02:00:50.778568 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:50.778534 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" event={"ID":"2e61b914-b1dc-479f-93f3-15388fa87422","Type":"ContainerStarted","Data":"e4f627c13d6466b013df05444be7f341efe35148787586cc9b061b95b3f652f4"} Jun 02 02:00:55.760011 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:55.759938 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5msrf" Jun 02 02:00:55.800255 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:55.800124 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" event={"ID":"2e61b914-b1dc-479f-93f3-15388fa87422","Type":"ContainerStarted","Data":"8110c185b70e0ec0ddfa32b700dd47bea36f05599700af48e9aa030caa2a35fd"} Jun 02 02:00:55.800255 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:55.800195 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:00:55.830428 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:55.830369 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" podStartSLOduration=1.8009288620000001 podStartE2EDuration="6.830350972s" podCreationTimestamp="2026-06-02 02:00:49 +0000 UTC" firstStartedPulling="2026-06-02 02:00:50.325850427 +0000 UTC m=+612.241981433" lastFinishedPulling="2026-06-02 02:00:55.355272534 +0000 UTC m=+617.271403543" observedRunningTime="2026-06-02 02:00:55.829411922 +0000 UTC m=+617.745542949" watchObservedRunningTime="2026-06-02 02:00:55.830350972 +0000 UTC m=+617.746482000" Jun 02 02:00:58.772967 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:00:58.772897 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:01:06.805803 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:06.805777 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:01:08.608487 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.608451 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn"] Jun 02 02:01:08.608968 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.608688 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" containerName="manager" containerID="cri-o://8110c185b70e0ec0ddfa32b700dd47bea36f05599700af48e9aa030caa2a35fd" gracePeriod=2 Jun 02 02:01:08.621404 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.621376 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn"] Jun 02 02:01:08.649054 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.649022 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs"] Jun 02 02:01:08.649479 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.649464 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" containerName="manager" Jun 02 02:01:08.649532 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.649482 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" containerName="manager" Jun 02 02:01:08.649611 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.649543 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" containerName="manager" Jun 02 02:01:08.651756 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.651735 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:08.663469 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.663431 2559 status_manager.go:895] "Failed to get status for pod" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" is forbidden: User \"system:node:ip-10-0-135-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-96.ec2.internal' and this object" Jun 02 02:01:08.680739 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.680707 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs"] Jun 02 02:01:08.683876 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.683856 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq"] Jun 02 02:01:08.684090 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.684070 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" podUID="7bdf18be-53fd-4377-a1a2-72ec17661d81" containerName="manager" containerID="cri-o://d042c8274bcd264677a95af087c23a92f68d36e2588c5963ccfc754d80473f55" gracePeriod=2 Jun 02 02:01:08.699068 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.699042 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq"] Jun 02 02:01:08.703025 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.703000 2559 status_manager.go:895] "Failed to get status for pod" podUID="7bdf18be-53fd-4377-a1a2-72ec17661d81" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" err="pods \"limitador-operator-controller-manager-85c4996f8c-2vmzq\" is forbidden: User \"system:node:ip-10-0-135-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-96.ec2.internal' and this object" Jun 02 02:01:08.707320 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.707289 2559 status_manager.go:895] "Failed to get status for pod" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" is forbidden: User \"system:node:ip-10-0-135-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-96.ec2.internal' and this object" Jun 02 02:01:08.714384 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.714359 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8"] Jun 02 02:01:08.714973 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.714951 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bdf18be-53fd-4377-a1a2-72ec17661d81" containerName="manager" Jun 02 02:01:08.714973 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.714973 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bdf18be-53fd-4377-a1a2-72ec17661d81" containerName="manager" Jun 02 02:01:08.715115 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.715059 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="7bdf18be-53fd-4377-a1a2-72ec17661d81" containerName="manager" Jun 02 02:01:08.717251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.717231 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" Jun 02 02:01:08.720263 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.720234 2559 status_manager.go:895] "Failed to get status for pod" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" is forbidden: User \"system:node:ip-10-0-135-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-96.ec2.internal' and this object" Jun 02 02:01:08.729308 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.729278 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8"] Jun 02 02:01:08.750921 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.750890 2559 status_manager.go:895] "Failed to get status for pod" podUID="7bdf18be-53fd-4377-a1a2-72ec17661d81" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" err="pods \"limitador-operator-controller-manager-85c4996f8c-2vmzq\" is forbidden: User \"system:node:ip-10-0-135-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-96.ec2.internal' and this object" Jun 02 02:01:08.761414 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.761381 2559 status_manager.go:895] "Failed to get status for pod" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-w86wn\" is forbidden: User \"system:node:ip-10-0-135-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-96.ec2.internal' and this object" Jun 02 02:01:08.764789 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.764763 2559 status_manager.go:895] "Failed to get status for pod" podUID="7bdf18be-53fd-4377-a1a2-72ec17661d81" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" err="pods \"limitador-operator-controller-manager-85c4996f8c-2vmzq\" is forbidden: User \"system:node:ip-10-0-135-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-96.ec2.internal' and this object" Jun 02 02:01:08.796065 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.796034 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2w7p\" (UniqueName: \"kubernetes.io/projected/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-kube-api-access-w2w7p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sj8vs\" (UID: \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:08.796206 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.796090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sj8vs\" (UID: \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:08.796271 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.796254 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87s5\" (UniqueName: \"kubernetes.io/projected/8398a5f6-5b25-4025-bbcf-e69e661a6d45-kube-api-access-n87s5\") pod \"limitador-operator-controller-manager-85c4996f8c-kc5w8\" (UID: \"8398a5f6-5b25-4025-bbcf-e69e661a6d45\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" Jun 02 02:01:08.852481 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.852423 2559 generic.go:358] "Generic (PLEG): container finished" podID="7bdf18be-53fd-4377-a1a2-72ec17661d81" containerID="d042c8274bcd264677a95af087c23a92f68d36e2588c5963ccfc754d80473f55" exitCode=0 Jun 02 02:01:08.854259 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.854072 2559 generic.go:358] "Generic (PLEG): container finished" podID="2e61b914-b1dc-479f-93f3-15388fa87422" containerID="8110c185b70e0ec0ddfa32b700dd47bea36f05599700af48e9aa030caa2a35fd" exitCode=0 Jun 02 02:01:08.897844 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.897733 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2w7p\" (UniqueName: \"kubernetes.io/projected/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-kube-api-access-w2w7p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sj8vs\" (UID: \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:08.897844 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.897778 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sj8vs\" (UID: \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:08.897990 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.897877 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n87s5\" (UniqueName: \"kubernetes.io/projected/8398a5f6-5b25-4025-bbcf-e69e661a6d45-kube-api-access-n87s5\") pod \"limitador-operator-controller-manager-85c4996f8c-kc5w8\" (UID: \"8398a5f6-5b25-4025-bbcf-e69e661a6d45\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" Jun 02 02:01:08.898294 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.898215 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sj8vs\" (UID: \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:08.912243 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.912215 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87s5\" (UniqueName: \"kubernetes.io/projected/8398a5f6-5b25-4025-bbcf-e69e661a6d45-kube-api-access-n87s5\") pod \"limitador-operator-controller-manager-85c4996f8c-kc5w8\" (UID: \"8398a5f6-5b25-4025-bbcf-e69e661a6d45\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" Jun 02 02:01:08.917562 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.917540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2w7p\" (UniqueName: \"kubernetes.io/projected/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-kube-api-access-w2w7p\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sj8vs\" (UID: \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:08.924488 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.924459 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:01:08.927768 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.927751 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:01:08.987819 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.987787 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:08.998876 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.998845 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdhtw\" (UniqueName: \"kubernetes.io/projected/7bdf18be-53fd-4377-a1a2-72ec17661d81-kube-api-access-vdhtw\") pod \"7bdf18be-53fd-4377-a1a2-72ec17661d81\" (UID: \"7bdf18be-53fd-4377-a1a2-72ec17661d81\") " Jun 02 02:01:08.998980 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.998901 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdd6p\" (UniqueName: \"kubernetes.io/projected/2e61b914-b1dc-479f-93f3-15388fa87422-kube-api-access-fdd6p\") pod \"2e61b914-b1dc-479f-93f3-15388fa87422\" (UID: \"2e61b914-b1dc-479f-93f3-15388fa87422\") " Jun 02 02:01:08.999027 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.998998 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e61b914-b1dc-479f-93f3-15388fa87422-extensions-socket-volume\") pod \"2e61b914-b1dc-479f-93f3-15388fa87422\" (UID: \"2e61b914-b1dc-479f-93f3-15388fa87422\") " Jun 02 02:01:08.999602 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:08.999569 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e61b914-b1dc-479f-93f3-15388fa87422-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2e61b914-b1dc-479f-93f3-15388fa87422" (UID: "2e61b914-b1dc-479f-93f3-15388fa87422"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:01:09.000951 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.000922 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bdf18be-53fd-4377-a1a2-72ec17661d81-kube-api-access-vdhtw" (OuterVolumeSpecName: "kube-api-access-vdhtw") pod "7bdf18be-53fd-4377-a1a2-72ec17661d81" (UID: "7bdf18be-53fd-4377-a1a2-72ec17661d81"). InnerVolumeSpecName "kube-api-access-vdhtw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:01:09.001128 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.001104 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e61b914-b1dc-479f-93f3-15388fa87422-kube-api-access-fdd6p" (OuterVolumeSpecName: "kube-api-access-fdd6p") pod "2e61b914-b1dc-479f-93f3-15388fa87422" (UID: "2e61b914-b1dc-479f-93f3-15388fa87422"). InnerVolumeSpecName "kube-api-access-fdd6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:01:09.072440 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.072387 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" Jun 02 02:01:09.100339 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.100305 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdhtw\" (UniqueName: \"kubernetes.io/projected/7bdf18be-53fd-4377-a1a2-72ec17661d81-kube-api-access-vdhtw\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:09.100339 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.100341 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdd6p\" (UniqueName: \"kubernetes.io/projected/2e61b914-b1dc-479f-93f3-15388fa87422-kube-api-access-fdd6p\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:09.100536 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.100359 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e61b914-b1dc-479f-93f3-15388fa87422-extensions-socket-volume\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:09.129808 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.129777 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs"] Jun 02 02:01:09.131489 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:01:09.131305 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e59f1af_f437_4d0a_bdc6_4ec41a27d367.slice/crio-5b2de2540d1ff837208ebcaf5d0c1e80096a02143a7c49254f7d77c3ba755969 WatchSource:0}: Error finding container 5b2de2540d1ff837208ebcaf5d0c1e80096a02143a7c49254f7d77c3ba755969: Status 404 returned error can't find the container with id 5b2de2540d1ff837208ebcaf5d0c1e80096a02143a7c49254f7d77c3ba755969 Jun 02 02:01:09.220179 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.220130 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8"] Jun 02 02:01:09.221596 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:01:09.221564 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8398a5f6_5b25_4025_bbcf_e69e661a6d45.slice/crio-1081cc716982b996976f0be5fe9e3c93262c72d10aaad16bfd2630214debf007 WatchSource:0}: Error finding container 1081cc716982b996976f0be5fe9e3c93262c72d10aaad16bfd2630214debf007: Status 404 returned error can't find the container with id 1081cc716982b996976f0be5fe9e3c93262c72d10aaad16bfd2630214debf007 Jun 02 02:01:09.866050 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.866021 2559 scope.go:117] "RemoveContainer" containerID="8110c185b70e0ec0ddfa32b700dd47bea36f05599700af48e9aa030caa2a35fd" Jun 02 02:01:09.866050 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.866044 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-w86wn" Jun 02 02:01:09.868892 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.868834 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" event={"ID":"8398a5f6-5b25-4025-bbcf-e69e661a6d45","Type":"ContainerStarted","Data":"b29f0eab4409f760b8fa0645e4dd451c15df62b982245b18f2c7ee5b8e5697c1"} Jun 02 02:01:09.868892 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.868875 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" event={"ID":"8398a5f6-5b25-4025-bbcf-e69e661a6d45","Type":"ContainerStarted","Data":"1081cc716982b996976f0be5fe9e3c93262c72d10aaad16bfd2630214debf007"} Jun 02 02:01:09.869067 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.868930 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" Jun 02 02:01:09.870603 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.870579 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-2vmzq" Jun 02 02:01:09.872860 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.872830 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" event={"ID":"8e59f1af-f437-4d0a-bdc6-4ec41a27d367","Type":"ContainerStarted","Data":"6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc"} Jun 02 02:01:09.872972 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.872876 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" event={"ID":"8e59f1af-f437-4d0a-bdc6-4ec41a27d367","Type":"ContainerStarted","Data":"5b2de2540d1ff837208ebcaf5d0c1e80096a02143a7c49254f7d77c3ba755969"} Jun 02 02:01:09.872972 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.872935 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:09.878975 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.878952 2559 scope.go:117] "RemoveContainer" containerID="d042c8274bcd264677a95af087c23a92f68d36e2588c5963ccfc754d80473f55" Jun 02 02:01:09.894751 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.894712 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" podStartSLOduration=1.8946998860000002 podStartE2EDuration="1.894699886s" podCreationTimestamp="2026-06-02 02:01:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:01:09.892897981 +0000 UTC m=+631.809029008" watchObservedRunningTime="2026-06-02 02:01:09.894699886 +0000 UTC m=+631.810830913" Jun 02 02:01:09.933388 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:09.933330 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" podStartSLOduration=1.933311896 podStartE2EDuration="1.933311896s" podCreationTimestamp="2026-06-02 02:01:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:01:09.931507179 +0000 UTC m=+631.847638209" watchObservedRunningTime="2026-06-02 02:01:09.933311896 +0000 UTC m=+631.849442927" Jun 02 02:01:10.760107 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:10.760073 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e61b914-b1dc-479f-93f3-15388fa87422" path="/var/lib/kubelet/pods/2e61b914-b1dc-479f-93f3-15388fa87422/volumes" Jun 02 02:01:10.760423 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:10.760409 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bdf18be-53fd-4377-a1a2-72ec17661d81" path="/var/lib/kubelet/pods/7bdf18be-53fd-4377-a1a2-72ec17661d81/volumes" Jun 02 02:01:11.879098 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:11.879057 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6744967664-q99b8" podUID="b9d783d0-984e-4cf3-845f-809babb4d82e" containerName="console" containerID="cri-o://c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df" gracePeriod=15 Jun 02 02:01:12.134080 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.134024 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6744967664-q99b8_b9d783d0-984e-4cf3-845f-809babb4d82e/console/0.log" Jun 02 02:01:12.134218 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.134096 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6744967664-q99b8" Jun 02 02:01:12.229671 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.229633 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stxxj\" (UniqueName: \"kubernetes.io/projected/b9d783d0-984e-4cf3-845f-809babb4d82e-kube-api-access-stxxj\") pod \"b9d783d0-984e-4cf3-845f-809babb4d82e\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " Jun 02 02:01:12.229860 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.229701 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-service-ca\") pod \"b9d783d0-984e-4cf3-845f-809babb4d82e\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " Jun 02 02:01:12.229860 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.229802 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-oauth-config\") pod \"b9d783d0-984e-4cf3-845f-809babb4d82e\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " Jun 02 02:01:12.229860 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.229835 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-console-config\") pod \"b9d783d0-984e-4cf3-845f-809babb4d82e\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " Jun 02 02:01:12.230028 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.229863 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-serving-cert\") pod \"b9d783d0-984e-4cf3-845f-809babb4d82e\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " Jun 02 02:01:12.230028 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.229967 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-trusted-ca-bundle\") pod \"b9d783d0-984e-4cf3-845f-809babb4d82e\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " Jun 02 02:01:12.230028 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.229994 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-oauth-serving-cert\") pod \"b9d783d0-984e-4cf3-845f-809babb4d82e\" (UID: \"b9d783d0-984e-4cf3-845f-809babb4d82e\") " Jun 02 02:01:12.230229 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.230092 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-service-ca" (OuterVolumeSpecName: "service-ca") pod "b9d783d0-984e-4cf3-845f-809babb4d82e" (UID: "b9d783d0-984e-4cf3-845f-809babb4d82e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:01:12.230229 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.230206 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-console-config" (OuterVolumeSpecName: "console-config") pod "b9d783d0-984e-4cf3-845f-809babb4d82e" (UID: "b9d783d0-984e-4cf3-845f-809babb4d82e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:01:12.230368 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.230349 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-service-ca\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:12.230432 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.230373 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-console-config\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:12.230488 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.230436 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b9d783d0-984e-4cf3-845f-809babb4d82e" (UID: "b9d783d0-984e-4cf3-845f-809babb4d82e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:01:12.230539 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.230520 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b9d783d0-984e-4cf3-845f-809babb4d82e" (UID: "b9d783d0-984e-4cf3-845f-809babb4d82e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:01:12.231857 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.231833 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b9d783d0-984e-4cf3-845f-809babb4d82e" (UID: "b9d783d0-984e-4cf3-845f-809babb4d82e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:01:12.231940 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.231902 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b9d783d0-984e-4cf3-845f-809babb4d82e" (UID: "b9d783d0-984e-4cf3-845f-809babb4d82e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:01:12.231940 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.231928 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9d783d0-984e-4cf3-845f-809babb4d82e-kube-api-access-stxxj" (OuterVolumeSpecName: "kube-api-access-stxxj") pod "b9d783d0-984e-4cf3-845f-809babb4d82e" (UID: "b9d783d0-984e-4cf3-845f-809babb4d82e"). InnerVolumeSpecName "kube-api-access-stxxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:01:12.330926 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.330896 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stxxj\" (UniqueName: \"kubernetes.io/projected/b9d783d0-984e-4cf3-845f-809babb4d82e-kube-api-access-stxxj\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:12.330926 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.330922 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-oauth-config\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:12.330926 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.330931 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d783d0-984e-4cf3-845f-809babb4d82e-console-serving-cert\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:12.331163 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.330939 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-trusted-ca-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:12.331163 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.330949 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b9d783d0-984e-4cf3-845f-809babb4d82e-oauth-serving-cert\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:12.888412 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.888385 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6744967664-q99b8_b9d783d0-984e-4cf3-845f-809babb4d82e/console/0.log" Jun 02 02:01:12.888850 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.888424 2559 generic.go:358] "Generic (PLEG): container finished" podID="b9d783d0-984e-4cf3-845f-809babb4d82e" containerID="c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df" exitCode=2 Jun 02 02:01:12.888850 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.888487 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6744967664-q99b8" Jun 02 02:01:12.888850 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.888528 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6744967664-q99b8" event={"ID":"b9d783d0-984e-4cf3-845f-809babb4d82e","Type":"ContainerDied","Data":"c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df"} Jun 02 02:01:12.888850 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.888575 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6744967664-q99b8" event={"ID":"b9d783d0-984e-4cf3-845f-809babb4d82e","Type":"ContainerDied","Data":"2c0f2fe7713a07a6975e88168a4ed9e7507a225a0aaf5d7b3122339d0ed791b3"} Jun 02 02:01:12.888850 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.888597 2559 scope.go:117] "RemoveContainer" containerID="c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df" Jun 02 02:01:12.897341 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.897324 2559 scope.go:117] "RemoveContainer" containerID="c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df" Jun 02 02:01:12.897556 ip-10-0-135-96 kubenswrapper[2559]: E0602 02:01:12.897540 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df\": container with ID starting with c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df not found: ID does not exist" containerID="c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df" Jun 02 02:01:12.897621 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.897564 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df"} err="failed to get container status \"c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df\": rpc error: code = NotFound desc = could not find container \"c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df\": container with ID starting with c091e35a8043630aae8dcd89244f1e776d868e99b4e7dc9d9ffed88d6eda08df not found: ID does not exist" Jun 02 02:01:12.908747 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.908725 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6744967664-q99b8"] Jun 02 02:01:12.910979 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:12.910960 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6744967664-q99b8"] Jun 02 02:01:14.760102 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:14.760070 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9d783d0-984e-4cf3-845f-809babb4d82e" path="/var/lib/kubelet/pods/b9d783d0-984e-4cf3-845f-809babb4d82e/volumes" Jun 02 02:01:20.881395 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:20.881359 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:20.881914 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:20.881775 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-kc5w8" Jun 02 02:01:24.061612 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.061579 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs"] Jun 02 02:01:24.061987 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.061786 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" podUID="8e59f1af-f437-4d0a-bdc6-4ec41a27d367" containerName="manager" containerID="cri-o://6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc" gracePeriod=10 Jun 02 02:01:24.312415 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.312358 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:24.347355 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.347317 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-extensions-socket-volume\") pod \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\" (UID: \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\") " Jun 02 02:01:24.347522 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.347377 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2w7p\" (UniqueName: \"kubernetes.io/projected/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-kube-api-access-w2w7p\") pod \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\" (UID: \"8e59f1af-f437-4d0a-bdc6-4ec41a27d367\") " Jun 02 02:01:24.347798 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.347769 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e59f1af-f437-4d0a-bdc6-4ec41a27d367" (UID: "8e59f1af-f437-4d0a-bdc6-4ec41a27d367"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:01:24.349498 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.349469 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-kube-api-access-w2w7p" (OuterVolumeSpecName: "kube-api-access-w2w7p") pod "8e59f1af-f437-4d0a-bdc6-4ec41a27d367" (UID: "8e59f1af-f437-4d0a-bdc6-4ec41a27d367"). InnerVolumeSpecName "kube-api-access-w2w7p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:01:24.448858 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.448825 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-extensions-socket-volume\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:24.448858 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.448853 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2w7p\" (UniqueName: \"kubernetes.io/projected/8e59f1af-f437-4d0a-bdc6-4ec41a27d367-kube-api-access-w2w7p\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:01:24.938900 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.938864 2559 generic.go:358] "Generic (PLEG): container finished" podID="8e59f1af-f437-4d0a-bdc6-4ec41a27d367" containerID="6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc" exitCode=0 Jun 02 02:01:24.939068 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.938913 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" event={"ID":"8e59f1af-f437-4d0a-bdc6-4ec41a27d367","Type":"ContainerDied","Data":"6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc"} Jun 02 02:01:24.939068 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.938928 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" Jun 02 02:01:24.939068 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.938945 2559 scope.go:117] "RemoveContainer" containerID="6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc" Jun 02 02:01:24.939068 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.938936 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs" event={"ID":"8e59f1af-f437-4d0a-bdc6-4ec41a27d367","Type":"ContainerDied","Data":"5b2de2540d1ff837208ebcaf5d0c1e80096a02143a7c49254f7d77c3ba755969"} Jun 02 02:01:24.947917 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.947899 2559 scope.go:117] "RemoveContainer" containerID="6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc" Jun 02 02:01:24.948202 ip-10-0-135-96 kubenswrapper[2559]: E0602 02:01:24.948179 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc\": container with ID starting with 6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc not found: ID does not exist" containerID="6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc" Jun 02 02:01:24.948302 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.948206 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc"} err="failed to get container status \"6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc\": rpc error: code = NotFound desc = could not find container \"6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc\": container with ID starting with 6b526fa0025562c553d748c054bded1ee4987f4a62af69b042c9b03b105511fc not found: ID does not exist" Jun 02 02:01:24.960513 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.960485 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs"] Jun 02 02:01:24.963868 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:24.963845 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sj8vs"] Jun 02 02:01:26.761196 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:26.761167 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e59f1af-f437-4d0a-bdc6-4ec41a27d367" path="/var/lib/kubelet/pods/8e59f1af-f437-4d0a-bdc6-4ec41a27d367/volumes" Jun 02 02:01:40.337872 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.337835 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r"] Jun 02 02:01:40.338281 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.338268 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e59f1af-f437-4d0a-bdc6-4ec41a27d367" containerName="manager" Jun 02 02:01:40.338327 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.338282 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e59f1af-f437-4d0a-bdc6-4ec41a27d367" containerName="manager" Jun 02 02:01:40.338327 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.338296 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9d783d0-984e-4cf3-845f-809babb4d82e" containerName="console" Jun 02 02:01:40.338327 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.338301 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9d783d0-984e-4cf3-845f-809babb4d82e" containerName="console" Jun 02 02:01:40.338439 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.338357 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="8e59f1af-f437-4d0a-bdc6-4ec41a27d367" containerName="manager" Jun 02 02:01:40.338439 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.338364 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b9d783d0-984e-4cf3-845f-809babb4d82e" containerName="console" Jun 02 02:01:40.349184 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.349132 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.352356 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.352329 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-npmbt\"" Jun 02 02:01:40.363285 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.363257 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r"] Jun 02 02:01:40.391938 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.391910 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.392066 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.391962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.392066 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.391982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.392066 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.392048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.392192 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.392078 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.392192 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.392113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.392192 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.392178 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.392289 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.392209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.392289 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.392229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlj94\" (UniqueName: \"kubernetes.io/projected/74be30f5-ac49-48b8-bd75-5885d2f7c20a-kube-api-access-jlj94\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493266 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493226 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493457 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493293 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493457 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493321 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jlj94\" (UniqueName: \"kubernetes.io/projected/74be30f5-ac49-48b8-bd75-5885d2f7c20a-kube-api-access-jlj94\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493457 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493370 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493457 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493441 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493687 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493464 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493687 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493604 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493687 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493652 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493859 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493704 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493859 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.493859 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493792 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.494029 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.493980 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.494092 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.494031 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.494092 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.494075 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.496114 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.496088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.496325 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.496309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.502980 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.502961 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74be30f5-ac49-48b8-bd75-5885d2f7c20a-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.503348 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.503330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlj94\" (UniqueName: \"kubernetes.io/projected/74be30f5-ac49-48b8-bd75-5885d2f7c20a-kube-api-access-jlj94\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-g9l8r\" (UID: \"74be30f5-ac49-48b8-bd75-5885d2f7c20a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.661842 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.661767 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:40.807778 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.807743 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r"] Jun 02 02:01:40.808890 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:01:40.808852 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74be30f5_ac49_48b8_bd75_5885d2f7c20a.slice/crio-b42c7b05fb35bec3a7db5e6355a8fac487c36fe4adde43b9b1965e7dccd46446 WatchSource:0}: Error finding container b42c7b05fb35bec3a7db5e6355a8fac487c36fe4adde43b9b1965e7dccd46446: Status 404 returned error can't find the container with id b42c7b05fb35bec3a7db5e6355a8fac487c36fe4adde43b9b1965e7dccd46446 Jun 02 02:01:40.810700 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.810681 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:01:40.811035 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.811007 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 02:01:40.811087 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.811063 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 02:01:40.811119 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:40.811091 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 02:01:41.003799 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:41.003766 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" event={"ID":"74be30f5-ac49-48b8-bd75-5885d2f7c20a","Type":"ContainerStarted","Data":"dff7830e0b03422cab912a630359dffd4fd8bbc86e8acb428233b9b1183ade89"} Jun 02 02:01:41.003799 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:41.003801 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" event={"ID":"74be30f5-ac49-48b8-bd75-5885d2f7c20a","Type":"ContainerStarted","Data":"b42c7b05fb35bec3a7db5e6355a8fac487c36fe4adde43b9b1965e7dccd46446"} Jun 02 02:01:41.037258 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:41.037210 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" podStartSLOduration=1.037197233 podStartE2EDuration="1.037197233s" podCreationTimestamp="2026-06-02 02:01:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:01:41.034313068 +0000 UTC m=+662.950444095" watchObservedRunningTime="2026-06-02 02:01:41.037197233 +0000 UTC m=+662.953328264" Jun 02 02:01:41.662619 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:41.662586 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:41.663906 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:41.663877 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jun 02 02:01:41.664049 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:41.663925 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" podUID="74be30f5-ac49-48b8-bd75-5885d2f7c20a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jun 02 02:01:42.666578 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:42.666549 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:43.012277 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:43.012247 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:43.013285 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:43.013267 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-g9l8r" Jun 02 02:01:45.070880 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.070844 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7m4hj"] Jun 02 02:01:45.073465 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.073445 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:45.076096 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.076074 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dvzkm\"" Jun 02 02:01:45.076226 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.076082 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 02:01:45.081844 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.081818 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7m4hj"] Jun 02 02:01:45.139407 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.139372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b93ff304-930f-44d5-bc32-5844199e3b05-config-file\") pod \"limitador-limitador-7d549b5b-7m4hj\" (UID: \"b93ff304-930f-44d5-bc32-5844199e3b05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:45.139693 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.139675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwsl6\" (UniqueName: \"kubernetes.io/projected/b93ff304-930f-44d5-bc32-5844199e3b05-kube-api-access-hwsl6\") pod \"limitador-limitador-7d549b5b-7m4hj\" (UID: \"b93ff304-930f-44d5-bc32-5844199e3b05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:45.176905 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.176876 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7m4hj"] Jun 02 02:01:45.240525 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.240494 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwsl6\" (UniqueName: \"kubernetes.io/projected/b93ff304-930f-44d5-bc32-5844199e3b05-kube-api-access-hwsl6\") pod \"limitador-limitador-7d549b5b-7m4hj\" (UID: \"b93ff304-930f-44d5-bc32-5844199e3b05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:45.240683 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.240601 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b93ff304-930f-44d5-bc32-5844199e3b05-config-file\") pod \"limitador-limitador-7d549b5b-7m4hj\" (UID: \"b93ff304-930f-44d5-bc32-5844199e3b05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:45.241152 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.241124 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b93ff304-930f-44d5-bc32-5844199e3b05-config-file\") pod \"limitador-limitador-7d549b5b-7m4hj\" (UID: \"b93ff304-930f-44d5-bc32-5844199e3b05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:45.249973 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.249949 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwsl6\" (UniqueName: \"kubernetes.io/projected/b93ff304-930f-44d5-bc32-5844199e3b05-kube-api-access-hwsl6\") pod \"limitador-limitador-7d549b5b-7m4hj\" (UID: \"b93ff304-930f-44d5-bc32-5844199e3b05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:45.385704 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.385619 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:45.519909 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:45.519880 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7m4hj"] Jun 02 02:01:45.521581 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:01:45.521550 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93ff304_930f_44d5_bc32_5844199e3b05.slice/crio-2f27dcb8b4de7fa51ec2d08e89712cb9fd61cf944a2b022e384c33a2996dcefb WatchSource:0}: Error finding container 2f27dcb8b4de7fa51ec2d08e89712cb9fd61cf944a2b022e384c33a2996dcefb: Status 404 returned error can't find the container with id 2f27dcb8b4de7fa51ec2d08e89712cb9fd61cf944a2b022e384c33a2996dcefb Jun 02 02:01:46.025542 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:46.025505 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" event={"ID":"b93ff304-930f-44d5-bc32-5844199e3b05","Type":"ContainerStarted","Data":"2f27dcb8b4de7fa51ec2d08e89712cb9fd61cf944a2b022e384c33a2996dcefb"} Jun 02 02:01:49.040930 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:49.040890 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" event={"ID":"b93ff304-930f-44d5-bc32-5844199e3b05","Type":"ContainerStarted","Data":"643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145"} Jun 02 02:01:49.041332 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:49.041067 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:01:49.058674 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:01:49.058578 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" podStartSLOduration=1.393309187 podStartE2EDuration="4.05856315s" podCreationTimestamp="2026-06-02 02:01:45 +0000 UTC" firstStartedPulling="2026-06-02 02:01:45.523419967 +0000 UTC m=+667.439550973" lastFinishedPulling="2026-06-02 02:01:48.188673919 +0000 UTC m=+670.104804936" observedRunningTime="2026-06-02 02:01:49.05806578 +0000 UTC m=+670.974196809" watchObservedRunningTime="2026-06-02 02:01:49.05856315 +0000 UTC m=+670.974694178" Jun 02 02:02:00.046094 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.046062 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:02:00.162082 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.162045 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7m4hj"] Jun 02 02:02:00.162393 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.162344 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" podUID="b93ff304-930f-44d5-bc32-5844199e3b05" containerName="limitador" containerID="cri-o://643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145" gracePeriod=30 Jun 02 02:02:00.715210 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.715184 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:02:00.895624 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.895536 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b93ff304-930f-44d5-bc32-5844199e3b05-config-file\") pod \"b93ff304-930f-44d5-bc32-5844199e3b05\" (UID: \"b93ff304-930f-44d5-bc32-5844199e3b05\") " Jun 02 02:02:00.895793 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.895634 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwsl6\" (UniqueName: \"kubernetes.io/projected/b93ff304-930f-44d5-bc32-5844199e3b05-kube-api-access-hwsl6\") pod \"b93ff304-930f-44d5-bc32-5844199e3b05\" (UID: \"b93ff304-930f-44d5-bc32-5844199e3b05\") " Jun 02 02:02:00.895915 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.895891 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b93ff304-930f-44d5-bc32-5844199e3b05-config-file" (OuterVolumeSpecName: "config-file") pod "b93ff304-930f-44d5-bc32-5844199e3b05" (UID: "b93ff304-930f-44d5-bc32-5844199e3b05"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:02:00.896203 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.896182 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b93ff304-930f-44d5-bc32-5844199e3b05-config-file\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:02:00.897667 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.897649 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b93ff304-930f-44d5-bc32-5844199e3b05-kube-api-access-hwsl6" (OuterVolumeSpecName: "kube-api-access-hwsl6") pod "b93ff304-930f-44d5-bc32-5844199e3b05" (UID: "b93ff304-930f-44d5-bc32-5844199e3b05"). InnerVolumeSpecName "kube-api-access-hwsl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:02:00.997676 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:00.997641 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwsl6\" (UniqueName: \"kubernetes.io/projected/b93ff304-930f-44d5-bc32-5844199e3b05-kube-api-access-hwsl6\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:02:01.090911 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.090873 2559 generic.go:358] "Generic (PLEG): container finished" podID="b93ff304-930f-44d5-bc32-5844199e3b05" containerID="643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145" exitCode=0 Jun 02 02:02:01.091341 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.090932 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" Jun 02 02:02:01.091341 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.090955 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" event={"ID":"b93ff304-930f-44d5-bc32-5844199e3b05","Type":"ContainerDied","Data":"643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145"} Jun 02 02:02:01.091341 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.090985 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-7m4hj" event={"ID":"b93ff304-930f-44d5-bc32-5844199e3b05","Type":"ContainerDied","Data":"2f27dcb8b4de7fa51ec2d08e89712cb9fd61cf944a2b022e384c33a2996dcefb"} Jun 02 02:02:01.091341 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.090998 2559 scope.go:117] "RemoveContainer" containerID="643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145" Jun 02 02:02:01.100248 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.100231 2559 scope.go:117] "RemoveContainer" containerID="643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145" Jun 02 02:02:01.100493 ip-10-0-135-96 kubenswrapper[2559]: E0602 02:02:01.100470 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145\": container with ID starting with 643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145 not found: ID does not exist" containerID="643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145" Jun 02 02:02:01.100591 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.100498 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145"} err="failed to get container status \"643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145\": rpc error: code = NotFound desc = could not find container \"643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145\": container with ID starting with 643339e552a92ce8dc9a4213b4423b3b2044057127ecc4d7ca79e079372bb145 not found: ID does not exist" Jun 02 02:02:01.118176 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.118129 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7m4hj"] Jun 02 02:02:01.124110 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:01.124082 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-7m4hj"] Jun 02 02:02:02.761017 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:02.760984 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b93ff304-930f-44d5-bc32-5844199e3b05" path="/var/lib/kubelet/pods/b93ff304-930f-44d5-bc32-5844199e3b05/volumes" Jun 02 02:02:05.648297 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.648264 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-2dpg4"] Jun 02 02:02:05.648687 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.648674 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b93ff304-930f-44d5-bc32-5844199e3b05" containerName="limitador" Jun 02 02:02:05.648687 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.648689 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b93ff304-930f-44d5-bc32-5844199e3b05" containerName="limitador" Jun 02 02:02:05.648764 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.648751 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="b93ff304-930f-44d5-bc32-5844199e3b05" containerName="limitador" Jun 02 02:02:05.653507 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.653487 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:05.660533 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.660267 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 02:02:05.668533 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.668507 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-2dpg4"] Jun 02 02:02:05.734105 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.734070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wppmh\" (UniqueName: \"kubernetes.io/projected/88bac9d8-4f97-4b47-a99a-4c922910223c-kube-api-access-wppmh\") pod \"postgres-68c4fbbd6f-2dpg4\" (UID: \"88bac9d8-4f97-4b47-a99a-4c922910223c\") " pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:05.734285 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.734167 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88bac9d8-4f97-4b47-a99a-4c922910223c-data\") pod \"postgres-68c4fbbd6f-2dpg4\" (UID: \"88bac9d8-4f97-4b47-a99a-4c922910223c\") " pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:05.835449 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.835411 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88bac9d8-4f97-4b47-a99a-4c922910223c-data\") pod \"postgres-68c4fbbd6f-2dpg4\" (UID: \"88bac9d8-4f97-4b47-a99a-4c922910223c\") " pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:05.835641 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.835480 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wppmh\" (UniqueName: \"kubernetes.io/projected/88bac9d8-4f97-4b47-a99a-4c922910223c-kube-api-access-wppmh\") pod \"postgres-68c4fbbd6f-2dpg4\" (UID: \"88bac9d8-4f97-4b47-a99a-4c922910223c\") " pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:05.835866 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.835845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/88bac9d8-4f97-4b47-a99a-4c922910223c-data\") pod \"postgres-68c4fbbd6f-2dpg4\" (UID: \"88bac9d8-4f97-4b47-a99a-4c922910223c\") " pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:05.844888 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.844865 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wppmh\" (UniqueName: \"kubernetes.io/projected/88bac9d8-4f97-4b47-a99a-4c922910223c-kube-api-access-wppmh\") pod \"postgres-68c4fbbd6f-2dpg4\" (UID: \"88bac9d8-4f97-4b47-a99a-4c922910223c\") " pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:05.964925 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:05.964834 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:06.093375 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:06.093349 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-2dpg4"] Jun 02 02:02:06.095517 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:02:06.095486 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88bac9d8_4f97_4b47_a99a_4c922910223c.slice/crio-98be00e5a56f4f9bb9b6b4a8ea41f68a0803042096f9452f4d04c63892f97f2c WatchSource:0}: Error finding container 98be00e5a56f4f9bb9b6b4a8ea41f68a0803042096f9452f4d04c63892f97f2c: Status 404 returned error can't find the container with id 98be00e5a56f4f9bb9b6b4a8ea41f68a0803042096f9452f4d04c63892f97f2c Jun 02 02:02:06.111206 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:06.111174 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-2dpg4" event={"ID":"88bac9d8-4f97-4b47-a99a-4c922910223c","Type":"ContainerStarted","Data":"98be00e5a56f4f9bb9b6b4a8ea41f68a0803042096f9452f4d04c63892f97f2c"} Jun 02 02:02:09.124510 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:09.124469 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-2dpg4" event={"ID":"88bac9d8-4f97-4b47-a99a-4c922910223c","Type":"ContainerStarted","Data":"9933f39430d711385563b7af23529ad819eeeb87227f999e8cb7e97e1266e369"} Jun 02 02:02:09.124928 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:09.124562 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:09.144245 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:09.144181 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-2dpg4" podStartSLOduration=1.7200352269999999 podStartE2EDuration="4.144168578s" podCreationTimestamp="2026-06-02 02:02:05 +0000 UTC" firstStartedPulling="2026-06-02 02:02:06.096953438 +0000 UTC m=+688.013084444" lastFinishedPulling="2026-06-02 02:02:08.521086775 +0000 UTC m=+690.437217795" observedRunningTime="2026-06-02 02:02:09.141309479 +0000 UTC m=+691.057440508" watchObservedRunningTime="2026-06-02 02:02:09.144168578 +0000 UTC m=+691.060299605" Jun 02 02:02:15.158679 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:15.158646 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-2dpg4" Jun 02 02:02:16.718223 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.718187 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw"] Jun 02 02:02:16.722225 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.722209 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.725008 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.724987 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:02:16.726997 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.726360 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:02:16.726997 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.726627 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9x25v\"" Jun 02 02:02:16.729934 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.729914 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw"] Jun 02 02:02:16.829480 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.829443 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.829651 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.829510 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.829651 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.829576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc8sc\" (UniqueName: \"kubernetes.io/projected/76857aac-527a-4017-82ad-ea9e49b174b4-kube-api-access-sc8sc\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.930610 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.930570 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.930774 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.930650 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.930774 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.930684 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sc8sc\" (UniqueName: \"kubernetes.io/projected/76857aac-527a-4017-82ad-ea9e49b174b4-kube-api-access-sc8sc\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.930974 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.930952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.931015 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.930987 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:16.941532 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:16.941512 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc8sc\" (UniqueName: \"kubernetes.io/projected/76857aac-527a-4017-82ad-ea9e49b174b4-kube-api-access-sc8sc\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:17.032644 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:17.032604 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:17.163554 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:17.163533 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw"] Jun 02 02:02:17.165331 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:02:17.165308 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76857aac_527a_4017_82ad_ea9e49b174b4.slice/crio-7efb7523434f53c6fef320f2b17c942ad33f7127a67a88ad62bc517b57ee3511 WatchSource:0}: Error finding container 7efb7523434f53c6fef320f2b17c942ad33f7127a67a88ad62bc517b57ee3511: Status 404 returned error can't find the container with id 7efb7523434f53c6fef320f2b17c942ad33f7127a67a88ad62bc517b57ee3511 Jun 02 02:02:18.166605 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:18.166563 2559 generic.go:358] "Generic (PLEG): container finished" podID="76857aac-527a-4017-82ad-ea9e49b174b4" containerID="a57b8240a24538fde37eb061dc2c49ea92bf04c4e08291ea2607745b6daee170" exitCode=0 Jun 02 02:02:18.167050 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:18.166656 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" event={"ID":"76857aac-527a-4017-82ad-ea9e49b174b4","Type":"ContainerDied","Data":"a57b8240a24538fde37eb061dc2c49ea92bf04c4e08291ea2607745b6daee170"} Jun 02 02:02:18.167050 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:18.166688 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" event={"ID":"76857aac-527a-4017-82ad-ea9e49b174b4","Type":"ContainerStarted","Data":"7efb7523434f53c6fef320f2b17c942ad33f7127a67a88ad62bc517b57ee3511"} Jun 02 02:02:19.172238 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:19.172165 2559 generic.go:358] "Generic (PLEG): container finished" podID="76857aac-527a-4017-82ad-ea9e49b174b4" containerID="9f244befae1f12e361c0c7b13c9a5084ddd0e747184217ff5f7666c4a4917d48" exitCode=0 Jun 02 02:02:19.172238 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:19.172234 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" event={"ID":"76857aac-527a-4017-82ad-ea9e49b174b4","Type":"ContainerDied","Data":"9f244befae1f12e361c0c7b13c9a5084ddd0e747184217ff5f7666c4a4917d48"} Jun 02 02:02:20.177933 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:20.177900 2559 generic.go:358] "Generic (PLEG): container finished" podID="76857aac-527a-4017-82ad-ea9e49b174b4" containerID="deafe6dc7aecd60844f367a53eb468baabc7d041720a055475d2bf43c3107418" exitCode=0 Jun 02 02:02:20.178334 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:20.177981 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" event={"ID":"76857aac-527a-4017-82ad-ea9e49b174b4","Type":"ContainerDied","Data":"deafe6dc7aecd60844f367a53eb468baabc7d041720a055475d2bf43c3107418"} Jun 02 02:02:21.314273 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.314246 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:21.371498 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.371459 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-bundle\") pod \"76857aac-527a-4017-82ad-ea9e49b174b4\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " Jun 02 02:02:21.371660 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.371524 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-util\") pod \"76857aac-527a-4017-82ad-ea9e49b174b4\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " Jun 02 02:02:21.371660 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.371568 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sc8sc\" (UniqueName: \"kubernetes.io/projected/76857aac-527a-4017-82ad-ea9e49b174b4-kube-api-access-sc8sc\") pod \"76857aac-527a-4017-82ad-ea9e49b174b4\" (UID: \"76857aac-527a-4017-82ad-ea9e49b174b4\") " Jun 02 02:02:21.371940 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.371918 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-bundle" (OuterVolumeSpecName: "bundle") pod "76857aac-527a-4017-82ad-ea9e49b174b4" (UID: "76857aac-527a-4017-82ad-ea9e49b174b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:02:21.373611 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.373587 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76857aac-527a-4017-82ad-ea9e49b174b4-kube-api-access-sc8sc" (OuterVolumeSpecName: "kube-api-access-sc8sc") pod "76857aac-527a-4017-82ad-ea9e49b174b4" (UID: "76857aac-527a-4017-82ad-ea9e49b174b4"). InnerVolumeSpecName "kube-api-access-sc8sc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:02:21.376656 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.376625 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-util" (OuterVolumeSpecName: "util") pod "76857aac-527a-4017-82ad-ea9e49b174b4" (UID: "76857aac-527a-4017-82ad-ea9e49b174b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:02:21.473254 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.473218 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-bundle\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:02:21.473254 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.473253 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76857aac-527a-4017-82ad-ea9e49b174b4-util\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:02:21.473446 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:21.473263 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc8sc\" (UniqueName: \"kubernetes.io/projected/76857aac-527a-4017-82ad-ea9e49b174b4-kube-api-access-sc8sc\") on node \"ip-10-0-135-96.ec2.internal\" DevicePath \"\"" Jun 02 02:02:22.187972 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:22.187938 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" event={"ID":"76857aac-527a-4017-82ad-ea9e49b174b4","Type":"ContainerDied","Data":"7efb7523434f53c6fef320f2b17c942ad33f7127a67a88ad62bc517b57ee3511"} Jun 02 02:02:22.187972 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:22.187972 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7efb7523434f53c6fef320f2b17c942ad33f7127a67a88ad62bc517b57ee3511" Jun 02 02:02:22.188224 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:22.187974 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70vvnrw" Jun 02 02:02:24.802407 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.802364 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-p8p89"] Jun 02 02:02:24.802802 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.802787 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76857aac-527a-4017-82ad-ea9e49b174b4" containerName="pull" Jun 02 02:02:24.802802 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.802800 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="76857aac-527a-4017-82ad-ea9e49b174b4" containerName="pull" Jun 02 02:02:24.802881 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.802813 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76857aac-527a-4017-82ad-ea9e49b174b4" containerName="util" Jun 02 02:02:24.802881 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.802819 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="76857aac-527a-4017-82ad-ea9e49b174b4" containerName="util" Jun 02 02:02:24.802881 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.802826 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76857aac-527a-4017-82ad-ea9e49b174b4" containerName="extract" Jun 02 02:02:24.802881 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.802832 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="76857aac-527a-4017-82ad-ea9e49b174b4" containerName="extract" Jun 02 02:02:24.803006 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.802896 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="76857aac-527a-4017-82ad-ea9e49b174b4" containerName="extract" Jun 02 02:02:24.810918 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.810897 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-p8p89" Jun 02 02:02:24.816968 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.816939 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 02:02:24.817176 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.817058 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-jqzrz\"" Jun 02 02:02:24.821013 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.820986 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-p8p89"] Jun 02 02:02:24.835873 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.835840 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 02:02:24.900345 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:24.900306 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqtgz\" (UniqueName: \"kubernetes.io/projected/3a0528a6-5392-435a-ad62-a0bc902cdb8b-kube-api-access-nqtgz\") pod \"keycloak-operator-7864d68cbd-p8p89\" (UID: \"3a0528a6-5392-435a-ad62-a0bc902cdb8b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-p8p89" Jun 02 02:02:25.001050 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:25.000995 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqtgz\" (UniqueName: \"kubernetes.io/projected/3a0528a6-5392-435a-ad62-a0bc902cdb8b-kube-api-access-nqtgz\") pod \"keycloak-operator-7864d68cbd-p8p89\" (UID: \"3a0528a6-5392-435a-ad62-a0bc902cdb8b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-p8p89" Jun 02 02:02:25.028738 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:25.028703 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqtgz\" (UniqueName: \"kubernetes.io/projected/3a0528a6-5392-435a-ad62-a0bc902cdb8b-kube-api-access-nqtgz\") pod \"keycloak-operator-7864d68cbd-p8p89\" (UID: \"3a0528a6-5392-435a-ad62-a0bc902cdb8b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-p8p89" Jun 02 02:02:25.121392 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:25.121304 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-p8p89" Jun 02 02:02:25.272916 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:25.272877 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-p8p89"] Jun 02 02:02:25.279077 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:02:25.279047 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0528a6_5392_435a_ad62_a0bc902cdb8b.slice/crio-1f824631d26275997d03dd39b394a9f0a2c4e05d68c1cceea2fc871ba92f9776 WatchSource:0}: Error finding container 1f824631d26275997d03dd39b394a9f0a2c4e05d68c1cceea2fc871ba92f9776: Status 404 returned error can't find the container with id 1f824631d26275997d03dd39b394a9f0a2c4e05d68c1cceea2fc871ba92f9776 Jun 02 02:02:26.208707 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:26.208672 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-p8p89" event={"ID":"3a0528a6-5392-435a-ad62-a0bc902cdb8b","Type":"ContainerStarted","Data":"1f824631d26275997d03dd39b394a9f0a2c4e05d68c1cceea2fc871ba92f9776"} Jun 02 02:02:31.232047 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:31.232011 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-p8p89" event={"ID":"3a0528a6-5392-435a-ad62-a0bc902cdb8b","Type":"ContainerStarted","Data":"08a80efec90e23ce5d66a4e4b2c14748c97a4ce2b380b10eaa133910f2a75863"} Jun 02 02:02:31.256224 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:02:31.256176 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-p8p89" podStartSLOduration=1.87336877 podStartE2EDuration="7.256160953s" podCreationTimestamp="2026-06-02 02:02:24 +0000 UTC" firstStartedPulling="2026-06-02 02:02:25.280599216 +0000 UTC m=+707.196730224" lastFinishedPulling="2026-06-02 02:02:30.6633914 +0000 UTC m=+712.579522407" observedRunningTime="2026-06-02 02:02:31.253088831 +0000 UTC m=+713.169219858" watchObservedRunningTime="2026-06-02 02:02:31.256160953 +0000 UTC m=+713.172291979" Jun 02 02:03:48.865270 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:48.865235 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-mvx98"] Jun 02 02:03:48.870753 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:48.870722 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" Jun 02 02:03:48.873265 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:48.873238 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 02:03:48.875418 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:48.875395 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-mvx98"] Jun 02 02:03:48.988656 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:48.988616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zhsz\" (UniqueName: \"kubernetes.io/projected/768bbe50-0161-4e9d-9a15-759c3c5e6bd6-kube-api-access-6zhsz\") pod \"payload-processing-58b6c8fdc7-mvx98\" (UID: \"768bbe50-0161-4e9d-9a15-759c3c5e6bd6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" Jun 02 02:03:49.089966 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:49.089932 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6zhsz\" (UniqueName: \"kubernetes.io/projected/768bbe50-0161-4e9d-9a15-759c3c5e6bd6-kube-api-access-6zhsz\") pod \"payload-processing-58b6c8fdc7-mvx98\" (UID: \"768bbe50-0161-4e9d-9a15-759c3c5e6bd6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" Jun 02 02:03:49.098722 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:49.098687 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zhsz\" (UniqueName: \"kubernetes.io/projected/768bbe50-0161-4e9d-9a15-759c3c5e6bd6-kube-api-access-6zhsz\") pod \"payload-processing-58b6c8fdc7-mvx98\" (UID: \"768bbe50-0161-4e9d-9a15-759c3c5e6bd6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" Jun 02 02:03:49.185324 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:49.185232 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" Jun 02 02:03:49.316543 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:49.316518 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-mvx98"] Jun 02 02:03:49.318094 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:03:49.318068 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768bbe50_0161_4e9d_9a15_759c3c5e6bd6.slice/crio-f14ad75bbfb0240cbdb7c4e8fd34722c6eb307cc7ab8df6a2a7d83efec26327b WatchSource:0}: Error finding container f14ad75bbfb0240cbdb7c4e8fd34722c6eb307cc7ab8df6a2a7d83efec26327b: Status 404 returned error can't find the container with id f14ad75bbfb0240cbdb7c4e8fd34722c6eb307cc7ab8df6a2a7d83efec26327b Jun 02 02:03:49.551657 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:49.551624 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" event={"ID":"768bbe50-0161-4e9d-9a15-759c3c5e6bd6","Type":"ContainerStarted","Data":"f14ad75bbfb0240cbdb7c4e8fd34722c6eb307cc7ab8df6a2a7d83efec26327b"} Jun 02 02:03:52.566464 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:52.566427 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" event={"ID":"768bbe50-0161-4e9d-9a15-759c3c5e6bd6","Type":"ContainerStarted","Data":"33b41bffe6fd548f754bffcc39194fa39358f9a8c147923a9f18a608ff76cc61"} Jun 02 02:03:52.566898 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:52.566486 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" Jun 02 02:03:52.584398 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:03:52.584342 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" podStartSLOduration=1.974218305 podStartE2EDuration="4.584324777s" podCreationTimestamp="2026-06-02 02:03:48 +0000 UTC" firstStartedPulling="2026-06-02 02:03:49.319760864 +0000 UTC m=+791.235891870" lastFinishedPulling="2026-06-02 02:03:51.92986733 +0000 UTC m=+793.845998342" observedRunningTime="2026-06-02 02:03:52.583793972 +0000 UTC m=+794.499925014" watchObservedRunningTime="2026-06-02 02:03:52.584324777 +0000 UTC m=+794.500455807" Jun 02 02:04:03.573859 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:03.573780 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-mvx98" Jun 02 02:04:57.591437 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.591393 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w"] Jun 02 02:04:57.594929 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.594909 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.598774 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.598752 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 02:04:57.598918 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.598753 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jq62q\"" Jun 02 02:04:57.598918 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.598753 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 02:04:57.598918 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.598757 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 02:04:57.606071 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.606047 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w"] Jun 02 02:04:57.738368 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.738327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.738368 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.738367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.738622 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.738495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.738622 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.738533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrd9x\" (UniqueName: \"kubernetes.io/projected/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-kube-api-access-hrd9x\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.738622 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.738554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.738622 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.738596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839264 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839233 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839264 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839272 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839496 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839287 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839496 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839346 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839496 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839368 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrd9x\" (UniqueName: \"kubernetes.io/projected/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-kube-api-access-hrd9x\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839496 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839426 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839737 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839800 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839755 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.839853 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.839807 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.841623 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.841571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.841868 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.841849 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.848088 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.848067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrd9x\" (UniqueName: \"kubernetes.io/projected/2dfc4c0e-6250-4cbf-8776-4a48b20aeee3-kube-api-access-hrd9x\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w\" (UID: \"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:57.906283 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:57.906246 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:04:58.038387 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:58.038360 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w"] Jun 02 02:04:58.039650 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:04:58.039622 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfc4c0e_6250_4cbf_8776_4a48b20aeee3.slice/crio-04dda5ed4c9965c1a7a18c16ca25b1876d6ab3a6162e78c117f30263b7a46942 WatchSource:0}: Error finding container 04dda5ed4c9965c1a7a18c16ca25b1876d6ab3a6162e78c117f30263b7a46942: Status 404 returned error can't find the container with id 04dda5ed4c9965c1a7a18c16ca25b1876d6ab3a6162e78c117f30263b7a46942 Jun 02 02:04:58.842075 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:04:58.842032 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" event={"ID":"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3","Type":"ContainerStarted","Data":"04dda5ed4c9965c1a7a18c16ca25b1876d6ab3a6162e78c117f30263b7a46942"} Jun 02 02:05:01.858528 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:01.858488 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" event={"ID":"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3","Type":"ContainerStarted","Data":"226b5c3b56ae8286a4a3203548bc8d89d5099256e0f4b3f745485961568f5ca8"} Jun 02 02:05:03.867992 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:03.867959 2559 generic.go:358] "Generic (PLEG): container finished" podID="2dfc4c0e-6250-4cbf-8776-4a48b20aeee3" containerID="226b5c3b56ae8286a4a3203548bc8d89d5099256e0f4b3f745485961568f5ca8" exitCode=0 Jun 02 02:05:03.868418 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:03.868040 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" event={"ID":"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3","Type":"ContainerDied","Data":"226b5c3b56ae8286a4a3203548bc8d89d5099256e0f4b3f745485961568f5ca8"} Jun 02 02:05:05.879856 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:05.879820 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" event={"ID":"2dfc4c0e-6250-4cbf-8776-4a48b20aeee3","Type":"ContainerStarted","Data":"84236fc2b6f6b0f981f712b51b139f4ff715b20e5c170b0c6b79c337aa6aa63a"} Jun 02 02:05:05.898832 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:05.898783 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" podStartSLOduration=1.628627942 podStartE2EDuration="8.898726716s" podCreationTimestamp="2026-06-02 02:04:57 +0000 UTC" firstStartedPulling="2026-06-02 02:04:58.041375005 +0000 UTC m=+859.957506015" lastFinishedPulling="2026-06-02 02:05:05.311473782 +0000 UTC m=+867.227604789" observedRunningTime="2026-06-02 02:05:05.898482959 +0000 UTC m=+867.814613989" watchObservedRunningTime="2026-06-02 02:05:05.898726716 +0000 UTC m=+867.814857747" Jun 02 02:05:07.907256 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:07.907217 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:05:07.907256 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:07.907259 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:05:07.919828 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:07.919797 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:05:08.903403 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:08.903369 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w" Jun 02 02:05:25.699022 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.698979 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4"] Jun 02 02:05:25.717677 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.717645 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4"] Jun 02 02:05:25.717793 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.717774 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.721969 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.721233 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 02:05:25.801517 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.801485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.801630 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.801550 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.801786 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.801691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4skq\" (UniqueName: \"kubernetes.io/projected/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-kube-api-access-z4skq\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.801888 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.801825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.801988 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.801967 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.802054 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.802006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903126 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903092 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903126 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903131 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903350 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903183 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903350 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903208 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903350 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903259 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4skq\" (UniqueName: \"kubernetes.io/projected/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-kube-api-access-z4skq\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903350 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903294 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903636 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903710 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.903760 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.903727 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.905313 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.905293 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.905596 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.905579 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:25.912739 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:25.912716 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4skq\" (UniqueName: \"kubernetes.io/projected/4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8-kube-api-access-z4skq\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4\" (UID: \"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:26.051351 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:26.051316 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" Jun 02 02:05:26.186567 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:26.186541 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4"] Jun 02 02:05:26.187776 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:05:26.187753 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bdf4a1b_2f99_492e_98cc_a1bd3e52d3e8.slice/crio-30889af51101257ebb00fcca03161f333ff88f0b6ed1bc64aa1fba9e37579047 WatchSource:0}: Error finding container 30889af51101257ebb00fcca03161f333ff88f0b6ed1bc64aa1fba9e37579047: Status 404 returned error can't find the container with id 30889af51101257ebb00fcca03161f333ff88f0b6ed1bc64aa1fba9e37579047 Jun 02 02:05:26.963797 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:26.963754 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" event={"ID":"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8","Type":"ContainerStarted","Data":"6fae18e2ca6f825f4c0c1ce1a4769fa31f57afd2832058825e2a6997280bad30"} Jun 02 02:05:26.963797 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:26.963802 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4" event={"ID":"4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8","Type":"ContainerStarted","Data":"30889af51101257ebb00fcca03161f333ff88f0b6ed1bc64aa1fba9e37579047"} Jun 02 02:05:38.770281 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:38.770247 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 02:05:38.770837 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:05:38.770737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 02:10:38.805987 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:10:38.805953 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 02:10:38.808653 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:10:38.808633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 02:11:41.479706 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:41.479624 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-krxn4_4bdf4a1b-2f99-492e-98cc-a1bd3e52d3e8/storage-initializer/0.log" Jun 02 02:11:46.912990 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:46.912957 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5ffbc658cc-88pp4_ef797bd2-4756-4326-a730-811adab2db3c/nginx/0.log" Jun 02 02:11:47.732385 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:47.732351 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-zc8fk_6fb84100-b99e-455e-8929-3593639aba8c/manager/0.log" Jun 02 02:11:48.076502 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:48.076422 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-xpxfs_3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a/copy-manifests/0.log" Jun 02 02:11:48.085968 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:48.085942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-xpxfs_3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a/manager/0.log" Jun 02 02:11:48.199937 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:48.199911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-2dpg4_88bac9d8-4f97-4b47-a99a-4c922910223c/postgres/0.log" Jun 02 02:11:48.935534 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:48.935489 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms_03e52002-c224-4e6d-89b2-2691455cca8d/util/0.log" Jun 02 02:11:48.946130 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:48.946103 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms_03e52002-c224-4e6d-89b2-2691455cca8d/pull/0.log" Jun 02 02:11:48.953503 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:48.953483 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms_03e52002-c224-4e6d-89b2-2691455cca8d/extract/0.log" Jun 02 02:11:49.057501 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.057473 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw_f6ea96af-f7df-4ade-a6f4-856d09010ebd/util/0.log" Jun 02 02:11:49.063824 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.063792 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw_f6ea96af-f7df-4ade-a6f4-856d09010ebd/pull/0.log" Jun 02 02:11:49.070376 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.070351 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw_f6ea96af-f7df-4ade-a6f4-856d09010ebd/extract/0.log" Jun 02 02:11:49.174178 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.174133 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh_3bd1a213-7d90-41a6-9458-246700734af9/util/0.log" Jun 02 02:11:49.182556 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.182531 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh_3bd1a213-7d90-41a6-9458-246700734af9/pull/0.log" Jun 02 02:11:49.189791 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.189714 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh_3bd1a213-7d90-41a6-9458-246700734af9/extract/0.log" Jun 02 02:11:49.289432 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.289405 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr_4625e8d1-bc27-4925-8b12-923432def909/util/0.log" Jun 02 02:11:49.295939 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.295919 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr_4625e8d1-bc27-4925-8b12-923432def909/pull/0.log" Jun 02 02:11:49.301803 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.301785 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr_4625e8d1-bc27-4925-8b12-923432def909/extract/0.log" Jun 02 02:11:49.646088 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.646050 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5msrf_b9208abe-55c5-42b4-874d-6b341fac55f7/manager/0.log" Jun 02 02:11:49.870961 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:49.870930 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9q7km_eda52b0a-4d15-462f-aa66-744b498bc179/registry-server/0.log" Jun 02 02:11:50.203399 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:50.203369 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-kc5w8_8398a5f6-5b25-4025-bbcf-e69e661a6d45/manager/0.log" Jun 02 02:11:50.551067 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:50.551040 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb_90effe07-9ccc-44fd-b81d-3283678e7eaf/istio-proxy/0.log" Jun 02 02:11:50.998574 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:50.998546 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-g9l8r_74be30f5-ac49-48b8-bd75-5885d2f7c20a/istio-proxy/0.log" Jun 02 02:11:51.123123 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:51.123093 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-mvx98_768bbe50-0161-4e9d-9a15-759c3c5e6bd6/payload-processing/0.log" Jun 02 02:11:51.259804 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:51.259717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b6bdcd6bc-h4mhx_3c532827-81af-4e0f-b793-c7f9662ed2db/router/0.log" Jun 02 02:11:51.832950 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:51.832923 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w_2dfc4c0e-6250-4cbf-8776-4a48b20aeee3/storage-initializer/0.log" Jun 02 02:11:51.840940 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:51.840913 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-wfz5w_2dfc4c0e-6250-4cbf-8776-4a48b20aeee3/main/0.log" Jun 02 02:11:59.325635 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:59.325600 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7nfcg_6e723871-88b6-4db1-b057-e7429c6c906d/global-pull-secret-syncer/0.log" Jun 02 02:11:59.443265 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:59.443236 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cxwg2_4869edb7-b7c3-49b2-8014-5a85cd52b448/konnectivity-agent/0.log" Jun 02 02:11:59.589596 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:11:59.589523 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-96.ec2.internal_1081596490cd45967eb050f77c113fcd/haproxy/0.log" Jun 02 02:12:02.783245 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:02.783212 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms_03e52002-c224-4e6d-89b2-2691455cca8d/extract/0.log" Jun 02 02:12:02.820997 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:02.820964 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms_03e52002-c224-4e6d-89b2-2691455cca8d/util/0.log" Jun 02 02:12:02.856501 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:02.856474 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pstms_03e52002-c224-4e6d-89b2-2691455cca8d/pull/0.log" Jun 02 02:12:02.894671 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:02.894644 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw_f6ea96af-f7df-4ade-a6f4-856d09010ebd/extract/0.log" Jun 02 02:12:02.925244 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:02.925217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw_f6ea96af-f7df-4ade-a6f4-856d09010ebd/util/0.log" Jun 02 02:12:02.957943 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:02.957919 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jcwmw_f6ea96af-f7df-4ade-a6f4-856d09010ebd/pull/0.log" Jun 02 02:12:02.998491 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:02.998466 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh_3bd1a213-7d90-41a6-9458-246700734af9/extract/0.log" Jun 02 02:12:03.028005 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:03.027970 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh_3bd1a213-7d90-41a6-9458-246700734af9/util/0.log" Jun 02 02:12:03.053488 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:03.053410 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737ccqh_3bd1a213-7d90-41a6-9458-246700734af9/pull/0.log" Jun 02 02:12:03.087859 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:03.087830 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr_4625e8d1-bc27-4925-8b12-923432def909/extract/0.log" Jun 02 02:12:03.122488 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:03.122458 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr_4625e8d1-bc27-4925-8b12-923432def909/util/0.log" Jun 02 02:12:03.163963 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:03.163939 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wjkgr_4625e8d1-bc27-4925-8b12-923432def909/pull/0.log" Jun 02 02:12:03.286326 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:03.286300 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5msrf_b9208abe-55c5-42b4-874d-6b341fac55f7/manager/0.log" Jun 02 02:12:03.356637 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:03.356543 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9q7km_eda52b0a-4d15-462f-aa66-744b498bc179/registry-server/0.log" Jun 02 02:12:03.491665 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:03.491635 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-kc5w8_8398a5f6-5b25-4025-bbcf-e69e661a6d45/manager/0.log" Jun 02 02:12:04.803421 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:04.803382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e07d49-9a3f-492b-ad53-79e871f5cddc/alertmanager/0.log" Jun 02 02:12:04.829851 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:04.829823 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e07d49-9a3f-492b-ad53-79e871f5cddc/config-reloader/0.log" Jun 02 02:12:04.865719 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:04.865688 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e07d49-9a3f-492b-ad53-79e871f5cddc/kube-rbac-proxy-web/0.log" Jun 02 02:12:04.897504 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:04.897462 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e07d49-9a3f-492b-ad53-79e871f5cddc/kube-rbac-proxy/0.log" Jun 02 02:12:04.926803 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:04.926771 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e07d49-9a3f-492b-ad53-79e871f5cddc/kube-rbac-proxy-metric/0.log" Jun 02 02:12:04.952799 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:04.952774 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e07d49-9a3f-492b-ad53-79e871f5cddc/prom-label-proxy/0.log" Jun 02 02:12:04.979016 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:04.978988 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e07d49-9a3f-492b-ad53-79e871f5cddc/init-config-reloader/0.log" Jun 02 02:12:05.017283 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.017253 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-dpv94_3ef8e458-ef29-443c-8356-413b4256e95d/cluster-monitoring-operator/0.log" Jun 02 02:12:05.046797 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.046766 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-wt896_800652e7-98bb-45f6-b3ba-735e5c838587/kube-state-metrics/0.log" Jun 02 02:12:05.069746 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.069662 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-wt896_800652e7-98bb-45f6-b3ba-735e5c838587/kube-rbac-proxy-main/0.log" Jun 02 02:12:05.096793 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.096761 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-wt896_800652e7-98bb-45f6-b3ba-735e5c838587/kube-rbac-proxy-self/0.log" Jun 02 02:12:05.192854 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.192826 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-6pzdk_00608bea-03d7-48ee-890b-73fd91dc7f9e/monitoring-plugin/0.log" Jun 02 02:12:05.351496 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.351406 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxl79_4f4a3f81-7e66-4bbc-abde-71c17a651b33/node-exporter/0.log" Jun 02 02:12:05.400378 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.400349 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxl79_4f4a3f81-7e66-4bbc-abde-71c17a651b33/kube-rbac-proxy/0.log" Jun 02 02:12:05.426062 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.426038 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxl79_4f4a3f81-7e66-4bbc-abde-71c17a651b33/init-textfile/0.log" Jun 02 02:12:05.610485 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.610392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7n9kj_17e7dd35-da04-451a-b5f5-05a6805b7292/kube-rbac-proxy-main/0.log" Jun 02 02:12:05.644371 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.644348 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7n9kj_17e7dd35-da04-451a-b5f5-05a6805b7292/kube-rbac-proxy-self/0.log" Jun 02 02:12:05.673186 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.673157 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-7n9kj_17e7dd35-da04-451a-b5f5-05a6805b7292/openshift-state-metrics/0.log" Jun 02 02:12:05.959206 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.959107 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-klmc4_a4b024e1-1143-4181-858d-8f00d1d828ab/prometheus-operator/0.log" Jun 02 02:12:05.982409 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:05.982378 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-klmc4_a4b024e1-1143-4181-858d-8f00d1d828ab/kube-rbac-proxy/0.log" Jun 02 02:12:06.013594 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:06.013568 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-9nctj_73576d50-6ef6-4dc7-9e27-b4ef4615362b/prometheus-operator-admission-webhook/0.log" Jun 02 02:12:06.064454 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:06.064425 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-595475c87f-kgkvf_32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0/telemeter-client/0.log" Jun 02 02:12:06.090359 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:06.090325 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-595475c87f-kgkvf_32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0/reload/0.log" Jun 02 02:12:06.124944 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:06.124916 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-595475c87f-kgkvf_32bb8e2a-1cb3-4dff-be6f-3e85afc9e4c0/kube-rbac-proxy/0.log" Jun 02 02:12:08.154769 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.154737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/1.log" Jun 02 02:12:08.160467 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.160449 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-9qdzw_6d4f73d5-17fc-444f-9beb-bb7474e3321d/console-operator/2.log" Jun 02 02:12:08.672583 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.672554 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-684cb67c7f-8z9gq_95728bb5-84b3-410d-b338-fd8c369a2f6b/console/0.log" Jun 02 02:12:08.931400 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.931323 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k"] Jun 02 02:12:08.934751 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.934735 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:08.937589 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.937561 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kl4qd\"/\"kube-root-ca.crt\"" Jun 02 02:12:08.938558 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.938540 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kl4qd\"/\"openshift-service-ca.crt\"" Jun 02 02:12:08.938659 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.938543 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kl4qd\"/\"default-dockercfg-pzj7r\"" Jun 02 02:12:08.945590 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.945565 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k"] Jun 02 02:12:08.988848 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.988812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-sys\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:08.988848 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.988847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-podres\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:08.989041 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.988925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmlf6\" (UniqueName: \"kubernetes.io/projected/b20034b3-5987-4c90-8203-d84ce581a2db-kube-api-access-nmlf6\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:08.989041 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.988982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-proc\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:08.989041 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:08.988997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-lib-modules\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090580 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090541 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmlf6\" (UniqueName: \"kubernetes.io/projected/b20034b3-5987-4c90-8203-d84ce581a2db-kube-api-access-nmlf6\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090790 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090658 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-proc\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090790 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090685 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-lib-modules\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090790 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090716 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-sys\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090790 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090739 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-podres\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090989 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090803 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-proc\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090989 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-sys\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090989 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090869 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-lib-modules\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.090989 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.090906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b20034b3-5987-4c90-8203-d84ce581a2db-podres\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.103265 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.103235 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmlf6\" (UniqueName: \"kubernetes.io/projected/b20034b3-5987-4c90-8203-d84ce581a2db-kube-api-access-nmlf6\") pod \"perf-node-gather-daemonset-49g5k\" (UID: \"b20034b3-5987-4c90-8203-d84ce581a2db\") " pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.245335 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.245302 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.305320 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.305283 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-c7hnc_fd07b245-a919-413e-9e0b-f98a1c92f85a/volume-data-source-validator/0.log" Jun 02 02:12:09.379431 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.379405 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k"] Jun 02 02:12:09.381088 ip-10-0-135-96 kubenswrapper[2559]: W0602 02:12:09.381060 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb20034b3_5987_4c90_8203_d84ce581a2db.slice/crio-69b5f1f406fcf28ce26d94c6647680d2d6a55cbb4042f0aed428ea14cd2216cd WatchSource:0}: Error finding container 69b5f1f406fcf28ce26d94c6647680d2d6a55cbb4042f0aed428ea14cd2216cd: Status 404 returned error can't find the container with id 69b5f1f406fcf28ce26d94c6647680d2d6a55cbb4042f0aed428ea14cd2216cd Jun 02 02:12:09.382831 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.382811 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:12:09.640765 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.640677 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" event={"ID":"b20034b3-5987-4c90-8203-d84ce581a2db","Type":"ContainerStarted","Data":"5d426d0c9b084e79f8c3103650ebca023f35cb69716cb2125c817a4f969f5c08"} Jun 02 02:12:09.640765 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.640717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" event={"ID":"b20034b3-5987-4c90-8203-d84ce581a2db","Type":"ContainerStarted","Data":"69b5f1f406fcf28ce26d94c6647680d2d6a55cbb4042f0aed428ea14cd2216cd"} Jun 02 02:12:09.640946 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.640810 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:09.660781 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:09.660725 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" podStartSLOduration=1.6607122680000002 podStartE2EDuration="1.660712268s" podCreationTimestamp="2026-06-02 02:12:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:12:09.65735208 +0000 UTC m=+1291.573483109" watchObservedRunningTime="2026-06-02 02:12:09.660712268 +0000 UTC m=+1291.576843295" Jun 02 02:12:10.171561 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:10.171534 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-75gv6_586260d8-1a00-4e53-97bb-7da92f4473ed/dns/0.log" Jun 02 02:12:10.197837 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:10.197796 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-75gv6_586260d8-1a00-4e53-97bb-7da92f4473ed/kube-rbac-proxy/0.log" Jun 02 02:12:10.328861 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:10.328830 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9rrkx_937fac9e-c35b-4b3e-9f62-934a5fbb01bf/dns-node-resolver/0.log" Jun 02 02:12:10.953322 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:10.953290 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x82gn_c98e7568-2413-4bc9-8364-340bd4df48d0/node-ca/0.log" Jun 02 02:12:11.851564 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:11.851537 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4b2nhjb_90effe07-9ccc-44fd-b81d-3283678e7eaf/istio-proxy/0.log" Jun 02 02:12:12.030763 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:12.030736 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-g9l8r_74be30f5-ac49-48b8-bd75-5885d2f7c20a/istio-proxy/0.log" Jun 02 02:12:12.058293 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:12.058267 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-mvx98_768bbe50-0161-4e9d-9a15-759c3c5e6bd6/payload-processing/0.log" Jun 02 02:12:12.085824 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:12.085794 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b6bdcd6bc-h4mhx_3c532827-81af-4e0f-b793-c7f9662ed2db/router/0.log" Jun 02 02:12:12.667355 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:12.667322 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2ls86_420f75c1-1c72-45e3-82af-19acef404dcf/serve-healthcheck-canary/0.log" Jun 02 02:12:13.391400 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:13.391364 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgqkn_072516c5-a804-4601-9cf2-d816e433ac4e/kube-rbac-proxy/0.log" Jun 02 02:12:13.418453 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:13.418419 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgqkn_072516c5-a804-4601-9cf2-d816e433ac4e/exporter/0.log" Jun 02 02:12:13.441508 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:13.441479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zgqkn_072516c5-a804-4601-9cf2-d816e433ac4e/extractor/0.log" Jun 02 02:12:15.614412 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:15.614369 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5ffbc658cc-88pp4_ef797bd2-4756-4326-a730-811adab2db3c/nginx/0.log" Jun 02 02:12:15.655386 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:15.655351 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kl4qd/perf-node-gather-daemonset-49g5k" Jun 02 02:12:15.875732 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:15.875656 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-zc8fk_6fb84100-b99e-455e-8929-3593639aba8c/manager/0.log" Jun 02 02:12:16.068433 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:16.068398 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-xpxfs_3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a/manager/0.log" Jun 02 02:12:16.090809 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:16.090783 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c568bd5f7-xpxfs_3e3eddee-e4d8-4d8e-bee5-6c5f2a4f8c6a/copy-manifests/0.log" Jun 02 02:12:16.118224 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:16.118194 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-2dpg4_88bac9d8-4f97-4b47-a99a-4c922910223c/postgres/0.log" Jun 02 02:12:17.513988 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:17.513962 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f66fcb844-k7qtv_4e374532-7258-484c-ae71-c6edc4c95c5e/manager/0.log" Jun 02 02:12:17.578877 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:17.578848 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-z7vqq_1b770d04-2a68-48d8-8a1c-0f0497dbe836/openshift-lws-operator/0.log" Jun 02 02:12:23.015251 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:23.015220 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-5cfgh_a52ef298-36bb-4174-a13a-dcead25e5f76/kube-storage-version-migrator-operator/1.log" Jun 02 02:12:23.016117 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:23.016099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-5cfgh_a52ef298-36bb-4174-a13a-dcead25e5f76/kube-storage-version-migrator-operator/0.log" Jun 02 02:12:24.249039 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.249008 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d22lb_d066af60-4fa2-44da-92b5-d1c3ecdf5f22/kube-multus-additional-cni-plugins/0.log" Jun 02 02:12:24.279987 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.279963 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d22lb_d066af60-4fa2-44da-92b5-d1c3ecdf5f22/egress-router-binary-copy/0.log" Jun 02 02:12:24.314579 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.314557 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d22lb_d066af60-4fa2-44da-92b5-d1c3ecdf5f22/cni-plugins/0.log" Jun 02 02:12:24.342932 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.342907 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d22lb_d066af60-4fa2-44da-92b5-d1c3ecdf5f22/bond-cni-plugin/0.log" Jun 02 02:12:24.369969 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.369945 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d22lb_d066af60-4fa2-44da-92b5-d1c3ecdf5f22/routeoverride-cni/0.log" Jun 02 02:12:24.395199 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.395173 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d22lb_d066af60-4fa2-44da-92b5-d1c3ecdf5f22/whereabouts-cni-bincopy/0.log" Jun 02 02:12:24.420429 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.420402 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d22lb_d066af60-4fa2-44da-92b5-d1c3ecdf5f22/whereabouts-cni/0.log" Jun 02 02:12:24.665633 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.665558 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f782n_b1b3cdb5-8988-45b7-8f5c-80a5ff316895/kube-multus/0.log" Jun 02 02:12:24.848509 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.848482 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jkp2b_7390b1f2-1a3d-48af-a481-196e75ec47d9/network-metrics-daemon/0.log" Jun 02 02:12:24.871377 ip-10-0-135-96 kubenswrapper[2559]: I0602 02:12:24.871352 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jkp2b_7390b1f2-1a3d-48af-a481-196e75ec47d9/kube-rbac-proxy/0.log"