Jun 02 04:42:28.332128 ip-10-0-129-50 systemd[1]: Starting Kubernetes Kubelet... Jun 02 04:42:28.768451 ip-10-0-129-50 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:42:28.768451 ip-10-0-129-50 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 04:42:28.768451 ip-10-0-129-50 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:42:28.768451 ip-10-0-129-50 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 04:42:28.768451 ip-10-0-129-50 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 04:42:28.769703 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.769578 2582 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 04:42:28.776930 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776911 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:28.776930 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776929 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:28.776930 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776932 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776936 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776940 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776943 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776946 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776949 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776952 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776954 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776957 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776960 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776962 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776965 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776968 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776971 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776973 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776976 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776978 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776982 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776986 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:28.777023 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776989 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776992 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776994 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776996 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.776999 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777009 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777012 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777014 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777016 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777019 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777022 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777024 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777027 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777030 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777033 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777036 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777038 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777041 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777043 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:28.777477 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777045 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777048 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777051 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777053 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777055 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777058 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777062 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777064 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777067 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777069 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777071 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777074 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777076 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777079 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777081 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777085 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777087 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777090 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777093 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777095 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:28.777965 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777098 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777100 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777103 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777105 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777107 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777110 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777112 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777114 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777117 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777120 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777122 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777127 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777130 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777133 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777136 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777140 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777143 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777146 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777148 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777151 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:28.778467 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777154 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777157 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777159 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777162 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777165 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777167 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777603 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777609 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777613 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777616 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777618 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777621 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777624 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777626 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777629 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777631 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777634 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777636 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777639 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777641 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:28.778960 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777644 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777647 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777649 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777652 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777654 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777657 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777660 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777663 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777666 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777668 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777671 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777673 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777676 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777678 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777681 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777684 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777686 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777688 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777691 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777694 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:28.779441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777697 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777699 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777702 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777704 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777707 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777709 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777712 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777714 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777716 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777719 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777721 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777724 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777726 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777728 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777731 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777733 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777736 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777738 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777740 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777744 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:28.779952 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777747 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777749 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777752 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777755 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777758 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777762 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777765 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777768 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777771 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777773 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777776 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777779 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777782 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777786 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777789 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777791 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777794 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777796 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777798 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:28.780432 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777801 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777804 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777807 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777809 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777812 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777814 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777816 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777819 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777821 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777824 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777844 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777847 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.777852 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777927 2582 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777949 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777963 2582 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777969 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777975 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777978 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777982 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777987 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 04:42:28.780914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777990 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777993 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.777997 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778000 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778003 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778006 2582 flags.go:64] FLAG: --cgroup-root="" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778009 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778012 2582 flags.go:64] FLAG: --client-ca-file="" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778014 2582 flags.go:64] FLAG: --cloud-config="" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778017 2582 flags.go:64] FLAG: --cloud-provider="external" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778020 2582 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778025 2582 flags.go:64] FLAG: --cluster-domain="" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778027 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778030 2582 flags.go:64] FLAG: --config-dir="" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778033 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778036 2582 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778040 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778043 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778046 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778050 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778053 2582 flags.go:64] FLAG: --contention-profiling="false" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778055 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778059 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778062 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778064 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 04:42:28.781467 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778069 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778073 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778076 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778080 2582 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778083 2582 flags.go:64] FLAG: --enable-server="true" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778085 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778090 2582 flags.go:64] FLAG: --event-burst="100" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778093 2582 flags.go:64] FLAG: --event-qps="50" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778096 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778099 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778102 2582 flags.go:64] FLAG: --eviction-hard="" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778105 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778108 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778111 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778114 2582 flags.go:64] FLAG: --eviction-soft="" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778117 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778120 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778122 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778125 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778128 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778131 2582 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778133 2582 flags.go:64] FLAG: --feature-gates="" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778137 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778140 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778143 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 04:42:28.782102 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778146 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778149 2582 flags.go:64] FLAG: --healthz-port="10248" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778153 2582 flags.go:64] FLAG: --help="false" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778155 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-129-50.ec2.internal" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778158 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778161 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778174 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778177 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778181 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778185 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778189 2582 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778191 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778194 2582 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778197 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778200 2582 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778203 2582 flags.go:64] FLAG: --kube-reserved="" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778206 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778209 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778215 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778217 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778220 2582 flags.go:64] FLAG: --lock-file="" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778223 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778225 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778228 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 04:42:28.782758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778234 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778236 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778239 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778242 2582 flags.go:64] FLAG: --logging-format="text" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778245 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778248 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778251 2582 flags.go:64] FLAG: --manifest-url="" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778254 2582 flags.go:64] FLAG: --manifest-url-header="" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778258 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778261 2582 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778265 2582 flags.go:64] FLAG: --max-pods="110" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778267 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778271 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778273 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778276 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778279 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778282 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778285 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778294 2582 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778297 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778300 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778303 2582 flags.go:64] FLAG: --pod-cidr="" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778306 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 04:42:28.783366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778312 2582 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778314 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778317 2582 flags.go:64] FLAG: --pods-per-core="0" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778321 2582 flags.go:64] FLAG: --port="10250" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778324 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778327 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09ee37b4ed32e42d5" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778330 2582 flags.go:64] FLAG: --qos-reserved="" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778333 2582 flags.go:64] FLAG: --read-only-port="10255" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778336 2582 flags.go:64] FLAG: --register-node="true" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778339 2582 flags.go:64] FLAG: --register-schedulable="true" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778341 2582 flags.go:64] FLAG: --register-with-taints="" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778345 2582 flags.go:64] FLAG: --registry-burst="10" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778348 2582 flags.go:64] FLAG: --registry-qps="5" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778350 2582 flags.go:64] FLAG: --reserved-cpus="" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778353 2582 flags.go:64] FLAG: --reserved-memory="" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778357 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778360 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778362 2582 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778365 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778368 2582 flags.go:64] FLAG: --runonce="false" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778370 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778373 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778376 2582 flags.go:64] FLAG: --seccomp-default="false" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778379 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778382 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778385 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 04:42:28.783999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778388 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778391 2582 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778395 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778398 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778401 2582 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778404 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778407 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778410 2582 flags.go:64] FLAG: --system-cgroups="" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778412 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778419 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778421 2582 flags.go:64] FLAG: --tls-cert-file="" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778424 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778428 2582 flags.go:64] FLAG: --tls-min-version="" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778431 2582 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778434 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778437 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778440 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778443 2582 flags.go:64] FLAG: --v="2" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778447 2582 flags.go:64] FLAG: --version="false" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778451 2582 flags.go:64] FLAG: --vmodule="" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778455 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.778458 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778555 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778559 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:28.784680 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778562 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778564 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778567 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778569 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778572 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778574 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778577 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778580 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778582 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778585 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778589 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778593 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778596 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778599 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778602 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778605 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778608 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778613 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778615 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:28.785302 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778618 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778621 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778623 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778626 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778628 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778631 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778633 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778636 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778638 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778641 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778644 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778646 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778648 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778651 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778653 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778656 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778658 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778661 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778663 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778666 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:28.785781 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778669 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778671 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778674 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778676 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778679 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778682 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778685 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778689 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778691 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778694 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778698 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778700 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778702 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778705 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778707 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778710 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778712 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778715 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778717 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:28.786301 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778719 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778722 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778724 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778726 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778729 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778731 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778733 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778736 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778738 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778741 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778743 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778746 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778748 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778750 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778753 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778755 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778758 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778760 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778762 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778765 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:28.786778 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778768 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778770 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778773 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778777 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778779 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.778781 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.779380 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.786145 2582 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.786160 2582 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786219 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786224 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786227 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786230 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786233 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786235 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786238 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:28.787286 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786241 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786243 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786246 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786248 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786251 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786253 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786256 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786258 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786261 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786263 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786266 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786270 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786272 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786274 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786278 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786281 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786284 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786287 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786289 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:28.787685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786291 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786294 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786296 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786299 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786302 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786305 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786308 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786311 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786313 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786316 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786319 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786321 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786324 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786326 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786329 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786331 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786334 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786336 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786338 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786342 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:28.788236 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786345 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786348 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786351 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786354 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786358 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786361 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786364 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786367 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786369 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786372 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786375 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786378 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786380 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786382 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786385 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786388 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786390 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786393 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786395 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:28.788716 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786397 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786400 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786402 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786405 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786407 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786410 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786412 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786415 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786417 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786420 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786422 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786425 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786427 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786430 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786432 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786435 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786437 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786440 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786443 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786445 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:28.789199 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786448 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.786453 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786550 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786554 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786557 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786560 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786563 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786566 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786569 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786571 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786573 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786577 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786580 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786583 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786585 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 04:42:28.789687 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786588 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786590 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786592 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786595 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786597 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786599 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786602 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786604 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786607 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786609 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786611 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786614 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786616 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786619 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786621 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786623 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786626 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786628 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786631 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786633 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 04:42:28.790077 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786635 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786639 2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786641 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786643 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786646 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786648 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786651 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786653 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786656 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786658 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786661 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786663 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786666 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786668 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786672 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786675 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786678 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786680 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786683 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 04:42:28.790580 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786686 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786688 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786690 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786693 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786696 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786698 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786701 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786703 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786706 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786708 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786710 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786713 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786715 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786718 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786720 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786723 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786726 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786728 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786731 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786734 2582 feature_gate.go:328] unrecognized feature gate: Example Jun 02 04:42:28.791084 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786736 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786738 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786741 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786743 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786746 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786748 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786751 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786753 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786755 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786758 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786760 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786763 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786765 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:28.786768 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.786773 2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 04:42:28.791567 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.787515 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 04:42:28.793134 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.793119 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 04:42:28.794119 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.794107 2582 server.go:1019] "Starting client certificate rotation" Jun 02 04:42:28.794243 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.794224 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 04:42:28.794308 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.794275 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 04:42:28.821255 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.821228 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 04:42:28.825247 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.825218 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 04:42:28.843525 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.843500 2582 log.go:25] "Validated CRI v1 runtime API" Jun 02 04:42:28.850806 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.850788 2582 log.go:25] "Validated CRI v1 image API" Jun 02 04:42:28.853065 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.853045 2582 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 04:42:28.855967 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.855946 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9ee2d30c-e328-4879-9c9b-38a57360d93f:/dev/nvme0n1p4 ed4e12b9-8158-482c-8780-9fb39fb51cc8:/dev/nvme0n1p3] Jun 02 04:42:28.856024 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.855967 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 04:42:28.860409 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.860297 2582 manager.go:217] Machine: {Timestamp:2026-06-02 04:42:28.859776677 +0000 UTC m=+0.407769518 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106766 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2816305009e58bc17c4dc9f76834ae SystemUUID:ec281630-5009-e58b-c17c-4dc9f76834ae BootID:61dd1c13-659a-4b77-823e-f3cf1d70462f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:66:e1:cf:6b:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:66:e1:cf:6b:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:70:ad:5b:8b:24 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 04:42:28.861196 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.861185 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 04:42:28.861325 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.861312 2582 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 04:42:28.865285 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.865258 2582 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 04:42:28.865432 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.865285 2582 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-50.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 04:42:28.865488 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.865442 2582 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 04:42:28.865488 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.865450 2582 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 04:42:28.865488 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.865458 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 04:42:28.865488 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.865471 2582 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 04:42:28.866051 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.866034 2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 04:42:28.867396 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.867382 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 02 04:42:28.867509 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.867499 2582 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 04:42:28.870275 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.870263 2582 kubelet.go:491] "Attempting to sync node with API server" Jun 02 04:42:28.870328 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.870284 2582 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 04:42:28.870371 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.870331 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 04:42:28.870371 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.870342 2582 kubelet.go:397] "Adding apiserver pod source" Jun 02 04:42:28.870371 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.870352 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 04:42:28.871589 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.871576 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 04:42:28.871636 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.871596 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 04:42:28.878488 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.878472 2582 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 04:42:28.880850 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.880822 2582 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 04:42:28.883120 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883108 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 04:42:28.883163 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883127 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 04:42:28.883163 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883133 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 04:42:28.883163 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883141 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 04:42:28.883163 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883156 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 04:42:28.883163 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883164 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 04:42:28.883291 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883170 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 04:42:28.883291 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883176 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 04:42:28.883291 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883182 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 04:42:28.883291 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883188 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 04:42:28.883291 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883201 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 04:42:28.883291 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.883207 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 04:42:28.884225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.884213 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 04:42:28.884260 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.884227 2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 04:42:28.884903 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.884856 2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 04:42:28.884967 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.884949 2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 04:42:28.887526 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.887512 2582 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 04:42:28.887596 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.887551 2582 server.go:1295] "Started kubelet" Jun 02 04:42:28.887646 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.887618 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 04:42:28.887698 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.887648 2582 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 04:42:28.887742 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.887730 2582 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 04:42:28.888473 ip-10-0-129-50 systemd[1]: Started Kubernetes Kubelet. Jun 02 04:42:28.891075 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.891059 2582 server.go:317] "Adding debug handlers to kubelet server" Jun 02 04:42:28.894896 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.894821 2582 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 04:42:28.898359 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.898211 2582 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-50.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 04:42:28.898440 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.898370 2582 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 04:42:28.898584 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.898565 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 04:42:28.898584 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.898579 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 04:42:28.898747 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.898667 2582 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 04:42:28.898747 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.898678 2582 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 04:42:28.898868 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.898805 2582 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 04:42:28.898929 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.898894 2582 reconstruct.go:97] "Volume reconstruction finished" Jun 02 04:42:28.898929 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.898901 2582 reconciler.go:26] "Reconciler: start to sync state" Jun 02 04:42:28.899314 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.898120 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-50.ec2.internal.18b529f26d4d991a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-50.ec2.internal,UID:ip-10-0-129-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-50.ec2.internal,},FirstTimestamp:2026-06-02 04:42:28.887525658 +0000 UTC m=+0.435518484,LastTimestamp:2026-06-02 04:42:28.887525658 +0000 UTC m=+0.435518484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-50.ec2.internal,}" Jun 02 04:42:28.900245 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.900227 2582 factory.go:55] Registering systemd factory Jun 02 04:42:28.900245 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.900248 2582 factory.go:223] Registration of the systemd container factory successfully Jun 02 04:42:28.900482 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.900469 2582 factory.go:153] Registering CRI-O factory Jun 02 04:42:28.900549 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.900484 2582 factory.go:223] Registration of the crio container factory successfully Jun 02 04:42:28.900599 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.900563 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 04:42:28.900599 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.900576 2582 factory.go:103] Registering Raw factory Jun 02 04:42:28.900599 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.900586 2582 manager.go:1196] Started watching for new ooms in manager Jun 02 04:42:28.900959 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.900939 2582 manager.go:319] Starting recovery of all containers Jun 02 04:42:28.902541 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.902492 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:28.905452 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.905427 2582 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 04:42:28.905627 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.905604 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-50.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 04:42:28.911169 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.911148 2582 manager.go:324] Recovery completed Jun 02 04:42:28.915606 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.915592 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:28.917521 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.917503 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:28.917606 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.917539 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:28.917606 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.917554 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:28.918113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.918096 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 04:42:28.918113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.918111 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 04:42:28.918233 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.918131 2582 state_mem.go:36] "Initialized new in-memory state store" Jun 02 04:42:28.919616 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.919552 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-50.ec2.internal.18b529f26f174c4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-50.ec2.internal,UID:ip-10-0-129-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-50.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-50.ec2.internal,},FirstTimestamp:2026-06-02 04:42:28.917521486 +0000 UTC m=+0.465514312,LastTimestamp:2026-06-02 04:42:28.917521486 +0000 UTC m=+0.465514312,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-50.ec2.internal,}" Jun 02 04:42:28.922634 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.922616 2582 policy_none.go:49] "None policy: Start" Jun 02 04:42:28.922634 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.922630 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8mkks" Jun 02 04:42:28.922746 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.922636 2582 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 04:42:28.922746 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.922666 2582 state_mem.go:35] "Initializing new in-memory state store" Jun 02 04:42:28.930280 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.930262 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8mkks" Jun 02 04:42:28.932105 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.932035 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-50.ec2.internal.18b529f26f17ae21 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-50.ec2.internal,UID:ip-10-0-129-50.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-50.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-50.ec2.internal,},FirstTimestamp:2026-06-02 04:42:28.917546529 +0000 UTC m=+0.465539359,LastTimestamp:2026-06-02 04:42:28.917546529 +0000 UTC m=+0.465539359,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-50.ec2.internal,}" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.963490 2582 manager.go:341] "Starting Device Plugin manager" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.963572 2582 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.964024 2582 server.go:85] "Starting device plugin registration server" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.964370 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.964383 2582 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.964977 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.965051 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:28.965060 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.966706 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 04:42:28.981449 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:28.966754 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.002021 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.001991 2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 04:42:29.003293 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.003278 2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 04:42:29.003380 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.003299 2582 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 04:42:29.003380 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.003322 2582 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 04:42:29.003380 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.003329 2582 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 04:42:29.003380 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.003371 2582 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 04:42:29.006017 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.005993 2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:29.065560 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.065459 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:29.066525 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.066502 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:29.066636 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.066537 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:29.066636 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.066553 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:29.066636 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.066581 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.076435 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.076408 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.076537 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.076440 2582 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-50.ec2.internal\": node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.092181 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.092159 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.104029 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.104006 2582 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal"] Jun 02 04:42:29.104094 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.104068 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:29.105012 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.104997 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:29.105077 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.105030 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:29.105077 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.105045 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:29.106358 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.106345 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:29.106545 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.106527 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.106608 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.106566 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:29.107216 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.107202 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:29.107216 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.107209 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:29.107348 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.107230 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:29.107348 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.107232 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:29.107348 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.107244 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:29.107348 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.107256 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:29.108392 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.108370 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.108455 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.108396 2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 04:42:29.109115 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.109098 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientMemory" Jun 02 04:42:29.109183 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.109128 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 04:42:29.109183 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.109138 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeHasSufficientPID" Jun 02 04:42:29.124417 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.124394 2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-50.ec2.internal\" not found" node="ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.129042 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.129027 2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-50.ec2.internal\" not found" node="ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.192261 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.192222 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.200483 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.200457 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcb5ae6994b77a539942397e4bc70de4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal\" (UID: \"dcb5ae6994b77a539942397e4bc70de4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.200573 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.200485 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cc66db09ee39134ad20f355fe1d0b01-config\") pod \"kube-apiserver-proxy-ip-10-0-129-50.ec2.internal\" (UID: \"7cc66db09ee39134ad20f355fe1d0b01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.200573 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.200504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dcb5ae6994b77a539942397e4bc70de4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal\" (UID: \"dcb5ae6994b77a539942397e4bc70de4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.292862 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.292813 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.301185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.301160 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cc66db09ee39134ad20f355fe1d0b01-config\") pod \"kube-apiserver-proxy-ip-10-0-129-50.ec2.internal\" (UID: \"7cc66db09ee39134ad20f355fe1d0b01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.301229 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.301193 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dcb5ae6994b77a539942397e4bc70de4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal\" (UID: \"dcb5ae6994b77a539942397e4bc70de4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.301229 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.301213 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcb5ae6994b77a539942397e4bc70de4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal\" (UID: \"dcb5ae6994b77a539942397e4bc70de4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.301298 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.301255 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dcb5ae6994b77a539942397e4bc70de4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal\" (UID: \"dcb5ae6994b77a539942397e4bc70de4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.301298 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.301264 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dcb5ae6994b77a539942397e4bc70de4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal\" (UID: \"dcb5ae6994b77a539942397e4bc70de4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.301298 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.301264 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cc66db09ee39134ad20f355fe1d0b01-config\") pod \"kube-apiserver-proxy-ip-10-0-129-50.ec2.internal\" (UID: \"7cc66db09ee39134ad20f355fe1d0b01\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.393654 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.393578 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.427097 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.427069 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.432622 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.432604 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:29.494288 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.494247 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.594843 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.594804 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.695357 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.695274 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.793842 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.793792 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 04:42:29.794459 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.793972 2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 04:42:29.795955 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.795931 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.897268 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.897231 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:29.898886 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.898856 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 04:42:29.907181 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.907154 2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:29.913452 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.913430 2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 04:42:29.931870 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.931839 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 04:37:28 +0000 UTC" deadline="2028-02-12 03:08:16.445856592 +0000 UTC" Jun 02 04:42:29.931870 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.931868 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14878h25m46.513992367s" Jun 02 04:42:29.932594 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.932571 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c9t8l" Jun 02 04:42:29.940253 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.940235 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c9t8l" Jun 02 04:42:29.982530 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:29.982482 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc66db09ee39134ad20f355fe1d0b01.slice/crio-20d651295cec7443e34a240cc8cc6e5084143f18fd390b40d16980691205b3b2 WatchSource:0}: Error finding container 20d651295cec7443e34a240cc8cc6e5084143f18fd390b40d16980691205b3b2: Status 404 returned error can't find the container with id 20d651295cec7443e34a240cc8cc6e5084143f18fd390b40d16980691205b3b2 Jun 02 04:42:29.982795 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:29.982770 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb5ae6994b77a539942397e4bc70de4.slice/crio-a8a17f6845635ae6e4a77748432d709237d738d3dd8c75f7d0bc2df06c730793 WatchSource:0}: Error finding container a8a17f6845635ae6e4a77748432d709237d738d3dd8c75f7d0bc2df06c730793: Status 404 returned error can't find the container with id a8a17f6845635ae6e4a77748432d709237d738d3dd8c75f7d0bc2df06c730793 Jun 02 04:42:29.987020 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:29.986953 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 04:42:29.998068 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:29.998042 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:30.006248 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.006196 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" event={"ID":"dcb5ae6994b77a539942397e4bc70de4","Type":"ContainerStarted","Data":"a8a17f6845635ae6e4a77748432d709237d738d3dd8c75f7d0bc2df06c730793"} Jun 02 04:42:30.007127 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.007103 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" event={"ID":"7cc66db09ee39134ad20f355fe1d0b01","Type":"ContainerStarted","Data":"20d651295cec7443e34a240cc8cc6e5084143f18fd390b40d16980691205b3b2"} Jun 02 04:42:30.098365 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:30.098333 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:30.198793 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:30.198756 2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-50.ec2.internal\" not found" Jun 02 04:42:30.234356 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.234294 2582 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:30.299824 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.299786 2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" Jun 02 04:42:30.310577 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.310554 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 04:42:30.313310 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.313296 2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" Jun 02 04:42:30.324156 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.324133 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 04:42:30.469379 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.469346 2582 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:30.648940 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.646655 2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 04:42:30.871024 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.870993 2582 apiserver.go:52] "Watching apiserver" Jun 02 04:42:30.879962 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.879933 2582 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 04:42:30.881157 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.881127 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-xr6nk","openshift-multus/network-metrics-daemon-pq546","openshift-network-diagnostics/network-check-target-2m594","openshift-network-operator/iptables-alerter-8ff2z","kube-system/konnectivity-agent-q7bnv","kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal","openshift-image-registry/node-ca-zm68m","openshift-multus/multus-qkgrz","openshift-ovn-kubernetes/ovnkube-node-dgf7w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx","openshift-cluster-node-tuning-operator/tuned-8tw4c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal"] Jun 02 04:42:30.885456 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.885431 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.889222 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.887359 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:30.889222 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.887432 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:30.889222 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:30.887532 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:30.889222 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:30.888023 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:30.889222 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.888358 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mkxkz\"" Jun 02 04:42:30.889222 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.888919 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 04:42:30.889610 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.889243 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 04:42:30.889610 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.889292 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 04:42:30.889610 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.889492 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 04:42:30.889750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.889723 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 04:42:30.893264 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.893099 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:30.895047 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.895026 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 04:42:30.895159 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.895053 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4fwb9\"" Jun 02 04:42:30.895159 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.895027 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 04:42:30.896248 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.896232 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:30.897921 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.897904 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:42:30.898021 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.897908 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 04:42:30.898672 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.898183 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 04:42:30.898672 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.898189 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rpwqk\"" Jun 02 04:42:30.898672 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.898337 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:30.898672 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.898488 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.899953 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.899904 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 04:42:30.900237 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.900215 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 04:42:30.900516 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.900390 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 04:42:30.900516 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.900412 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c27cb\"" Jun 02 04:42:30.900516 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.900414 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 04:42:30.900516 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.900511 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhbcw\"" Jun 02 04:42:30.900720 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.900661 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.902553 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.902535 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 04:42:30.902630 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.902578 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 04:42:30.902800 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.902784 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 04:42:30.902859 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.902819 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 04:42:30.903087 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.903072 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p7whw\"" Jun 02 04:42:30.903120 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.903111 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 04:42:30.903335 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.903321 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 04:42:30.905173 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.905154 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:30.905173 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.905167 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:30.907009 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.906990 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 04:42:30.907099 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.907021 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 04:42:30.907099 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.907046 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 04:42:30.907206 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.907097 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5j8p2\"" Jun 02 04:42:30.907206 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.907106 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 04:42:30.907206 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.907187 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9xrr7\"" Jun 02 04:42:30.907370 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.907354 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:42:30.910421 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-systemd\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.910421 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910226 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5466ed00-ce4a-4163-b9d0-3576450522a7-agent-certs\") pod \"konnectivity-agent-q7bnv\" (UID: \"5466ed00-ce4a-4163-b9d0-3576450522a7\") " pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:30.910421 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910267 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.910421 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910302 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-run-netns\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.910421 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910322 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-multus-certs\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.910421 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910347 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-host-slash\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:30.910421 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910370 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-cnibin\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910426 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-os-release\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910460 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-var-lib-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910488 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-cni-bin\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910547 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-cni-netd\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-os-release\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-cnibin\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5076649b-86c8-4e4a-b653-181e816bccef-ovn-node-metrics-cert\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910625 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910641 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-iptables-alerter-script\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910681 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48gqr\" (UniqueName: \"kubernetes.io/projected/f9b14777-6686-408f-94f8-9db173624233-kube-api-access-48gqr\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910720 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-netns\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.910738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910744 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjtj\" (UniqueName: \"kubernetes.io/projected/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-kube-api-access-wdjtj\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-conf-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910857 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-etc-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910885 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9b14777-6686-408f-94f8-9db173624233-host\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-k8s-cni-cncf-io\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-cni-binary-copy\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.910981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911020 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-systemd-units\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911047 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q9mn\" (UniqueName: \"kubernetes.io/projected/5076649b-86c8-4e4a-b653-181e816bccef-kube-api-access-2q9mn\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911071 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-kubelet\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911112 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-slash\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911171 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.911221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5znn4\" (UniqueName: \"kubernetes.io/projected/401fe11a-e1ab-48a1-9211-60714444024a-kube-api-access-5znn4\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911258 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-etc-kubernetes\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911284 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-kubelet\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-ovnkube-config\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-system-cni-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911420 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-cni-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911449 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911524 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjcvj\" (UniqueName: \"kubernetes.io/projected/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-kube-api-access-tjcvj\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911564 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-socket-dir-parent\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-cni-bin\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911612 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-cni-multus\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-hostroot\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.911708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911690 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.912179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911715 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-log-socket\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.912179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911768 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-env-overrides\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.912179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911905 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-ovn\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.912179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.911955 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-ovnkube-script-lib\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.912179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.912068 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.912179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.912106 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9b14777-6686-408f-94f8-9db173624233-serviceca\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:30.912179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.912130 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-cni-binary-copy\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.912179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.912155 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-daemon-config\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:30.912490 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.912206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5466ed00-ce4a-4163-b9d0-3576450522a7-konnectivity-ca\") pod \"konnectivity-agent-q7bnv\" (UID: \"5466ed00-ce4a-4163-b9d0-3576450522a7\") " pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:30.912490 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.912240 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-node-log\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:30.912490 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.912277 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-system-cni-dir\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.912490 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.912316 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2sd2\" (UniqueName: \"kubernetes.io/projected/d77b1c01-cd50-4802-a942-c501a8880df0-kube-api-access-f2sd2\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:30.941098 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.941070 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 04:37:29 +0000 UTC" deadline="2028-01-22 23:09:01.902205242 +0000 UTC" Jun 02 04:42:30.941098 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.941095 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14394h26m30.961111857s" Jun 02 04:42:30.999693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:30.999662 2582 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 04:42:31.012581 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012546 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysctl-d\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.012763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-host\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.012763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012625 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5znn4\" (UniqueName: \"kubernetes.io/projected/401fe11a-e1ab-48a1-9211-60714444024a-kube-api-access-5znn4\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:31.012763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012652 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-etc-kubernetes\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.012763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012678 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-kubelet\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.012763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012702 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-ovnkube-config\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.012763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012731 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-system-cni-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.012763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012762 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-cni-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012790 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-modprobe-d\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012823 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-etc-kubernetes\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012865 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-tuned\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012935 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012967 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-system-cni-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.012984 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-cni-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013005 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjcvj\" (UniqueName: \"kubernetes.io/projected/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-kube-api-access-tjcvj\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013041 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-socket-dir-parent\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013077 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-systemd\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013101 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-var-lib-kubelet\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013126 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-cni-bin\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013140 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013128 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-socket-dir-parent\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013164 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-cni-multus\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013195 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-hostroot\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013220 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-cni-bin\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013225 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013261 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-cni-multus\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013282 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-log-socket\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013309 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-hostroot\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013336 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-env-overrides\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013363 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-device-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013385 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-log-socket\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-kubernetes\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013481 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-ovn\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013511 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-ovnkube-script-lib\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013540 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013565 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9b14777-6686-408f-94f8-9db173624233-serviceca\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013584 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-ovnkube-config\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013601 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-ovn\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.013683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013591 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-cni-binary-copy\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013638 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-run-ovn-kubernetes\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013658 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-daemon-config\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013675 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013689 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5466ed00-ce4a-4163-b9d0-3576450522a7-konnectivity-ca\") pod \"konnectivity-agent-q7bnv\" (UID: \"5466ed00-ce4a-4163-b9d0-3576450522a7\") " pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013715 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-node-log\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013766 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-env-overrides\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysconfig\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013817 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-system-cni-dir\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013865 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2sd2\" (UniqueName: \"kubernetes.io/projected/d77b1c01-cd50-4802-a942-c501a8880df0-kube-api-access-f2sd2\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013942 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-system-cni-dir\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.013979 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-node-log\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014018 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-systemd\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lm7l\" (UniqueName: \"kubernetes.io/projected/4f891086-cd4f-43e7-a523-39c29d4f730c-kube-api-access-7lm7l\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014100 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5466ed00-ce4a-4163-b9d0-3576450522a7-agent-certs\") pod \"konnectivity-agent-q7bnv\" (UID: \"5466ed00-ce4a-4163-b9d0-3576450522a7\") " pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014125 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-systemd\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.014501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014128 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-etc-selinux\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014151 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f9b14777-6686-408f-94f8-9db173624233-serviceca\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014185 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysctl-conf\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014214 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014260 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-cni-binary-copy\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014277 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-run-netns\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014214 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5076649b-86c8-4e4a-b653-181e816bccef-ovnkube-script-lib\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014303 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-daemon-config\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014314 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-run-netns\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-lib-modules\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014339 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5466ed00-ce4a-4163-b9d0-3576450522a7-konnectivity-ca\") pod \"konnectivity-agent-q7bnv\" (UID: \"5466ed00-ce4a-4163-b9d0-3576450522a7\") " pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014349 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014362 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-multus-certs\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014392 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-host-slash\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014410 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-multus-certs\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014419 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-cnibin\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014452 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-os-release\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014456 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-host-slash\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:31.015161 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014470 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014472 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-var-lib-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014511 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-cnibin\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014531 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-cni-bin\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014545 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-var-lib-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014557 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-os-release\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014559 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-registration-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014584 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-cni-bin\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014609 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-cni-netd\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014632 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f891086-cd4f-43e7-a523-39c29d4f730c-tmp\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014655 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-os-release\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014663 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-cni-netd\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014695 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-cnibin\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014717 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-os-release\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014725 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5076649b-86c8-4e4a-b653-181e816bccef-ovn-node-metrics-cert\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014746 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d77b1c01-cd50-4802-a942-c501a8880df0-cnibin\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.016221 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014768 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-iptables-alerter-script\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014791 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-kubelet\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014823 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-48gqr\" (UniqueName: \"kubernetes.io/projected/f9b14777-6686-408f-94f8-9db173624233-kube-api-access-48gqr\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014867 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-netns\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.014878 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014890 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjtj\" (UniqueName: \"kubernetes.io/projected/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-kube-api-access-wdjtj\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014917 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhcx\" (UniqueName: \"kubernetes.io/projected/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-kube-api-access-vrhcx\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.014977 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:42:31.514927893 +0000 UTC m=+3.062920744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.014969 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-netns\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-sys\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015077 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-conf-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015106 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015149 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-etc-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015176 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-socket-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015220 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-run\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015245 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9b14777-6686-408f-94f8-9db173624233-host\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015276 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-k8s-cni-cncf-io\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017010 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015288 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-iptables-alerter-script\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015304 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-cni-binary-copy\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015333 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015364 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-systemd-units\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015365 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-multus-conf-dir\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015386 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9b14777-6686-408f-94f8-9db173624233-host\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015425 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-run-k8s-cni-cncf-io\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015440 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-etc-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015786 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-systemd-units\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015845 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q9mn\" (UniqueName: \"kubernetes.io/projected/5076649b-86c8-4e4a-b653-181e816bccef-kube-api-access-2q9mn\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015870 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-kubelet\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015886 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-slash\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015902 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015929 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d77b1c01-cd50-4802-a942-c501a8880df0-cni-binary-copy\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-sys-fs\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.015964 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-host-var-lib-kubelet\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.017723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.016057 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-host-slash\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.018438 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.016060 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5076649b-86c8-4e4a-b653-181e816bccef-run-openvswitch\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.018438 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.017999 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5076649b-86c8-4e4a-b653-181e816bccef-ovn-node-metrics-cert\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.018438 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.018147 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5466ed00-ce4a-4163-b9d0-3576450522a7-agent-certs\") pod \"konnectivity-agent-q7bnv\" (UID: \"5466ed00-ce4a-4163-b9d0-3576450522a7\") " pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:31.028911 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.028880 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:31.029039 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.028932 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:31.029039 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.028951 2582 projected.go:194] Error preparing data for projected volume kube-api-access-zkkbv for pod openshift-network-diagnostics/network-check-target-2m594: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:31.029168 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.029147 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv podName:3763f76e-013e-41e6-ba3b-ab56495228b7 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:31.529126172 +0000 UTC m=+3.077119002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zkkbv" (UniqueName: "kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv") pod "network-check-target-2m594" (UID: "3763f76e-013e-41e6-ba3b-ab56495228b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:31.032076 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.032043 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2sd2\" (UniqueName: \"kubernetes.io/projected/d77b1c01-cd50-4802-a942-c501a8880df0-kube-api-access-f2sd2\") pod \"multus-additional-cni-plugins-xr6nk\" (UID: \"d77b1c01-cd50-4802-a942-c501a8880df0\") " pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.032183 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.032114 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjcvj\" (UniqueName: \"kubernetes.io/projected/8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0-kube-api-access-tjcvj\") pod \"iptables-alerter-8ff2z\" (UID: \"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0\") " pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:31.032296 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.032274 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5znn4\" (UniqueName: \"kubernetes.io/projected/401fe11a-e1ab-48a1-9211-60714444024a-kube-api-access-5znn4\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:31.032975 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.032952 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48gqr\" (UniqueName: \"kubernetes.io/projected/f9b14777-6686-408f-94f8-9db173624233-kube-api-access-48gqr\") pod \"node-ca-zm68m\" (UID: \"f9b14777-6686-408f-94f8-9db173624233\") " pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:31.033655 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.033635 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q9mn\" (UniqueName: \"kubernetes.io/projected/5076649b-86c8-4e4a-b653-181e816bccef-kube-api-access-2q9mn\") pod \"ovnkube-node-dgf7w\" (UID: \"5076649b-86c8-4e4a-b653-181e816bccef\") " pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.040574 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.040540 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjtj\" (UniqueName: \"kubernetes.io/projected/cbd9129e-b2bf-41fb-9df4-9df29bbd16c7-kube-api-access-wdjtj\") pod \"multus-qkgrz\" (UID: \"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7\") " pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.116497 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116464 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-registration-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.116665 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116506 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f891086-cd4f-43e7-a523-39c29d4f730c-tmp\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116665 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116595 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-registration-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.116665 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116627 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhcx\" (UniqueName: \"kubernetes.io/projected/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-kube-api-access-vrhcx\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.116665 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116656 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-sys\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116685 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-socket-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116709 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-run\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116747 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-sys-fs\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-sys\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116768 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysctl-d\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116789 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-host\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116807 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-sys-fs\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116816 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-modprobe-d\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116855 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-tuned\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116880 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-systemd\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116876 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-socket-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.116895 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116900 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-var-lib-kubelet\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116916 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-host\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116928 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-device-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116964 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysctl-d\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116978 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-device-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116851 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-run\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116966 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-kubernetes\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116990 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-modprobe-d\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.116978 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-systemd\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117023 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-var-lib-kubelet\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117038 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-kubernetes\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117051 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117077 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysconfig\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117109 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lm7l\" (UniqueName: \"kubernetes.io/projected/4f891086-cd4f-43e7-a523-39c29d4f730c-kube-api-access-7lm7l\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117131 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117136 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-etc-selinux\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.117419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117418 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysctl-conf\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.118205 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117447 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-lib-modules\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.118205 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117179 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-etc-selinux\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.118205 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117154 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysconfig\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.118205 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117608 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-sysctl-conf\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.118205 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.117721 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f891086-cd4f-43e7-a523-39c29d4f730c-lib-modules\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.119258 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.119239 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f891086-cd4f-43e7-a523-39c29d4f730c-tmp\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.119369 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.119285 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f891086-cd4f-43e7-a523-39c29d4f730c-etc-tuned\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.125359 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.125340 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lm7l\" (UniqueName: \"kubernetes.io/projected/4f891086-cd4f-43e7-a523-39c29d4f730c-kube-api-access-7lm7l\") pod \"tuned-8tw4c\" (UID: \"4f891086-cd4f-43e7-a523-39c29d4f730c\") " pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.125699 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.125678 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhcx\" (UniqueName: \"kubernetes.io/projected/ae1dd592-edac-4d48-8cb6-fadc9c2bc3db-kube-api-access-vrhcx\") pod \"aws-ebs-csi-driver-node-qv6kx\" (UID: \"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.195714 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.195637 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" Jun 02 04:42:31.205524 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.205494 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:31.216004 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.215976 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8ff2z" Jun 02 04:42:31.221650 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.221625 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zm68m" Jun 02 04:42:31.229274 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.229244 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qkgrz" Jun 02 04:42:31.236195 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.236171 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:31.241855 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.241814 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" Jun 02 04:42:31.247572 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.247549 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" Jun 02 04:42:31.520573 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.520502 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:31.520706 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.520612 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:31.520706 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.520659 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:42:32.520646035 +0000 UTC m=+4.068638848 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:31.621152 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.621107 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:31.621322 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.621285 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:31.621322 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.621309 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:31.621322 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.621320 2582 projected.go:194] Error preparing data for projected volume kube-api-access-zkkbv for pod openshift-network-diagnostics/network-check-target-2m594: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:31.621486 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:31.621403 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv podName:3763f76e-013e-41e6-ba3b-ab56495228b7 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:32.621385872 +0000 UTC m=+4.169378686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkkbv" (UniqueName: "kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv") pod "network-check-target-2m594" (UID: "3763f76e-013e-41e6-ba3b-ab56495228b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:31.702533 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:31.702492 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd77b1c01_cd50_4802_a942_c501a8880df0.slice/crio-976533b7810fd03a4bc80c76874e0bff607d91e23f4f918cbee38d7621a26cad WatchSource:0}: Error finding container 976533b7810fd03a4bc80c76874e0bff607d91e23f4f918cbee38d7621a26cad: Status 404 returned error can't find the container with id 976533b7810fd03a4bc80c76874e0bff607d91e23f4f918cbee38d7621a26cad Jun 02 04:42:31.705786 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:31.705756 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1dd592_edac_4d48_8cb6_fadc9c2bc3db.slice/crio-11ca45535acab93c55af04d65abff0f5e64ee982cdf3f6899b938873fe3213e0 WatchSource:0}: Error finding container 11ca45535acab93c55af04d65abff0f5e64ee982cdf3f6899b938873fe3213e0: Status 404 returned error can't find the container with id 11ca45535acab93c55af04d65abff0f5e64ee982cdf3f6899b938873fe3213e0 Jun 02 04:42:31.708013 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:31.707977 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5466ed00_ce4a_4163_b9d0_3576450522a7.slice/crio-aa5ca0e17fd86ac5ef7fcc5daed38b725187a353d605a245b65d6067456e4ca7 WatchSource:0}: Error finding container aa5ca0e17fd86ac5ef7fcc5daed38b725187a353d605a245b65d6067456e4ca7: Status 404 returned error can't find the container with id aa5ca0e17fd86ac5ef7fcc5daed38b725187a353d605a245b65d6067456e4ca7 Jun 02 04:42:31.708819 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:31.708792 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5076649b_86c8_4e4a_b653_181e816bccef.slice/crio-897a13ff8a5abea6518b58aa83fc50fb0f196417a3ffc6e58196eebb61fc5ecd WatchSource:0}: Error finding container 897a13ff8a5abea6518b58aa83fc50fb0f196417a3ffc6e58196eebb61fc5ecd: Status 404 returned error can't find the container with id 897a13ff8a5abea6518b58aa83fc50fb0f196417a3ffc6e58196eebb61fc5ecd Jun 02 04:42:31.731389 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:31.731367 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b14777_6686_408f_94f8_9db173624233.slice/crio-3f854bce5094ce74b02c0c2aae8cdcb44c88c204802874bc38dbd8c289c362c2 WatchSource:0}: Error finding container 3f854bce5094ce74b02c0c2aae8cdcb44c88c204802874bc38dbd8c289c362c2: Status 404 returned error can't find the container with id 3f854bce5094ce74b02c0c2aae8cdcb44c88c204802874bc38dbd8c289c362c2 Jun 02 04:42:31.732798 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:31.732578 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8727f1c6_43f3_4f5b_bdd2_46f73e5b59f0.slice/crio-ae3719539b173811d8f6c57aecdd7bf66226ca2c93e4a6a1fa85ac3eff16c7a0 WatchSource:0}: Error finding container ae3719539b173811d8f6c57aecdd7bf66226ca2c93e4a6a1fa85ac3eff16c7a0: Status 404 returned error can't find the container with id ae3719539b173811d8f6c57aecdd7bf66226ca2c93e4a6a1fa85ac3eff16c7a0 Jun 02 04:42:31.733504 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:31.733484 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f891086_cd4f_43e7_a523_39c29d4f730c.slice/crio-cc8a11c841a13596084bbdd73519555e8e2c138d0eda66c9c79e16ded8c7511f WatchSource:0}: Error finding container cc8a11c841a13596084bbdd73519555e8e2c138d0eda66c9c79e16ded8c7511f: Status 404 returned error can't find the container with id cc8a11c841a13596084bbdd73519555e8e2c138d0eda66c9c79e16ded8c7511f Jun 02 04:42:31.735319 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:42:31.735302 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd9129e_b2bf_41fb_9df4_9df29bbd16c7.slice/crio-bd175cdbcf3f79df6a6ba0721dde93c2eecc3cf6f7fb162ae26ef21638556eb9 WatchSource:0}: Error finding container bd175cdbcf3f79df6a6ba0721dde93c2eecc3cf6f7fb162ae26ef21638556eb9: Status 404 returned error can't find the container with id bd175cdbcf3f79df6a6ba0721dde93c2eecc3cf6f7fb162ae26ef21638556eb9 Jun 02 04:42:31.941716 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.941680 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 04:37:29 +0000 UTC" deadline="2028-03-16 21:02:02.809107326 +0000 UTC" Jun 02 04:42:31.941716 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:31.941710 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15688h19m30.867399577s" Jun 02 04:42:32.013240 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.013213 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" event={"ID":"4f891086-cd4f-43e7-a523-39c29d4f730c","Type":"ContainerStarted","Data":"cc8a11c841a13596084bbdd73519555e8e2c138d0eda66c9c79e16ded8c7511f"} Jun 02 04:42:32.014170 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.014141 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"897a13ff8a5abea6518b58aa83fc50fb0f196417a3ffc6e58196eebb61fc5ecd"} Jun 02 04:42:32.015039 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.015019 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" event={"ID":"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db","Type":"ContainerStarted","Data":"11ca45535acab93c55af04d65abff0f5e64ee982cdf3f6899b938873fe3213e0"} Jun 02 04:42:32.015968 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.015941 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q7bnv" event={"ID":"5466ed00-ce4a-4163-b9d0-3576450522a7","Type":"ContainerStarted","Data":"aa5ca0e17fd86ac5ef7fcc5daed38b725187a353d605a245b65d6067456e4ca7"} Jun 02 04:42:32.017056 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.017036 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" event={"ID":"d77b1c01-cd50-4802-a942-c501a8880df0","Type":"ContainerStarted","Data":"976533b7810fd03a4bc80c76874e0bff607d91e23f4f918cbee38d7621a26cad"} Jun 02 04:42:32.018085 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.018064 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8ff2z" event={"ID":"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0","Type":"ContainerStarted","Data":"ae3719539b173811d8f6c57aecdd7bf66226ca2c93e4a6a1fa85ac3eff16c7a0"} Jun 02 04:42:32.019134 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.019100 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zm68m" event={"ID":"f9b14777-6686-408f-94f8-9db173624233","Type":"ContainerStarted","Data":"3f854bce5094ce74b02c0c2aae8cdcb44c88c204802874bc38dbd8c289c362c2"} Jun 02 04:42:32.020569 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.020549 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" event={"ID":"7cc66db09ee39134ad20f355fe1d0b01","Type":"ContainerStarted","Data":"6250b212afdd58ffd0f3d310c9d6324dbaeb915bf0d35eeefcb383d488f1c9af"} Jun 02 04:42:32.021535 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.021515 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qkgrz" event={"ID":"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7","Type":"ContainerStarted","Data":"bd175cdbcf3f79df6a6ba0721dde93c2eecc3cf6f7fb162ae26ef21638556eb9"} Jun 02 04:42:32.038606 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.038516 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-50.ec2.internal" podStartSLOduration=2.038499449 podStartE2EDuration="2.038499449s" podCreationTimestamp="2026-06-02 04:42:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:42:32.037946841 +0000 UTC m=+3.585939677" watchObservedRunningTime="2026-06-02 04:42:32.038499449 +0000 UTC m=+3.586492287" Jun 02 04:42:32.528637 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.528539 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:32.528792 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:32.528719 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:32.528792 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:32.528783 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:42:34.528764508 +0000 UTC m=+6.076757332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:32.629648 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:32.629601 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:32.629911 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:32.629787 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:32.629911 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:32.629809 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:32.629911 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:32.629823 2582 projected.go:194] Error preparing data for projected volume kube-api-access-zkkbv for pod openshift-network-diagnostics/network-check-target-2m594: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:32.629911 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:32.629901 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv podName:3763f76e-013e-41e6-ba3b-ab56495228b7 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:34.629882036 +0000 UTC m=+6.177874872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkkbv" (UniqueName: "kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv") pod "network-check-target-2m594" (UID: "3763f76e-013e-41e6-ba3b-ab56495228b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:33.006117 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.006038 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:33.006573 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:33.006184 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:33.006678 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.006658 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:33.006786 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:33.006767 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:33.020297 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.020266 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2t6x7"] Jun 02 04:42:33.023258 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.023233 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.023404 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:33.023317 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:33.046564 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.046520 2582 generic.go:358] "Generic (PLEG): container finished" podID="dcb5ae6994b77a539942397e4bc70de4" containerID="1d8709ba3c72ee53cdcf20c8af9aba9d40c0587b751ca87d88da602cf8097474" exitCode=0 Jun 02 04:42:33.047195 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.047163 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" event={"ID":"dcb5ae6994b77a539942397e4bc70de4","Type":"ContainerDied","Data":"1d8709ba3c72ee53cdcf20c8af9aba9d40c0587b751ca87d88da602cf8097474"} Jun 02 04:42:33.135256 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.135041 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14408def-e3d2-4108-b7c6-492f054ad6ea-kubelet-config\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.135256 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.135099 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14408def-e3d2-4108-b7c6-492f054ad6ea-dbus\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.135256 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.135134 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.236330 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.236299 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.236452 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.236406 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14408def-e3d2-4108-b7c6-492f054ad6ea-kubelet-config\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.236452 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.236442 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14408def-e3d2-4108-b7c6-492f054ad6ea-dbus\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.236627 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.236607 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14408def-e3d2-4108-b7c6-492f054ad6ea-dbus\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.236735 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:33.236718 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:33.236802 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:33.236778 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret podName:14408def-e3d2-4108-b7c6-492f054ad6ea nodeName:}" failed. No retries permitted until 2026-06-02 04:42:33.736758314 +0000 UTC m=+5.284751131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret") pod "global-pull-secret-syncer-2t6x7" (UID: "14408def-e3d2-4108-b7c6-492f054ad6ea") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:33.236878 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.236853 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14408def-e3d2-4108-b7c6-492f054ad6ea-kubelet-config\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.741186 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:33.741060 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:33.741411 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:33.741206 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:33.741411 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:33.741284 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret podName:14408def-e3d2-4108-b7c6-492f054ad6ea nodeName:}" failed. No retries permitted until 2026-06-02 04:42:34.741263024 +0000 UTC m=+6.289255861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret") pod "global-pull-secret-syncer-2t6x7" (UID: "14408def-e3d2-4108-b7c6-492f054ad6ea") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:34.051604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:34.051151 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" event={"ID":"dcb5ae6994b77a539942397e4bc70de4","Type":"ContainerStarted","Data":"b8c1d0a9c7efe71d4fc55df80cbe033ef9c1da1ac8997aba7b7cf656a4d085ea"} Jun 02 04:42:34.064787 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:34.064734 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-50.ec2.internal" podStartSLOduration=4.064715942 podStartE2EDuration="4.064715942s" podCreationTimestamp="2026-06-02 04:42:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:42:34.064417303 +0000 UTC m=+5.612410142" watchObservedRunningTime="2026-06-02 04:42:34.064715942 +0000 UTC m=+5.612708778" Jun 02 04:42:34.548934 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:34.548849 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:34.549223 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:34.549019 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:34.549223 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:34.549081 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:42:38.549062356 +0000 UTC m=+10.097055172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:34.649271 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:34.649234 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:34.649487 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:34.649391 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:34.649487 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:34.649411 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:34.649487 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:34.649423 2582 projected.go:194] Error preparing data for projected volume kube-api-access-zkkbv for pod openshift-network-diagnostics/network-check-target-2m594: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:34.649487 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:34.649480 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv podName:3763f76e-013e-41e6-ba3b-ab56495228b7 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:38.649461466 +0000 UTC m=+10.197454294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkkbv" (UniqueName: "kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv") pod "network-check-target-2m594" (UID: "3763f76e-013e-41e6-ba3b-ab56495228b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:34.753163 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:34.753126 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:34.753376 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:34.753304 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:34.753429 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:34.753378 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret podName:14408def-e3d2-4108-b7c6-492f054ad6ea nodeName:}" failed. No retries permitted until 2026-06-02 04:42:36.753356522 +0000 UTC m=+8.301349352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret") pod "global-pull-secret-syncer-2t6x7" (UID: "14408def-e3d2-4108-b7c6-492f054ad6ea") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:35.006061 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:35.005915 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:35.006061 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:35.005950 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:35.006061 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:35.006022 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:35.006061 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:35.006070 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:35.006311 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:35.006157 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:35.006474 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:35.006433 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:36.777460 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:36.777416 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:36.777925 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:36.777564 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:36.777925 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:36.777650 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret podName:14408def-e3d2-4108-b7c6-492f054ad6ea nodeName:}" failed. No retries permitted until 2026-06-02 04:42:40.777627428 +0000 UTC m=+12.325620300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret") pod "global-pull-secret-syncer-2t6x7" (UID: "14408def-e3d2-4108-b7c6-492f054ad6ea") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:37.005956 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:37.005913 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:37.006121 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:37.006042 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:37.006121 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:37.006045 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:37.006121 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:37.006072 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:37.006299 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:37.006176 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:37.006299 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:37.006266 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:38.592572 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:38.592532 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:38.593008 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:38.592706 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:38.593008 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:38.592782 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:42:46.592761623 +0000 UTC m=+18.140754451 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:38.693393 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:38.693310 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:38.693545 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:38.693484 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:38.693545 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:38.693510 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:38.693545 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:38.693522 2582 projected.go:194] Error preparing data for projected volume kube-api-access-zkkbv for pod openshift-network-diagnostics/network-check-target-2m594: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:38.693652 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:38.693588 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv podName:3763f76e-013e-41e6-ba3b-ab56495228b7 nodeName:}" failed. No retries permitted until 2026-06-02 04:42:46.693568209 +0000 UTC m=+18.241561028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkkbv" (UniqueName: "kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv") pod "network-check-target-2m594" (UID: "3763f76e-013e-41e6-ba3b-ab56495228b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:39.004811 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:39.004728 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:39.004979 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:39.004889 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:39.004979 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:39.004914 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:39.004979 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:39.004951 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:39.005143 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:39.005033 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:39.005143 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:39.005105 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:40.813704 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:40.813654 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:40.814287 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:40.813839 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:40.814287 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:40.813923 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret podName:14408def-e3d2-4108-b7c6-492f054ad6ea nodeName:}" failed. No retries permitted until 2026-06-02 04:42:48.813902218 +0000 UTC m=+20.361895032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret") pod "global-pull-secret-syncer-2t6x7" (UID: "14408def-e3d2-4108-b7c6-492f054ad6ea") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:41.004266 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.004223 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:41.004266 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.004257 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:41.004470 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.004308 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:41.004470 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:41.004383 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:41.004748 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:41.004705 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:41.004909 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:41.004846 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:41.524765 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.524723 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2jvdg"] Jun 02 04:42:41.532517 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.532490 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.535059 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.535038 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zrgp6\"" Jun 02 04:42:41.535254 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.535228 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 04:42:41.535254 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.535245 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 04:42:41.621529 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.621489 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e13e1144-840d-4398-8d98-5be590db9c25-tmp-dir\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.621707 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.621552 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e13e1144-840d-4398-8d98-5be590db9c25-hosts-file\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.621707 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.621596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr7c2\" (UniqueName: \"kubernetes.io/projected/e13e1144-840d-4398-8d98-5be590db9c25-kube-api-access-hr7c2\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.722374 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.722342 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hr7c2\" (UniqueName: \"kubernetes.io/projected/e13e1144-840d-4398-8d98-5be590db9c25-kube-api-access-hr7c2\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.722528 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.722394 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e13e1144-840d-4398-8d98-5be590db9c25-tmp-dir\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.722528 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.722431 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e13e1144-840d-4398-8d98-5be590db9c25-hosts-file\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.722528 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.722511 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e13e1144-840d-4398-8d98-5be590db9c25-hosts-file\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.722737 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.722719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e13e1144-840d-4398-8d98-5be590db9c25-tmp-dir\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.732493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.732463 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr7c2\" (UniqueName: \"kubernetes.io/projected/e13e1144-840d-4398-8d98-5be590db9c25-kube-api-access-hr7c2\") pod \"node-resolver-2jvdg\" (UID: \"e13e1144-840d-4398-8d98-5be590db9c25\") " pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:41.842749 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:41.842657 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2jvdg" Jun 02 04:42:43.003996 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:43.003960 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:43.003996 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:43.003976 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:43.004475 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:43.004076 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:43.004475 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:43.004088 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:43.004475 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:43.004175 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:43.004475 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:43.004308 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:45.004283 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:45.004245 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:45.004283 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:45.004273 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:45.004674 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:45.004349 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:45.004674 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:45.004366 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:45.004674 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:45.004426 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:45.004674 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:45.004478 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:46.655475 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:46.655434 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:46.655923 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:46.655612 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:46.655923 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:46.655696 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:43:02.655673766 +0000 UTC m=+34.203666583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:42:46.756333 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:46.756296 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:46.756521 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:46.756452 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:42:46.756521 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:46.756470 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:42:46.756521 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:46.756483 2582 projected.go:194] Error preparing data for projected volume kube-api-access-zkkbv for pod openshift-network-diagnostics/network-check-target-2m594: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:46.756668 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:46.756540 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv podName:3763f76e-013e-41e6-ba3b-ab56495228b7 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:02.756526281 +0000 UTC m=+34.304519098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkkbv" (UniqueName: "kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv") pod "network-check-target-2m594" (UID: "3763f76e-013e-41e6-ba3b-ab56495228b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:42:47.003972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:47.003844 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:47.003972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:47.003859 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:47.004179 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:47.003981 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:47.004179 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:47.003985 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:47.004179 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:47.004077 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:47.004179 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:47.004169 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:48.870847 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:48.870795 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:48.871362 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:48.870941 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:48.871362 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:48.871022 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret podName:14408def-e3d2-4108-b7c6-492f054ad6ea nodeName:}" failed. No retries permitted until 2026-06-02 04:43:04.871001062 +0000 UTC m=+36.418993889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret") pod "global-pull-secret-syncer-2t6x7" (UID: "14408def-e3d2-4108-b7c6-492f054ad6ea") : object "kube-system"/"original-pull-secret" not registered Jun 02 04:42:49.004544 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:49.004512 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:49.004720 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:49.004608 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:49.004720 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:49.004652 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:49.004720 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:49.004701 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:49.004900 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:49.004724 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:49.004900 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:49.004781 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:50.081247 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:50.080891 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" event={"ID":"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db","Type":"ContainerStarted","Data":"a0f275b676d8c35ea65715e4e25cd566603d3639088a923c5b63c413e26251e1"} Jun 02 04:42:50.085811 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:50.084690 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q7bnv" event={"ID":"5466ed00-ce4a-4163-b9d0-3576450522a7","Type":"ContainerStarted","Data":"12c23949228bea05b1a7cbbcb09edb34a85763f5bed555693d28883092d14e60"} Jun 02 04:42:50.089773 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:50.087876 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jvdg" event={"ID":"e13e1144-840d-4398-8d98-5be590db9c25","Type":"ContainerStarted","Data":"408005918e9769abcd03c1b714cec9dd85d6b19a792100941eb4d44ecad70d8c"} Jun 02 04:42:50.091662 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:50.091104 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" event={"ID":"4f891086-cd4f-43e7-a523-39c29d4f730c","Type":"ContainerStarted","Data":"eb138da47de7b5a2334eb5dd114587eaef372f876184987d4c1887a82d76d3ce"} Jun 02 04:42:50.100071 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:50.100031 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q7bnv" podStartSLOduration=7.763542585 podStartE2EDuration="21.100017976s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:42:31.730027297 +0000 UTC m=+3.278020110" lastFinishedPulling="2026-06-02 04:42:45.066502669 +0000 UTC m=+16.614495501" observedRunningTime="2026-06-02 04:42:50.099720604 +0000 UTC m=+21.647713438" watchObservedRunningTime="2026-06-02 04:42:50.100017976 +0000 UTC m=+21.648010811" Jun 02 04:42:50.116070 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:50.116011 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8tw4c" podStartSLOduration=2.985376382 podStartE2EDuration="21.115994365s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:42:31.738811034 +0000 UTC m=+3.286803846" lastFinishedPulling="2026-06-02 04:42:49.869429008 +0000 UTC m=+21.417421829" observedRunningTime="2026-06-02 04:42:50.11525847 +0000 UTC m=+21.663251292" watchObservedRunningTime="2026-06-02 04:42:50.115994365 +0000 UTC m=+21.663987199" Jun 02 04:42:50.266416 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:50.266386 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:51.004573 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.004370 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:51.004798 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.004376 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:51.004798 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:51.004671 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:51.004798 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.004376 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:51.004798 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:51.004736 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:51.005033 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:51.004868 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:51.094318 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.094277 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2jvdg" event={"ID":"e13e1144-840d-4398-8d98-5be590db9c25","Type":"ContainerStarted","Data":"a3164d8aa88a0c5389edeb4bbbd76e2db06865bffc620887e90fdec5a13239d8"} Jun 02 04:42:51.095560 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.095539 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qkgrz" event={"ID":"cbd9129e-b2bf-41fb-9df4-9df29bbd16c7","Type":"ContainerStarted","Data":"8f2af24eaade288afa8db904336392e1b5f7c1d9fa98f3bcf360e44fbf8c86aa"} Jun 02 04:42:51.097989 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.097969 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:42:51.098289 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.098271 2582 generic.go:358] "Generic (PLEG): container finished" podID="5076649b-86c8-4e4a-b653-181e816bccef" containerID="755b596ce244d37d20b0ac120990c1225f6e5cf30bb66cfe8903b7de0aa773b3" exitCode=1 Jun 02 04:42:51.098356 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.098336 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"9f065e993c6a8a109d23448e9a2ead7d19bdc685ee1300f11f99943ddb6f7c24"} Jun 02 04:42:51.098399 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.098365 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"9852269bda1cb6c37b107987b8e55bd0f24db74a2b131171c66ab4cccc46ce94"} Jun 02 04:42:51.098399 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.098380 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"8313ebd806621e247ea34446540bfaefb1bc8566cd99c0b9dbe6e5dd31c9e345"} Jun 02 04:42:51.098399 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.098388 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"f2a5a293e817819a71c2171c17f28278961114ff9f83fe665d95aa318e0741ac"} Jun 02 04:42:51.098508 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.098401 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerDied","Data":"755b596ce244d37d20b0ac120990c1225f6e5cf30bb66cfe8903b7de0aa773b3"} Jun 02 04:42:51.098508 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.098415 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"572fa8bb7e935543935b18dd78ec852d49865d7ecadd719b5ed22117a208d605"} Jun 02 04:42:51.099498 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.099481 2582 generic.go:358] "Generic (PLEG): container finished" podID="d77b1c01-cd50-4802-a942-c501a8880df0" containerID="dcbc096b2eee4ab221521ff6dd2261f97b4c592cc45e2ca117971ed4a7947d13" exitCode=0 Jun 02 04:42:51.099579 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.099534 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" event={"ID":"d77b1c01-cd50-4802-a942-c501a8880df0","Type":"ContainerDied","Data":"dcbc096b2eee4ab221521ff6dd2261f97b4c592cc45e2ca117971ed4a7947d13"} Jun 02 04:42:51.100808 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.100710 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zm68m" event={"ID":"f9b14777-6686-408f-94f8-9db173624233","Type":"ContainerStarted","Data":"287cd30208190a69be7a2262c8f184c69cf1e6a7c7c49bd7231dc71a0311aaf4"} Jun 02 04:42:51.134242 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.134182 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2jvdg" podStartSLOduration=10.13416832 podStartE2EDuration="10.13416832s" podCreationTimestamp="2026-06-02 04:42:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:42:51.133664029 +0000 UTC m=+22.681656863" watchObservedRunningTime="2026-06-02 04:42:51.13416832 +0000 UTC m=+22.682161154" Jun 02 04:42:51.153798 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.153759 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zm68m" podStartSLOduration=4.019161641 podStartE2EDuration="22.15374621s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:42:31.733091789 +0000 UTC m=+3.281084602" lastFinishedPulling="2026-06-02 04:42:49.867676344 +0000 UTC m=+21.415669171" observedRunningTime="2026-06-02 04:42:51.153653779 +0000 UTC m=+22.701646614" watchObservedRunningTime="2026-06-02 04:42:51.15374621 +0000 UTC m=+22.701739042" Jun 02 04:42:51.512715 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.512391 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 04:42:51.981009 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.980714 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T04:42:51.512417145Z","UUID":"bce70443-194f-47a3-a51a-91d01f8c7485","Handler":null,"Name":"","Endpoint":""} Jun 02 04:42:51.983617 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.983596 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 04:42:51.983617 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:51.983625 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 04:42:52.106116 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:52.106075 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" event={"ID":"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db","Type":"ContainerStarted","Data":"3e3d42209b371b6959bd47d5f189052f05a0c50f365e14239b255057019d5b51"} Jun 02 04:42:52.108497 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:52.108469 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8ff2z" event={"ID":"8727f1c6-43f3-4f5b-bdd2-46f73e5b59f0","Type":"ContainerStarted","Data":"502b979690a4af6bf0d749d0a46a40a5dbc4396f74cb1838cccdbd2f08864a66"} Jun 02 04:42:52.122264 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:52.122238 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:52.122878 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:52.122859 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:52.124521 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:52.124480 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8ff2z" podStartSLOduration=4.991418132 podStartE2EDuration="23.124468744s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:42:31.734627844 +0000 UTC m=+3.282620671" lastFinishedPulling="2026-06-02 04:42:49.867678467 +0000 UTC m=+21.415671283" observedRunningTime="2026-06-02 04:42:52.124430707 +0000 UTC m=+23.672423542" watchObservedRunningTime="2026-06-02 04:42:52.124468744 +0000 UTC m=+23.672461579" Jun 02 04:42:52.124703 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:52.124677 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qkgrz" podStartSLOduration=4.977274448 podStartE2EDuration="23.124672391s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:42:31.738664356 +0000 UTC m=+3.286657169" lastFinishedPulling="2026-06-02 04:42:49.8860623 +0000 UTC m=+21.434055112" observedRunningTime="2026-06-02 04:42:51.199745894 +0000 UTC m=+22.747738729" watchObservedRunningTime="2026-06-02 04:42:52.124672391 +0000 UTC m=+23.672665225" Jun 02 04:42:53.004122 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:53.004082 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:53.004301 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:53.004207 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:53.004301 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:53.004227 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:53.004301 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:53.004262 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:53.004457 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:53.004363 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:53.004457 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:53.004443 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:53.112586 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:53.112558 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:42:53.113184 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:53.113028 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"469ae3bd5a1ee9bdb9e07958fb1d495688384c3839c2685e4b62d78c8387f546"} Jun 02 04:42:53.115057 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:53.115031 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" event={"ID":"ae1dd592-edac-4d48-8cb6-fadc9c2bc3db","Type":"ContainerStarted","Data":"014c0fa43bc56f8b2c6d68cfec45343b03b615c617ffa6f1ce83dcd3c553cc5e"} Jun 02 04:42:53.116024 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:53.116005 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q7bnv" Jun 02 04:42:53.133806 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:53.133758 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qv6kx" podStartSLOduration=3.3210051529999998 podStartE2EDuration="24.133746486s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:42:31.707705685 +0000 UTC m=+3.255698498" lastFinishedPulling="2026-06-02 04:42:52.520447004 +0000 UTC m=+24.068439831" observedRunningTime="2026-06-02 04:42:53.133508184 +0000 UTC m=+24.681501018" watchObservedRunningTime="2026-06-02 04:42:53.133746486 +0000 UTC m=+24.681739321" Jun 02 04:42:55.004033 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.003893 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:55.004722 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.003899 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:55.004722 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:55.004106 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:55.004722 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.003953 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:55.004722 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:55.004192 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:55.004722 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:55.004310 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:55.122096 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.121981 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:42:55.122418 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.122383 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"da501d7af83a3da94892564a32f0bd540a4fd99d23ae623bd1f96314ae16ded3"} Jun 02 04:42:55.122898 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.122877 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:55.122982 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.122910 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:55.122982 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.122885 2582 scope.go:117] "RemoveContainer" containerID="755b596ce244d37d20b0ac120990c1225f6e5cf30bb66cfe8903b7de0aa773b3" Jun 02 04:42:55.140091 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.140061 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:55.140496 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:55.140483 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:56.113606 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:56.113565 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:42:56.839748 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:56.839718 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2m594"] Jun 02 04:42:56.839916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:56.839841 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:56.839959 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:56.839922 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:56.844925 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:56.844903 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pq546"] Jun 02 04:42:56.845051 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:56.845014 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:56.845129 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:56.845116 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:56.847346 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:56.847320 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2t6x7"] Jun 02 04:42:56.847457 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:56.847420 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:56.847510 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:56.847494 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:57.129081 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:57.129000 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:42:57.129527 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:57.129332 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" event={"ID":"5076649b-86c8-4e4a-b653-181e816bccef","Type":"ContainerStarted","Data":"3383df317b908da9bdf4399be98eea12a9329b5638277be7e9fcb46e4fc3d19a"} Jun 02 04:42:57.130946 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:57.130923 2582 generic.go:358] "Generic (PLEG): container finished" podID="d77b1c01-cd50-4802-a942-c501a8880df0" containerID="68cb022dcf4fc61fd8460787201bcac18c090c9574a80857cbdf4d6b4955fcb5" exitCode=0 Jun 02 04:42:57.131043 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:57.130969 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" event={"ID":"d77b1c01-cd50-4802-a942-c501a8880df0","Type":"ContainerDied","Data":"68cb022dcf4fc61fd8460787201bcac18c090c9574a80857cbdf4d6b4955fcb5"} Jun 02 04:42:57.158861 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:57.158803 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" podStartSLOduration=9.97092715 podStartE2EDuration="28.158791615s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:42:31.730099799 +0000 UTC m=+3.278092626" lastFinishedPulling="2026-06-02 04:42:49.917964274 +0000 UTC m=+21.465957091" observedRunningTime="2026-06-02 04:42:57.158606699 +0000 UTC m=+28.706599533" watchObservedRunningTime="2026-06-02 04:42:57.158791615 +0000 UTC m=+28.706784450" Jun 02 04:42:58.004107 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:58.003932 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:42:58.004232 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:58.004185 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:42:58.134567 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:58.134488 2582 generic.go:358] "Generic (PLEG): container finished" podID="d77b1c01-cd50-4802-a942-c501a8880df0" containerID="e6568cae2a951a61c68cf8f6f4e964199d7d542d5893187b94f72b67343a7394" exitCode=0 Jun 02 04:42:58.134567 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:58.134555 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" event={"ID":"d77b1c01-cd50-4802-a942-c501a8880df0","Type":"ContainerDied","Data":"e6568cae2a951a61c68cf8f6f4e964199d7d542d5893187b94f72b67343a7394"} Jun 02 04:42:59.005317 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:59.004621 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:42:59.005317 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:59.004719 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:42:59.005317 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:59.004889 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:42:59.005317 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:42:59.005004 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:42:59.138520 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:59.138483 2582 generic.go:358] "Generic (PLEG): container finished" podID="d77b1c01-cd50-4802-a942-c501a8880df0" containerID="9ece0fa5ccd3c5930800dd34382ff74cfc7e3f3a6346fd117bd9af8e1db9aa8b" exitCode=0 Jun 02 04:42:59.138867 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:42:59.138532 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" event={"ID":"d77b1c01-cd50-4802-a942-c501a8880df0","Type":"ContainerDied","Data":"9ece0fa5ccd3c5930800dd34382ff74cfc7e3f3a6346fd117bd9af8e1db9aa8b"} Jun 02 04:43:00.003910 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:00.003868 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:43:00.004112 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:00.003984 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:43:01.003798 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:01.003768 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:43:01.004635 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:01.003898 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2m594" podUID="3763f76e-013e-41e6-ba3b-ab56495228b7" Jun 02 04:43:01.004635 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:01.003975 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:43:01.004635 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:01.004075 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:43:02.004120 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.004080 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:43:02.004524 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.004198 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t6x7" podUID="14408def-e3d2-4108-b7c6-492f054ad6ea" Jun 02 04:43:02.680299 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.680235 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:43:02.680497 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.680415 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:43:02.680497 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.680492 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:43:34.680475595 +0000 UTC m=+66.228468408 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 04:43:02.729736 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.729699 2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-50.ec2.internal" event="NodeReady" Jun 02 04:43:02.729949 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.729860 2582 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 04:43:02.781366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.781320 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:43:02.781519 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.781468 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 04:43:02.781519 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.781488 2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 04:43:02.781519 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.781500 2582 projected.go:194] Error preparing data for projected volume kube-api-access-zkkbv for pod openshift-network-diagnostics/network-check-target-2m594: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:43:02.781692 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.781566 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv podName:3763f76e-013e-41e6-ba3b-ab56495228b7 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:34.781547461 +0000 UTC m=+66.329540275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkkbv" (UniqueName: "kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv") pod "network-check-target-2m594" (UID: "3763f76e-013e-41e6-ba3b-ab56495228b7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 04:43:02.784170 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.784004 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-847b749778-p68nz"] Jun 02 04:43:02.786001 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.785979 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.788122 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.788102 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 04:43:02.788254 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.788102 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 04:43:02.788670 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.788647 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 04:43:02.788946 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.788931 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4vpfz\"" Jun 02 04:43:02.792720 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.791301 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm"] Jun 02 04:43:02.793821 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.793797 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:02.797375 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.797349 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 04:43:02.797792 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.797766 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 04:43:02.798406 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.798383 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-skk6k\"" Jun 02 04:43:02.798498 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.798419 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 04:43:02.809499 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.809465 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fg8d6"] Jun 02 04:43:02.812146 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.812125 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-847b749778-p68nz"] Jun 02 04:43:02.812264 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.812150 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm"] Jun 02 04:43:02.812264 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.812166 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n9q5d"] Jun 02 04:43:02.812365 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.812296 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:02.814226 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.814208 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:02.817558 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.817539 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 04:43:02.817558 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.817548 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 04:43:02.817726 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.817718 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 04:43:02.817783 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.817770 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 04:43:02.817962 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.817943 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l292j\"" Jun 02 04:43:02.818076 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.818027 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 04:43:02.820464 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.820430 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s8w52\"" Jun 02 04:43:02.825125 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.825106 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n9q5d"] Jun 02 04:43:02.839878 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.839799 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fg8d6"] Jun 02 04:43:02.881789 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.881757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-certificates\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.881986 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.881811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-trusted-ca\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.881986 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.881886 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e126c07-8905-4d3d-b2f5-00616074853a-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:02.881986 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.881905 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7hq\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-kube-api-access-nx7hq\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.882147 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.881989 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-installation-pull-secrets\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.882147 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.882024 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-image-registry-private-configuration\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.882147 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.882052 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14a94fc-c798-4f5a-813a-9004c00c0fdf-ca-trust-extracted\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.882147 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.882101 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:02.882147 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.882122 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.882147 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.882136 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-bound-sa-token\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.982527 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982489 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e126c07-8905-4d3d-b2f5-00616074853a-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:02.982711 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982536 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7hq\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-kube-api-access-nx7hq\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.982711 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982570 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq56h\" (UniqueName: \"kubernetes.io/projected/fa57166d-8b60-43e2-a03c-69ed60cc8e73-kube-api-access-lq56h\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:02.982711 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-tmp-dir\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:02.982711 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982615 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-installation-pull-secrets\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.982711 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982648 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-image-registry-private-configuration\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.982711 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982677 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14a94fc-c798-4f5a-813a-9004c00c0fdf-ca-trust-extracted\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982715 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982736 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982753 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-bound-sa-token\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982795 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-config-volume\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982817 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v2nz\" (UniqueName: \"kubernetes.io/projected/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-kube-api-access-7v2nz\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982870 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-certificates\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982892 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:02.983035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.982944 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-trusted-ca\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.983578 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.983344 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:43:02.983699 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.983389 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0e126c07-8905-4d3d-b2f5-00616074853a-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:02.983699 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.983439 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14a94fc-c798-4f5a-813a-9004c00c0fdf-ca-trust-extracted\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.983699 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.983470 2582 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:43:02.983699 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.983654 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:43:03.483631734 +0000 UTC m=+35.031624565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:43:02.983699 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.983655 2582 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-847b749778-p68nz: secret "image-registry-tls" not found Jun 02 04:43:02.983959 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:02.983710 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls podName:c14a94fc-c798-4f5a-813a-9004c00c0fdf nodeName:}" failed. No retries permitted until 2026-06-02 04:43:03.483697359 +0000 UTC m=+35.031690172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls") pod "image-registry-847b749778-p68nz" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf") : secret "image-registry-tls" not found Jun 02 04:43:02.983959 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.983810 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-certificates\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.983959 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.983925 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-trusted-ca\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.987446 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.987425 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-image-registry-private-configuration\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.987770 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.987755 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-installation-pull-secrets\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.992619 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.992600 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7hq\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-kube-api-access-nx7hq\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:02.993130 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:02.993110 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-bound-sa-token\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:03.004092 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.004064 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:43:03.004656 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.004266 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:43:03.007041 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.006777 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qgskw\"" Jun 02 04:43:03.007041 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.006849 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 04:43:03.007041 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.006781 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 04:43:03.007041 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.006778 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2ckqz\"" Jun 02 04:43:03.007041 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.006973 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 04:43:03.083666 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.083633 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:03.083892 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.083703 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lq56h\" (UniqueName: \"kubernetes.io/projected/fa57166d-8b60-43e2-a03c-69ed60cc8e73-kube-api-access-lq56h\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:03.083892 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.083727 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-tmp-dir\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:03.083892 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.083788 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:03.083892 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.083870 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert podName:fa57166d-8b60-43e2-a03c-69ed60cc8e73 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:03.583852034 +0000 UTC m=+35.131844848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert") pod "ingress-canary-n9q5d" (UID: "fa57166d-8b60-43e2-a03c-69ed60cc8e73") : secret "canary-serving-cert" not found Jun 02 04:43:03.084069 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.083905 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:03.084069 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.083956 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls podName:1b4f34f7-87d4-4e3d-8b16-c6b4565b2525 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:03.583941018 +0000 UTC m=+35.131933847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls") pod "dns-default-fg8d6" (UID: "1b4f34f7-87d4-4e3d-8b16-c6b4565b2525") : secret "dns-default-metrics-tls" not found Jun 02 04:43:03.084069 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.083795 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:03.084212 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.084107 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-config-volume\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:03.084212 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.084132 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v2nz\" (UniqueName: \"kubernetes.io/projected/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-kube-api-access-7v2nz\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:03.084447 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.084429 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-tmp-dir\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:03.084859 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.084811 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-config-volume\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:03.099761 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.099669 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq56h\" (UniqueName: \"kubernetes.io/projected/fa57166d-8b60-43e2-a03c-69ed60cc8e73-kube-api-access-lq56h\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:03.100506 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.100482 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v2nz\" (UniqueName: \"kubernetes.io/projected/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-kube-api-access-7v2nz\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:03.488789 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.488694 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:03.488789 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.488766 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:03.489011 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.488959 2582 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:43:03.489011 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.488972 2582 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-847b749778-p68nz: secret "image-registry-tls" not found Jun 02 04:43:03.489076 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.489017 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls podName:c14a94fc-c798-4f5a-813a-9004c00c0fdf nodeName:}" failed. No retries permitted until 2026-06-02 04:43:04.489003607 +0000 UTC m=+36.036996420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls") pod "image-registry-847b749778-p68nz" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf") : secret "image-registry-tls" not found Jun 02 04:43:03.489428 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.489406 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:43:03.489567 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.489475 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:43:04.4894559 +0000 UTC m=+36.037448714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:43:03.589545 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.589502 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:03.589730 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:03.589586 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:03.589730 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.589644 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:03.589730 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.589716 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:03.589877 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.589767 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls podName:1b4f34f7-87d4-4e3d-8b16-c6b4565b2525 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:04.589741898 +0000 UTC m=+36.137734722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls") pod "dns-default-fg8d6" (UID: "1b4f34f7-87d4-4e3d-8b16-c6b4565b2525") : secret "dns-default-metrics-tls" not found Jun 02 04:43:03.589877 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:03.589788 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert podName:fa57166d-8b60-43e2-a03c-69ed60cc8e73 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:04.589777147 +0000 UTC m=+36.137769961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert") pod "ingress-canary-n9q5d" (UID: "fa57166d-8b60-43e2-a03c-69ed60cc8e73") : secret "canary-serving-cert" not found Jun 02 04:43:04.003769 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.003736 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:43:04.006643 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.006617 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 04:43:04.497912 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.497873 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:04.497912 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.497916 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:04.498148 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.498057 2582 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:43:04.498148 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.498062 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:43:04.498238 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.498150 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.498128318 +0000 UTC m=+38.046121147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:43:04.498238 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.498071 2582 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-847b749778-p68nz: secret "image-registry-tls" not found Jun 02 04:43:04.498315 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.498248 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls podName:c14a94fc-c798-4f5a-813a-9004c00c0fdf nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.498230638 +0000 UTC m=+38.046223456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls") pod "image-registry-847b749778-p68nz" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf") : secret "image-registry-tls" not found Jun 02 04:43:04.598695 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.598650 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:04.598898 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.598730 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:04.598898 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.598759 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:04.598898 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.598847 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls podName:1b4f34f7-87d4-4e3d-8b16-c6b4565b2525 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.598815215 +0000 UTC m=+38.146808029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls") pod "dns-default-fg8d6" (UID: "1b4f34f7-87d4-4e3d-8b16-c6b4565b2525") : secret "dns-default-metrics-tls" not found Jun 02 04:43:04.599057 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.598929 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:04.599057 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:04.599004 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert podName:fa57166d-8b60-43e2-a03c-69ed60cc8e73 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:06.598987543 +0000 UTC m=+38.146980363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert") pod "ingress-canary-n9q5d" (UID: "fa57166d-8b60-43e2-a03c-69ed60cc8e73") : secret "canary-serving-cert" not found Jun 02 04:43:04.901430 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.901389 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:43:04.903692 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.903674 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14408def-e3d2-4108-b7c6-492f054ad6ea-original-pull-secret\") pod \"global-pull-secret-syncer-2t6x7\" (UID: \"14408def-e3d2-4108-b7c6-492f054ad6ea\") " pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:43:04.915878 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:04.915855 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t6x7" Jun 02 04:43:05.167429 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:05.167355 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2t6x7"] Jun 02 04:43:05.215520 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:43:05.215489 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14408def_e3d2_4108_b7c6_492f054ad6ea.slice/crio-f9db3630832aba07801ba7ba2fbeac0443737e1235529184945066b314417f73 WatchSource:0}: Error finding container f9db3630832aba07801ba7ba2fbeac0443737e1235529184945066b314417f73: Status 404 returned error can't find the container with id f9db3630832aba07801ba7ba2fbeac0443737e1235529184945066b314417f73 Jun 02 04:43:06.154795 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:06.154618 2582 generic.go:358] "Generic (PLEG): container finished" podID="d77b1c01-cd50-4802-a942-c501a8880df0" containerID="c79f4b16e28d03263a095c505d2718304ac743e1bcb54d8adb7863cd6f02e042" exitCode=0 Jun 02 04:43:06.154990 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:06.154697 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" event={"ID":"d77b1c01-cd50-4802-a942-c501a8880df0","Type":"ContainerDied","Data":"c79f4b16e28d03263a095c505d2718304ac743e1bcb54d8adb7863cd6f02e042"} Jun 02 04:43:06.155930 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:06.155910 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2t6x7" event={"ID":"14408def-e3d2-4108-b7c6-492f054ad6ea","Type":"ContainerStarted","Data":"f9db3630832aba07801ba7ba2fbeac0443737e1235529184945066b314417f73"} Jun 02 04:43:06.515442 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:06.515353 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:06.515442 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:06.515402 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:06.516010 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.515513 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:43:06.516010 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.515571 2582 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:43:06.516010 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.515589 2582 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-847b749778-p68nz: secret "image-registry-tls" not found Jun 02 04:43:06.516010 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.515601 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:43:10.515578738 +0000 UTC m=+42.063571570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:43:06.516010 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.515643 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls podName:c14a94fc-c798-4f5a-813a-9004c00c0fdf nodeName:}" failed. No retries permitted until 2026-06-02 04:43:10.515626395 +0000 UTC m=+42.063619208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls") pod "image-registry-847b749778-p68nz" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf") : secret "image-registry-tls" not found Jun 02 04:43:06.616595 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:06.616556 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:06.616806 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:06.616646 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:06.616806 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.616721 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:06.616806 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.616779 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:06.616806 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.616793 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls podName:1b4f34f7-87d4-4e3d-8b16-c6b4565b2525 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:10.616772694 +0000 UTC m=+42.164765526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls") pod "dns-default-fg8d6" (UID: "1b4f34f7-87d4-4e3d-8b16-c6b4565b2525") : secret "dns-default-metrics-tls" not found Jun 02 04:43:06.617012 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:06.616848 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert podName:fa57166d-8b60-43e2-a03c-69ed60cc8e73 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:10.616814357 +0000 UTC m=+42.164807174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert") pod "ingress-canary-n9q5d" (UID: "fa57166d-8b60-43e2-a03c-69ed60cc8e73") : secret "canary-serving-cert" not found Jun 02 04:43:07.160994 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:07.160965 2582 generic.go:358] "Generic (PLEG): container finished" podID="d77b1c01-cd50-4802-a942-c501a8880df0" containerID="a842dab6ac8a8fea4f54d6d8efc995c4d2784b6e3b6326b1880736ee5dc78533" exitCode=0 Jun 02 04:43:07.161187 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:07.161022 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" event={"ID":"d77b1c01-cd50-4802-a942-c501a8880df0","Type":"ContainerDied","Data":"a842dab6ac8a8fea4f54d6d8efc995c4d2784b6e3b6326b1880736ee5dc78533"} Jun 02 04:43:08.165523 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:08.165487 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" event={"ID":"d77b1c01-cd50-4802-a942-c501a8880df0","Type":"ContainerStarted","Data":"d73cf98a5d08865e85b34b4f8c397c155f4d7ce4350e7a4fea19625bc4b5cfe1"} Jun 02 04:43:08.189326 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:08.189241 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xr6nk" podStartSLOduration=5.64955651 podStartE2EDuration="39.189223704s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:42:31.705815654 +0000 UTC m=+3.253808473" lastFinishedPulling="2026-06-02 04:43:05.245482854 +0000 UTC m=+36.793475667" observedRunningTime="2026-06-02 04:43:08.189174419 +0000 UTC m=+39.737167271" watchObservedRunningTime="2026-06-02 04:43:08.189223704 +0000 UTC m=+39.737216540" Jun 02 04:43:10.171557 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:10.171450 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2t6x7" event={"ID":"14408def-e3d2-4108-b7c6-492f054ad6ea","Type":"ContainerStarted","Data":"fe5a2c1973aa8be0f7c7c6aefd2b0a4000ecf2722532844f055eb48a3c8db511"} Jun 02 04:43:10.189212 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:10.189131 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2t6x7" podStartSLOduration=33.51882043 podStartE2EDuration="38.189117386s" podCreationTimestamp="2026-06-02 04:42:32 +0000 UTC" firstStartedPulling="2026-06-02 04:43:05.222177632 +0000 UTC m=+36.770170445" lastFinishedPulling="2026-06-02 04:43:09.892474588 +0000 UTC m=+41.440467401" observedRunningTime="2026-06-02 04:43:10.188792019 +0000 UTC m=+41.736784887" watchObservedRunningTime="2026-06-02 04:43:10.189117386 +0000 UTC m=+41.737110202" Jun 02 04:43:10.549009 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:10.548923 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:10.549009 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:10.548964 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:10.549182 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.549098 2582 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:43:10.549182 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.549097 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:43:10.549182 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.549111 2582 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-847b749778-p68nz: secret "image-registry-tls" not found Jun 02 04:43:10.549182 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.549167 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls podName:c14a94fc-c798-4f5a-813a-9004c00c0fdf nodeName:}" failed. No retries permitted until 2026-06-02 04:43:18.549154673 +0000 UTC m=+50.097147486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls") pod "image-registry-847b749778-p68nz" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf") : secret "image-registry-tls" not found Jun 02 04:43:10.549182 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.549180 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:43:18.549174293 +0000 UTC m=+50.097167106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:43:10.649786 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:10.649750 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:10.649963 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:10.649806 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:10.649963 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.649908 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:10.649963 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.649915 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:10.649963 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.649960 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert podName:fa57166d-8b60-43e2-a03c-69ed60cc8e73 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:18.649947088 +0000 UTC m=+50.197939901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert") pod "ingress-canary-n9q5d" (UID: "fa57166d-8b60-43e2-a03c-69ed60cc8e73") : secret "canary-serving-cert" not found Jun 02 04:43:10.650097 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:10.649974 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls podName:1b4f34f7-87d4-4e3d-8b16-c6b4565b2525 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:18.649967606 +0000 UTC m=+50.197960419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls") pod "dns-default-fg8d6" (UID: "1b4f34f7-87d4-4e3d-8b16-c6b4565b2525") : secret "dns-default-metrics-tls" not found Jun 02 04:43:18.613113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:18.613070 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:18.613113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:18.613111 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:18.613518 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.613215 2582 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:43:18.613518 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.613218 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:43:18.613518 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.613284 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:43:34.613269138 +0000 UTC m=+66.161261952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:43:18.613518 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.613228 2582 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-847b749778-p68nz: secret "image-registry-tls" not found Jun 02 04:43:18.613518 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.613352 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls podName:c14a94fc-c798-4f5a-813a-9004c00c0fdf nodeName:}" failed. No retries permitted until 2026-06-02 04:43:34.613339958 +0000 UTC m=+66.161332772 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls") pod "image-registry-847b749778-p68nz" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf") : secret "image-registry-tls" not found Jun 02 04:43:18.714055 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:18.714016 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:18.714227 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:18.714086 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:18.714227 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.714179 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:18.714332 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.714228 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:18.714332 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.714245 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls podName:1b4f34f7-87d4-4e3d-8b16-c6b4565b2525 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:34.71422804 +0000 UTC m=+66.262220852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls") pod "dns-default-fg8d6" (UID: "1b4f34f7-87d4-4e3d-8b16-c6b4565b2525") : secret "dns-default-metrics-tls" not found Jun 02 04:43:18.714332 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:18.714278 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert podName:fa57166d-8b60-43e2-a03c-69ed60cc8e73 nodeName:}" failed. No retries permitted until 2026-06-02 04:43:34.714262626 +0000 UTC m=+66.262255439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert") pod "ingress-canary-n9q5d" (UID: "fa57166d-8b60-43e2-a03c-69ed60cc8e73") : secret "canary-serving-cert" not found Jun 02 04:43:28.145665 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:28.145639 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dgf7w" Jun 02 04:43:34.633972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.633929 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:43:34.633972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.633973 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:43:34.634482 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.634085 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:43:34.634482 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.634094 2582 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:43:34.634482 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.634110 2582 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-847b749778-p68nz: secret "image-registry-tls" not found Jun 02 04:43:34.634482 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.634159 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls podName:c14a94fc-c798-4f5a-813a-9004c00c0fdf nodeName:}" failed. No retries permitted until 2026-06-02 04:44:06.634144498 +0000 UTC m=+98.182137311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls") pod "image-registry-847b749778-p68nz" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf") : secret "image-registry-tls" not found Jun 02 04:43:34.634482 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.634179 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:44:06.634172727 +0000 UTC m=+98.182165540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:43:34.734612 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.734575 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:43:34.734612 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.734615 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:43:34.734813 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.734638 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:43:34.734813 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.734726 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:43:34.734813 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.734736 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:43:34.734813 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.734786 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert podName:fa57166d-8b60-43e2-a03c-69ed60cc8e73 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:06.73476729 +0000 UTC m=+98.282760118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert") pod "ingress-canary-n9q5d" (UID: "fa57166d-8b60-43e2-a03c-69ed60cc8e73") : secret "canary-serving-cert" not found Jun 02 04:43:34.734987 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.734844 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls podName:1b4f34f7-87d4-4e3d-8b16-c6b4565b2525 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:06.734810798 +0000 UTC m=+98.282803612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls") pod "dns-default-fg8d6" (UID: "1b4f34f7-87d4-4e3d-8b16-c6b4565b2525") : secret "dns-default-metrics-tls" not found Jun 02 04:43:34.737356 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.737339 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 04:43:34.745047 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.745033 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 04:43:34.745102 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:43:34.745088 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:44:38.745074897 +0000 UTC m=+130.293067709 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : secret "metrics-daemon-secret" not found Jun 02 04:43:34.835803 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.835765 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:43:34.838711 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.838692 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 04:43:34.849542 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.849520 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 04:43:34.861274 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:34.861242 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkkbv\" (UniqueName: \"kubernetes.io/projected/3763f76e-013e-41e6-ba3b-ab56495228b7-kube-api-access-zkkbv\") pod \"network-check-target-2m594\" (UID: \"3763f76e-013e-41e6-ba3b-ab56495228b7\") " pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:43:35.125399 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:35.125370 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qgskw\"" Jun 02 04:43:35.132845 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:35.132795 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:43:35.261284 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:35.261254 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2m594"] Jun 02 04:43:35.264736 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:43:35.264701 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3763f76e_013e_41e6_ba3b_ab56495228b7.slice/crio-787a857ab57553573f8f0b0748861cb1bbae092a5198e9abbc86d2cb9bc976e6 WatchSource:0}: Error finding container 787a857ab57553573f8f0b0748861cb1bbae092a5198e9abbc86d2cb9bc976e6: Status 404 returned error can't find the container with id 787a857ab57553573f8f0b0748861cb1bbae092a5198e9abbc86d2cb9bc976e6 Jun 02 04:43:36.223240 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:36.223202 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2m594" event={"ID":"3763f76e-013e-41e6-ba3b-ab56495228b7","Type":"ContainerStarted","Data":"787a857ab57553573f8f0b0748861cb1bbae092a5198e9abbc86d2cb9bc976e6"} Jun 02 04:43:38.228266 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:38.228230 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2m594" event={"ID":"3763f76e-013e-41e6-ba3b-ab56495228b7","Type":"ContainerStarted","Data":"47b7ba9ecd78e37f06c68655b98fba61138d3b626223db94b337f1efe958fed8"} Jun 02 04:43:38.228635 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:38.228364 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:43:38.245437 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:43:38.245390 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2m594" podStartSLOduration=66.416209202 podStartE2EDuration="1m9.245377694s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:43:35.266474309 +0000 UTC m=+66.814467122" lastFinishedPulling="2026-06-02 04:43:38.095642797 +0000 UTC m=+69.643635614" observedRunningTime="2026-06-02 04:43:38.24424524 +0000 UTC m=+69.792238075" watchObservedRunningTime="2026-06-02 04:43:38.245377694 +0000 UTC m=+69.793370523" Jun 02 04:44:06.668294 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:06.668173 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:44:06.668294 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:06.668235 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:44:06.668774 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.668332 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:44:06.668774 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.668354 2582 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 04:44:06.668774 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.668371 2582 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-847b749778-p68nz: secret "image-registry-tls" not found Jun 02 04:44:06.668774 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.668413 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:45:10.668396404 +0000 UTC m=+162.216389217 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:44:06.668774 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.668429 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls podName:c14a94fc-c798-4f5a-813a-9004c00c0fdf nodeName:}" failed. No retries permitted until 2026-06-02 04:45:10.668422643 +0000 UTC m=+162.216415457 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls") pod "image-registry-847b749778-p68nz" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf") : secret "image-registry-tls" not found Jun 02 04:44:06.769090 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:06.769043 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:44:06.769217 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:06.769142 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:44:06.769217 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.769194 2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 04:44:06.769285 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.769223 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 04:44:06.769285 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.769269 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls podName:1b4f34f7-87d4-4e3d-8b16-c6b4565b2525 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:10.769255689 +0000 UTC m=+162.317248502 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls") pod "dns-default-fg8d6" (UID: "1b4f34f7-87d4-4e3d-8b16-c6b4565b2525") : secret "dns-default-metrics-tls" not found Jun 02 04:44:06.769285 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:06.769281 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert podName:fa57166d-8b60-43e2-a03c-69ed60cc8e73 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:10.769275381 +0000 UTC m=+162.317268194 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert") pod "ingress-canary-n9q5d" (UID: "fa57166d-8b60-43e2-a03c-69ed60cc8e73") : secret "canary-serving-cert" not found Jun 02 04:44:09.232733 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:09.232700 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2m594" Jun 02 04:44:38.809338 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:38.809298 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:44:38.809806 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:38.809446 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 04:44:38.809806 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:38.809512 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs podName:401fe11a-e1ab-48a1-9211-60714444024a nodeName:}" failed. No retries permitted until 2026-06-02 04:46:40.809496112 +0000 UTC m=+252.357488926 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs") pod "network-metrics-daemon-pq546" (UID: "401fe11a-e1ab-48a1-9211-60714444024a") : secret "metrics-daemon-secret" not found Jun 02 04:44:52.579361 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.579281 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v"] Jun 02 04:44:52.582024 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.582006 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-8sb54"] Jun 02 04:44:52.582315 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.582184 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.585628 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.585598 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 04:44:52.586600 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.586574 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 04:44:52.586721 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.586611 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d7d4l\"" Jun 02 04:44:52.586721 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.586611 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 04:44:52.586820 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.586613 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 04:44:52.587335 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.587314 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.589183 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.589164 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 04:44:52.589183 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.589173 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rwchj\"" Jun 02 04:44:52.589506 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.589484 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 04:44:52.589614 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.589537 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 04:44:52.589814 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.589799 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 04:44:52.592805 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.592784 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v"] Jun 02 04:44:52.595097 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.595077 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-8sb54"] Jun 02 04:44:52.595962 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.595937 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 04:44:52.604163 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9180170-1e56-4a59-a093-3e766feb6289-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.604283 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604166 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7726b5ba-197e-4879-baee-9bbaf52ec489-serving-cert\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.604283 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604192 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.604283 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604260 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5frt4\" (UniqueName: \"kubernetes.io/projected/c9180170-1e56-4a59-a093-3e766feb6289-kube-api-access-5frt4\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.604417 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604319 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7726b5ba-197e-4879-baee-9bbaf52ec489-snapshots\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.604417 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604346 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7726b5ba-197e-4879-baee-9bbaf52ec489-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.604417 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604379 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7726b5ba-197e-4879-baee-9bbaf52ec489-service-ca-bundle\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.604522 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604422 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7726b5ba-197e-4879-baee-9bbaf52ec489-tmp\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.604522 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.604445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jmb\" (UniqueName: \"kubernetes.io/projected/7726b5ba-197e-4879-baee-9bbaf52ec489-kube-api-access-98jmb\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.677693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.677663 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz"] Jun 02 04:44:52.680554 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.680537 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz" Jun 02 04:44:52.682943 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.682916 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:44:52.683055 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.682922 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-w6qsq\"" Jun 02 04:44:52.684188 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.684169 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 04:44:52.687997 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.687978 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-drtb2"] Jun 02 04:44:52.690673 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.690659 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.693652 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.693635 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:44:52.693742 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.693680 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 04:44:52.694747 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.694728 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz"] Jun 02 04:44:52.694921 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.694906 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 04:44:52.696877 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.696853 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8p57c\"" Jun 02 04:44:52.697628 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.697605 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 04:44:52.699782 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.699764 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 04:44:52.705251 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705231 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.705346 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705268 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5frt4\" (UniqueName: \"kubernetes.io/projected/c9180170-1e56-4a59-a093-3e766feb6289-kube-api-access-5frt4\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.705346 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705299 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7726b5ba-197e-4879-baee-9bbaf52ec489-snapshots\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.705346 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705333 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98jmb\" (UniqueName: \"kubernetes.io/projected/7726b5ba-197e-4879-baee-9bbaf52ec489-kube-api-access-98jmb\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.705509 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-serving-cert\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.705509 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:52.705385 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 04:44:52.705509 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705396 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzxj\" (UniqueName: \"kubernetes.io/projected/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-kube-api-access-tqzxj\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.705509 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:52.705444 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls podName:c9180170-1e56-4a59-a093-3e766feb6289 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:53.205424153 +0000 UTC m=+144.753416980 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kn98v" (UID: "c9180170-1e56-4a59-a093-3e766feb6289") : secret "cluster-monitoring-operator-tls" not found Jun 02 04:44:52.705651 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705549 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7726b5ba-197e-4879-baee-9bbaf52ec489-tmp\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.705651 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705588 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7726b5ba-197e-4879-baee-9bbaf52ec489-service-ca-bundle\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.705651 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705618 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7726b5ba-197e-4879-baee-9bbaf52ec489-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.705651 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705643 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-trusted-ca\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.705767 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705689 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-config\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.705767 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705723 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9180170-1e56-4a59-a093-3e766feb6289-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.705767 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705753 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7726b5ba-197e-4879-baee-9bbaf52ec489-serving-cert\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.705881 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705783 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjfq\" (UniqueName: \"kubernetes.io/projected/271c680b-a894-4ed2-98ac-8d1d5c876790-kube-api-access-wcjfq\") pod \"volume-data-source-validator-7598fd5bd-lpgdz\" (UID: \"271c680b-a894-4ed2-98ac-8d1d5c876790\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz" Jun 02 04:44:52.705881 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705871 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7726b5ba-197e-4879-baee-9bbaf52ec489-tmp\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.705944 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.705914 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7726b5ba-197e-4879-baee-9bbaf52ec489-snapshots\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.706398 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.706378 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7726b5ba-197e-4879-baee-9bbaf52ec489-service-ca-bundle\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.706457 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.706441 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c9180170-1e56-4a59-a093-3e766feb6289-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.706531 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.706515 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7726b5ba-197e-4879-baee-9bbaf52ec489-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.708851 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.708806 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7726b5ba-197e-4879-baee-9bbaf52ec489-serving-cert\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.710444 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.710422 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-drtb2"] Jun 02 04:44:52.734320 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.734293 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jmb\" (UniqueName: \"kubernetes.io/projected/7726b5ba-197e-4879-baee-9bbaf52ec489-kube-api-access-98jmb\") pod \"insights-operator-788bf58df5-8sb54\" (UID: \"7726b5ba-197e-4879-baee-9bbaf52ec489\") " pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.734515 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.734497 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5frt4\" (UniqueName: \"kubernetes.io/projected/c9180170-1e56-4a59-a093-3e766feb6289-kube-api-access-5frt4\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:52.782574 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.782541 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m"] Jun 02 04:44:52.786652 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.786633 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:52.788891 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.788863 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 04:44:52.788891 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.788878 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:44:52.788891 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.788887 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rfvm7\"" Jun 02 04:44:52.789085 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.788923 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 04:44:52.797173 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.797153 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m"] Jun 02 04:44:52.806776 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.806753 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-trusted-ca\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.806916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.806794 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-config\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.806916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.806815 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:52.806916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.806868 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjfq\" (UniqueName: \"kubernetes.io/projected/271c680b-a894-4ed2-98ac-8d1d5c876790-kube-api-access-wcjfq\") pod \"volume-data-source-validator-7598fd5bd-lpgdz\" (UID: \"271c680b-a894-4ed2-98ac-8d1d5c876790\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz" Jun 02 04:44:52.806916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.806911 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-serving-cert\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.807113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.806967 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzxj\" (UniqueName: \"kubernetes.io/projected/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-kube-api-access-tqzxj\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.807113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.807012 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwrs\" (UniqueName: \"kubernetes.io/projected/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-kube-api-access-mvwrs\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:52.809267 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.808223 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-trusted-ca\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.809436 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.809415 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-config\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.810182 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.810156 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-serving-cert\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.815373 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.815337 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzxj\" (UniqueName: \"kubernetes.io/projected/ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d-kube-api-access-tqzxj\") pod \"console-operator-86d7c6cc77-drtb2\" (UID: \"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d\") " pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:52.815460 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.815436 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjfq\" (UniqueName: \"kubernetes.io/projected/271c680b-a894-4ed2-98ac-8d1d5c876790-kube-api-access-wcjfq\") pod \"volume-data-source-validator-7598fd5bd-lpgdz\" (UID: \"271c680b-a894-4ed2-98ac-8d1d5c876790\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz" Jun 02 04:44:52.900794 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.900681 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-8sb54" Jun 02 04:44:52.907779 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.907756 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:52.907892 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.907876 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwrs\" (UniqueName: \"kubernetes.io/projected/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-kube-api-access-mvwrs\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:52.907953 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:52.907914 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 04:44:52.907993 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:52.907983 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls podName:93e7ae8c-2223-456b-a90f-ae1808b3cd2e nodeName:}" failed. No retries permitted until 2026-06-02 04:44:53.407966849 +0000 UTC m=+144.955959663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-2lw7m" (UID: "93e7ae8c-2223-456b-a90f-ae1808b3cd2e") : secret "samples-operator-tls" not found Jun 02 04:44:52.926198 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.926170 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwrs\" (UniqueName: \"kubernetes.io/projected/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-kube-api-access-mvwrs\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:52.989539 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:52.989502 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz" Jun 02 04:44:53.001630 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.001598 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:44:53.027197 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.027161 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-8sb54"] Jun 02 04:44:53.031258 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:44:53.031232 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7726b5ba_197e_4879_baee_9bbaf52ec489.slice/crio-f90489e2e0a8c5223ff6eba4ac0c998e4f231ae977773a42e2724f91fa38b2e9 WatchSource:0}: Error finding container f90489e2e0a8c5223ff6eba4ac0c998e4f231ae977773a42e2724f91fa38b2e9: Status 404 returned error can't find the container with id f90489e2e0a8c5223ff6eba4ac0c998e4f231ae977773a42e2724f91fa38b2e9 Jun 02 04:44:53.122465 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.122435 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz"] Jun 02 04:44:53.125973 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:44:53.125932 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271c680b_a894_4ed2_98ac_8d1d5c876790.slice/crio-04a03e137d89ae69d36b8492daf99d5531c571790f130dde8d83419f71be3983 WatchSource:0}: Error finding container 04a03e137d89ae69d36b8492daf99d5531c571790f130dde8d83419f71be3983: Status 404 returned error can't find the container with id 04a03e137d89ae69d36b8492daf99d5531c571790f130dde8d83419f71be3983 Jun 02 04:44:53.136897 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.136873 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-drtb2"] Jun 02 04:44:53.139555 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:44:53.139531 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9b0d9b_8e87_402f_b1d0_4b9df9cc870d.slice/crio-b7dfdd059d1bb85955e30df786526afca5e476f103e091248151620f40262440 WatchSource:0}: Error finding container b7dfdd059d1bb85955e30df786526afca5e476f103e091248151620f40262440: Status 404 returned error can't find the container with id b7dfdd059d1bb85955e30df786526afca5e476f103e091248151620f40262440 Jun 02 04:44:53.210396 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.210315 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:53.210527 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:53.210438 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 04:44:53.210527 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:53.210492 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls podName:c9180170-1e56-4a59-a093-3e766feb6289 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:54.210478119 +0000 UTC m=+145.758470931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kn98v" (UID: "c9180170-1e56-4a59-a093-3e766feb6289") : secret "cluster-monitoring-operator-tls" not found Jun 02 04:44:53.378958 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.378911 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz" event={"ID":"271c680b-a894-4ed2-98ac-8d1d5c876790","Type":"ContainerStarted","Data":"04a03e137d89ae69d36b8492daf99d5531c571790f130dde8d83419f71be3983"} Jun 02 04:44:53.380060 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.380034 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-8sb54" event={"ID":"7726b5ba-197e-4879-baee-9bbaf52ec489","Type":"ContainerStarted","Data":"f90489e2e0a8c5223ff6eba4ac0c998e4f231ae977773a42e2724f91fa38b2e9"} Jun 02 04:44:53.380988 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.380961 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" event={"ID":"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d","Type":"ContainerStarted","Data":"b7dfdd059d1bb85955e30df786526afca5e476f103e091248151620f40262440"} Jun 02 04:44:53.411658 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:53.411629 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:53.411749 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:53.411739 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 04:44:53.411798 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:53.411789 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls podName:93e7ae8c-2223-456b-a90f-ae1808b3cd2e nodeName:}" failed. No retries permitted until 2026-06-02 04:44:54.411776143 +0000 UTC m=+145.959768956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-2lw7m" (UID: "93e7ae8c-2223-456b-a90f-ae1808b3cd2e") : secret "samples-operator-tls" not found Jun 02 04:44:54.219664 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:54.219617 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:54.220163 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:54.219806 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 04:44:54.220163 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:54.219895 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls podName:c9180170-1e56-4a59-a093-3e766feb6289 nodeName:}" failed. No retries permitted until 2026-06-02 04:44:56.219875099 +0000 UTC m=+147.767867917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kn98v" (UID: "c9180170-1e56-4a59-a093-3e766feb6289") : secret "cluster-monitoring-operator-tls" not found Jun 02 04:44:54.421058 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:54.421014 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:54.421276 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:54.421238 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 04:44:54.421353 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:54.421302 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls podName:93e7ae8c-2223-456b-a90f-ae1808b3cd2e nodeName:}" failed. No retries permitted until 2026-06-02 04:44:56.421284315 +0000 UTC m=+147.969277133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-2lw7m" (UID: "93e7ae8c-2223-456b-a90f-ae1808b3cd2e") : secret "samples-operator-tls" not found Jun 02 04:44:55.386446 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:55.386367 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz" event={"ID":"271c680b-a894-4ed2-98ac-8d1d5c876790","Type":"ContainerStarted","Data":"1188092215bad2d22191edbb408e2ff10373b0a30a5de982985051b934b00732"} Jun 02 04:44:55.403680 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:55.403627 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-lpgdz" podStartSLOduration=1.9929575929999999 podStartE2EDuration="3.40361059s" podCreationTimestamp="2026-06-02 04:44:52 +0000 UTC" firstStartedPulling="2026-06-02 04:44:53.127693383 +0000 UTC m=+144.675686195" lastFinishedPulling="2026-06-02 04:44:54.53834637 +0000 UTC m=+146.086339192" observedRunningTime="2026-06-02 04:44:55.402165287 +0000 UTC m=+146.950158113" watchObservedRunningTime="2026-06-02 04:44:55.40361059 +0000 UTC m=+146.951603425" Jun 02 04:44:56.238275 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.238226 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:44:56.238453 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:56.238416 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 04:44:56.238513 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:56.238500 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls podName:c9180170-1e56-4a59-a093-3e766feb6289 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:00.238480111 +0000 UTC m=+151.786472928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kn98v" (UID: "c9180170-1e56-4a59-a093-3e766feb6289") : secret "cluster-monitoring-operator-tls" not found Jun 02 04:44:56.390641 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.390613 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/0.log" Jun 02 04:44:56.391113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.390652 2582 generic.go:358] "Generic (PLEG): container finished" podID="ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d" containerID="cdc52159d404a0055e4a1f6e4efbe8bf4ec8c1602b7ca50611f8eae11e52508c" exitCode=255 Jun 02 04:44:56.391113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.390758 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" event={"ID":"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d","Type":"ContainerDied","Data":"cdc52159d404a0055e4a1f6e4efbe8bf4ec8c1602b7ca50611f8eae11e52508c"} Jun 02 04:44:56.391113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.391035 2582 scope.go:117] "RemoveContainer" containerID="cdc52159d404a0055e4a1f6e4efbe8bf4ec8c1602b7ca50611f8eae11e52508c" Jun 02 04:44:56.392122 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.392101 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-8sb54" event={"ID":"7726b5ba-197e-4879-baee-9bbaf52ec489","Type":"ContainerStarted","Data":"d64fe11ebb3e1552f990c5632fa2e765948bf836db841fc71d530ecad2ef1382"} Jun 02 04:44:56.424401 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.424356 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-8sb54" podStartSLOduration=1.668490656 podStartE2EDuration="4.424342639s" podCreationTimestamp="2026-06-02 04:44:52 +0000 UTC" firstStartedPulling="2026-06-02 04:44:53.033528524 +0000 UTC m=+144.581521351" lastFinishedPulling="2026-06-02 04:44:55.789380508 +0000 UTC m=+147.337373334" observedRunningTime="2026-06-02 04:44:56.423120076 +0000 UTC m=+147.971112910" watchObservedRunningTime="2026-06-02 04:44:56.424342639 +0000 UTC m=+147.972335474" Jun 02 04:44:56.440439 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.440206 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:44:56.445104 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:56.440990 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 04:44:56.445104 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:56.441069 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls podName:93e7ae8c-2223-456b-a90f-ae1808b3cd2e nodeName:}" failed. No retries permitted until 2026-06-02 04:45:00.441049128 +0000 UTC m=+151.989041957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-2lw7m" (UID: "93e7ae8c-2223-456b-a90f-ae1808b3cd2e") : secret "samples-operator-tls" not found Jun 02 04:44:56.601194 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.601163 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-72kbd"] Jun 02 04:44:56.604123 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.604107 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.606128 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.606101 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:44:56.606269 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.606101 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 04:44:56.606269 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.606180 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 04:44:56.606269 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.606200 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 04:44:56.606495 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.606480 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cqb7t\"" Jun 02 04:44:56.612989 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.612964 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-72kbd"] Jun 02 04:44:56.641440 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.641413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a95b92-40b9-467e-906e-66ff5228a3fc-serving-cert\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.641581 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.641447 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2a95b92-40b9-467e-906e-66ff5228a3fc-config\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.641581 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.641475 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk6mq\" (UniqueName: \"kubernetes.io/projected/f2a95b92-40b9-467e-906e-66ff5228a3fc-kube-api-access-fk6mq\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.742002 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.741962 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a95b92-40b9-467e-906e-66ff5228a3fc-serving-cert\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.742002 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.741998 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2a95b92-40b9-467e-906e-66ff5228a3fc-config\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.742244 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.742026 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fk6mq\" (UniqueName: \"kubernetes.io/projected/f2a95b92-40b9-467e-906e-66ff5228a3fc-kube-api-access-fk6mq\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.742561 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.742535 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f2a95b92-40b9-467e-906e-66ff5228a3fc-config\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.744392 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.744374 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a95b92-40b9-467e-906e-66ff5228a3fc-serving-cert\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.750160 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.750140 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk6mq\" (UniqueName: \"kubernetes.io/projected/f2a95b92-40b9-467e-906e-66ff5228a3fc-kube-api-access-fk6mq\") pod \"service-ca-operator-69877444c-72kbd\" (UID: \"f2a95b92-40b9-467e-906e-66ff5228a3fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:56.913381 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:56.913337 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" Jun 02 04:44:57.043512 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:57.043481 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-72kbd"] Jun 02 04:44:57.046479 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:44:57.046433 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a95b92_40b9_467e_906e_66ff5228a3fc.slice/crio-db0b84e2c64efd23e8c0a942d9344576a01e728c2dfe6389e5a2ca412f46c3bd WatchSource:0}: Error finding container db0b84e2c64efd23e8c0a942d9344576a01e728c2dfe6389e5a2ca412f46c3bd: Status 404 returned error can't find the container with id db0b84e2c64efd23e8c0a942d9344576a01e728c2dfe6389e5a2ca412f46c3bd Jun 02 04:44:57.395541 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:57.395507 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" event={"ID":"f2a95b92-40b9-467e-906e-66ff5228a3fc","Type":"ContainerStarted","Data":"db0b84e2c64efd23e8c0a942d9344576a01e728c2dfe6389e5a2ca412f46c3bd"} Jun 02 04:44:57.396882 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:57.396861 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/1.log" Jun 02 04:44:57.397199 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:57.397186 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/0.log" Jun 02 04:44:57.397260 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:57.397221 2582 generic.go:358] "Generic (PLEG): container finished" podID="ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d" containerID="458dcf4afdbdeacd813c3472506894bcdb2b0b1e0be058d42f914ed108d5aeec" exitCode=255 Jun 02 04:44:57.397307 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:57.397284 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" event={"ID":"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d","Type":"ContainerDied","Data":"458dcf4afdbdeacd813c3472506894bcdb2b0b1e0be058d42f914ed108d5aeec"} Jun 02 04:44:57.397347 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:57.397337 2582 scope.go:117] "RemoveContainer" containerID="cdc52159d404a0055e4a1f6e4efbe8bf4ec8c1602b7ca50611f8eae11e52508c" Jun 02 04:44:57.397594 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:57.397549 2582 scope.go:117] "RemoveContainer" containerID="458dcf4afdbdeacd813c3472506894bcdb2b0b1e0be058d42f914ed108d5aeec" Jun 02 04:44:57.397806 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:57.397787 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-drtb2_openshift-console-operator(ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" podUID="ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d" Jun 02 04:44:58.402007 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.401976 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/1.log" Jun 02 04:44:58.402540 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.402375 2582 scope.go:117] "RemoveContainer" containerID="458dcf4afdbdeacd813c3472506894bcdb2b0b1e0be058d42f914ed108d5aeec" Jun 02 04:44:58.402629 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:44:58.402607 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-drtb2_openshift-console-operator(ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" podUID="ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d" Jun 02 04:44:58.628471 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.628432 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s"] Jun 02 04:44:58.633114 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.633086 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" Jun 02 04:44:58.635293 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.635262 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 04:44:58.635293 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.635288 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 04:44:58.635494 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.635355 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8pc8s\"" Jun 02 04:44:58.641603 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.641390 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s"] Jun 02 04:44:58.662520 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.662442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpqgw\" (UniqueName: \"kubernetes.io/projected/a57e33ff-f38a-43cf-bfd5-44c662851c0d-kube-api-access-gpqgw\") pod \"migrator-96c6f749-c7k9s\" (UID: \"a57e33ff-f38a-43cf-bfd5-44c662851c0d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" Jun 02 04:44:58.763981 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.763413 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqgw\" (UniqueName: \"kubernetes.io/projected/a57e33ff-f38a-43cf-bfd5-44c662851c0d-kube-api-access-gpqgw\") pod \"migrator-96c6f749-c7k9s\" (UID: \"a57e33ff-f38a-43cf-bfd5-44c662851c0d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" Jun 02 04:44:58.771555 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.771525 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpqgw\" (UniqueName: \"kubernetes.io/projected/a57e33ff-f38a-43cf-bfd5-44c662851c0d-kube-api-access-gpqgw\") pod \"migrator-96c6f749-c7k9s\" (UID: \"a57e33ff-f38a-43cf-bfd5-44c662851c0d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" Jun 02 04:44:58.945197 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:58.945100 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" Jun 02 04:44:59.088710 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:59.088686 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s"] Jun 02 04:44:59.090691 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:44:59.090660 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57e33ff_f38a_43cf_bfd5_44c662851c0d.slice/crio-ff262e6643b9b1773224578b879f54458cd53f3a4b9232bfecca7001a248b2f3 WatchSource:0}: Error finding container ff262e6643b9b1773224578b879f54458cd53f3a4b9232bfecca7001a248b2f3: Status 404 returned error can't find the container with id ff262e6643b9b1773224578b879f54458cd53f3a4b9232bfecca7001a248b2f3 Jun 02 04:44:59.405689 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:59.405648 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" event={"ID":"f2a95b92-40b9-467e-906e-66ff5228a3fc","Type":"ContainerStarted","Data":"73c21a483d84e5018d2a28e6bcb132b5860137e65b00cbe32f325205707e2a3f"} Jun 02 04:44:59.406635 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:59.406613 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" event={"ID":"a57e33ff-f38a-43cf-bfd5-44c662851c0d","Type":"ContainerStarted","Data":"ff262e6643b9b1773224578b879f54458cd53f3a4b9232bfecca7001a248b2f3"} Jun 02 04:44:59.421673 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:59.421633 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" podStartSLOduration=1.6499524989999999 podStartE2EDuration="3.421619407s" podCreationTimestamp="2026-06-02 04:44:56 +0000 UTC" firstStartedPulling="2026-06-02 04:44:57.048400853 +0000 UTC m=+148.596393666" lastFinishedPulling="2026-06-02 04:44:58.820067754 +0000 UTC m=+150.368060574" observedRunningTime="2026-06-02 04:44:59.420532481 +0000 UTC m=+150.968525326" watchObservedRunningTime="2026-06-02 04:44:59.421619407 +0000 UTC m=+150.969612271" Jun 02 04:44:59.643175 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:44:59.643142 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jvdg_e13e1144-840d-4398-8d98-5be590db9c25/dns-node-resolver/0.log" Jun 02 04:45:00.280130 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:00.280103 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:45:00.280261 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:00.280242 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 04:45:00.280311 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:00.280300 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls podName:c9180170-1e56-4a59-a093-3e766feb6289 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:08.280285213 +0000 UTC m=+159.828278026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kn98v" (UID: "c9180170-1e56-4a59-a093-3e766feb6289") : secret "cluster-monitoring-operator-tls" not found Jun 02 04:45:00.410256 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:00.410163 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" event={"ID":"a57e33ff-f38a-43cf-bfd5-44c662851c0d","Type":"ContainerStarted","Data":"a378ea20fed10b169c9a2b5f55bb46d152be7f00712842abec1bca7c18913c1c"} Jun 02 04:45:00.410256 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:00.410205 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" event={"ID":"a57e33ff-f38a-43cf-bfd5-44c662851c0d","Type":"ContainerStarted","Data":"1365f31181691f0fe11b2a3eac8f99520ab8c16bb958884c30750f1ee86da396"} Jun 02 04:45:00.429299 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:00.429241 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-c7k9s" podStartSLOduration=1.393924317 podStartE2EDuration="2.429227336s" podCreationTimestamp="2026-06-02 04:44:58 +0000 UTC" firstStartedPulling="2026-06-02 04:44:59.092687289 +0000 UTC m=+150.640680105" lastFinishedPulling="2026-06-02 04:45:00.127990311 +0000 UTC m=+151.675983124" observedRunningTime="2026-06-02 04:45:00.428182299 +0000 UTC m=+151.976175131" watchObservedRunningTime="2026-06-02 04:45:00.429227336 +0000 UTC m=+151.977220171" Jun 02 04:45:00.482200 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:00.482166 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:45:00.482366 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:00.482318 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 04:45:00.482444 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:00.482379 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls podName:93e7ae8c-2223-456b-a90f-ae1808b3cd2e nodeName:}" failed. No retries permitted until 2026-06-02 04:45:08.482364804 +0000 UTC m=+160.030357618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-2lw7m" (UID: "93e7ae8c-2223-456b-a90f-ae1808b3cd2e") : secret "samples-operator-tls" not found Jun 02 04:45:00.844339 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:00.844307 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zm68m_f9b14777-6686-408f-94f8-9db173624233/node-ca/0.log" Jun 02 04:45:02.708142 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.706476 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-zwrvk"] Jun 02 04:45:02.710358 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.710328 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.712673 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.712651 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 04:45:02.713072 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.713052 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fst6r\"" Jun 02 04:45:02.713172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.713098 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 04:45:02.713172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.713162 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 04:45:02.713295 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.713162 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 04:45:02.718347 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.718326 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-zwrvk"] Jun 02 04:45:02.804521 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.804485 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmnqq\" (UniqueName: \"kubernetes.io/projected/14953c42-dac0-4521-9e8b-ec4ac98c40db-kube-api-access-wmnqq\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.804697 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.804535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/14953c42-dac0-4521-9e8b-ec4ac98c40db-signing-key\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.804697 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.804555 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/14953c42-dac0-4521-9e8b-ec4ac98c40db-signing-cabundle\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.905084 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.905045 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/14953c42-dac0-4521-9e8b-ec4ac98c40db-signing-key\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.905084 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.905086 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/14953c42-dac0-4521-9e8b-ec4ac98c40db-signing-cabundle\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.905280 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.905174 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmnqq\" (UniqueName: \"kubernetes.io/projected/14953c42-dac0-4521-9e8b-ec4ac98c40db-kube-api-access-wmnqq\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.905803 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.905772 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/14953c42-dac0-4521-9e8b-ec4ac98c40db-signing-cabundle\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.907527 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.907507 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/14953c42-dac0-4521-9e8b-ec4ac98c40db-signing-key\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:02.914570 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:02.914548 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmnqq\" (UniqueName: \"kubernetes.io/projected/14953c42-dac0-4521-9e8b-ec4ac98c40db-kube-api-access-wmnqq\") pod \"service-ca-685df94d57-zwrvk\" (UID: \"14953c42-dac0-4521-9e8b-ec4ac98c40db\") " pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:03.002558 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:03.002469 2582 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:45:03.002558 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:03.002503 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:45:03.002887 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:03.002873 2582 scope.go:117] "RemoveContainer" containerID="458dcf4afdbdeacd813c3472506894bcdb2b0b1e0be058d42f914ed108d5aeec" Jun 02 04:45:03.003061 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:03.003043 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-drtb2_openshift-console-operator(ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" podUID="ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d" Jun 02 04:45:03.019068 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:03.019042 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-zwrvk" Jun 02 04:45:03.144260 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:03.144130 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-zwrvk"] Jun 02 04:45:03.146730 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:03.146700 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14953c42_dac0_4521_9e8b_ec4ac98c40db.slice/crio-9580d7b7510053472f931d58bbbf93fb9245809d7d563fe8e93312f3520606e6 WatchSource:0}: Error finding container 9580d7b7510053472f931d58bbbf93fb9245809d7d563fe8e93312f3520606e6: Status 404 returned error can't find the container with id 9580d7b7510053472f931d58bbbf93fb9245809d7d563fe8e93312f3520606e6 Jun 02 04:45:03.418858 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:03.418812 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-zwrvk" event={"ID":"14953c42-dac0-4521-9e8b-ec4ac98c40db","Type":"ContainerStarted","Data":"04b414204ebb7bfb140635674abaf803a5d13b146cea6b98b5056d93b64d3e04"} Jun 02 04:45:03.418858 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:03.418862 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-zwrvk" event={"ID":"14953c42-dac0-4521-9e8b-ec4ac98c40db","Type":"ContainerStarted","Data":"9580d7b7510053472f931d58bbbf93fb9245809d7d563fe8e93312f3520606e6"} Jun 02 04:45:03.436220 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:03.436169 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-zwrvk" podStartSLOduration=1.436156572 podStartE2EDuration="1.436156572s" podCreationTimestamp="2026-06-02 04:45:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:45:03.435023985 +0000 UTC m=+154.983016820" watchObservedRunningTime="2026-06-02 04:45:03.436156572 +0000 UTC m=+154.984149407" Jun 02 04:45:05.799219 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:05.799175 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-847b749778-p68nz" podUID="c14a94fc-c798-4f5a-813a-9004c00c0fdf" Jun 02 04:45:05.806332 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:05.806293 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" podUID="0e126c07-8905-4d3d-b2f5-00616074853a" Jun 02 04:45:05.824666 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:05.824633 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fg8d6" podUID="1b4f34f7-87d4-4e3d-8b16-c6b4565b2525" Jun 02 04:45:05.831481 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:05.831449 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-n9q5d" podUID="fa57166d-8b60-43e2-a03c-69ed60cc8e73" Jun 02 04:45:06.015517 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:06.015469 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pq546" podUID="401fe11a-e1ab-48a1-9211-60714444024a" Jun 02 04:45:06.427241 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:06.427200 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:45:06.427405 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:06.427253 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:45:06.427405 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:06.427263 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:45:06.427405 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:06.427382 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fg8d6" Jun 02 04:45:08.357011 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:08.356967 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:45:08.357454 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:08.357131 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 04:45:08.357454 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:08.357205 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls podName:c9180170-1e56-4a59-a093-3e766feb6289 nodeName:}" failed. No retries permitted until 2026-06-02 04:45:24.35718927 +0000 UTC m=+175.905182087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-kn98v" (UID: "c9180170-1e56-4a59-a093-3e766feb6289") : secret "cluster-monitoring-operator-tls" not found Jun 02 04:45:08.558396 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:08.558359 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:45:08.561083 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:08.561056 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93e7ae8c-2223-456b-a90f-ae1808b3cd2e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-2lw7m\" (UID: \"93e7ae8c-2223-456b-a90f-ae1808b3cd2e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:45:08.695865 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:08.695765 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" Jun 02 04:45:08.823649 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:08.823569 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m"] Jun 02 04:45:09.437044 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:09.437008 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" event={"ID":"93e7ae8c-2223-456b-a90f-ae1808b3cd2e","Type":"ContainerStarted","Data":"b0eac854a4436481e6b5aa4c8030d7f33b716410233cdb208e217d3757146d48"} Jun 02 04:45:10.679169 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.679131 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:45:10.679589 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.679245 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:45:10.679589 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:10.679401 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 04:45:10.679589 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:10.679494 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert podName:0e126c07-8905-4d3d-b2f5-00616074853a nodeName:}" failed. No retries permitted until 2026-06-02 04:47:12.679472713 +0000 UTC m=+284.227465530 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-cs4nm" (UID: "0e126c07-8905-4d3d-b2f5-00616074853a") : secret "networking-console-plugin-cert" not found Jun 02 04:45:10.682460 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.682430 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"image-registry-847b749778-p68nz\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:45:10.780263 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.780222 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:45:10.780426 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.780282 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:45:10.783283 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.783249 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b4f34f7-87d4-4e3d-8b16-c6b4565b2525-metrics-tls\") pod \"dns-default-fg8d6\" (UID: \"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525\") " pod="openshift-dns/dns-default-fg8d6" Jun 02 04:45:10.783410 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.783249 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa57166d-8b60-43e2-a03c-69ed60cc8e73-cert\") pod \"ingress-canary-n9q5d\" (UID: \"fa57166d-8b60-43e2-a03c-69ed60cc8e73\") " pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:45:10.931634 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.931369 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s8w52\"" Jun 02 04:45:10.931634 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.931442 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l292j\"" Jun 02 04:45:10.931634 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.931446 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4vpfz\"" Jun 02 04:45:10.939087 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.939063 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9q5d" Jun 02 04:45:10.939250 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.939093 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fg8d6" Jun 02 04:45:10.939674 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:10.939398 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:45:11.296055 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:11.296027 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fg8d6"] Jun 02 04:45:11.300471 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:11.300441 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b4f34f7_87d4_4e3d_8b16_c6b4565b2525.slice/crio-3a6295fcdb49105ae0f974942e114974de9b5a014006606b7afa2096e51ecec0 WatchSource:0}: Error finding container 3a6295fcdb49105ae0f974942e114974de9b5a014006606b7afa2096e51ecec0: Status 404 returned error can't find the container with id 3a6295fcdb49105ae0f974942e114974de9b5a014006606b7afa2096e51ecec0 Jun 02 04:45:11.443225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:11.443190 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fg8d6" event={"ID":"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525","Type":"ContainerStarted","Data":"3a6295fcdb49105ae0f974942e114974de9b5a014006606b7afa2096e51ecec0"} Jun 02 04:45:11.444737 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:11.444686 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" event={"ID":"93e7ae8c-2223-456b-a90f-ae1808b3cd2e","Type":"ContainerStarted","Data":"965483e511dca665045c24f91a77d2fa67450c635067b40eb4d7d11ac4dba1ef"} Jun 02 04:45:11.444737 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:11.444713 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" event={"ID":"93e7ae8c-2223-456b-a90f-ae1808b3cd2e","Type":"ContainerStarted","Data":"34b652ad2013a28ec4dbd2ee605d0a9baeb3ce2de4d531fa8f5faa5faa8bd9e3"} Jun 02 04:45:11.464296 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:11.464253 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-2lw7m" podStartSLOduration=17.134845353 podStartE2EDuration="19.464241466s" podCreationTimestamp="2026-06-02 04:44:52 +0000 UTC" firstStartedPulling="2026-06-02 04:45:08.866217102 +0000 UTC m=+160.414209916" lastFinishedPulling="2026-06-02 04:45:11.195613212 +0000 UTC m=+162.743606029" observedRunningTime="2026-06-02 04:45:11.463787503 +0000 UTC m=+163.011780339" watchObservedRunningTime="2026-06-02 04:45:11.464241466 +0000 UTC m=+163.012234336" Jun 02 04:45:11.519232 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:11.519199 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n9q5d"] Jun 02 04:45:11.522089 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:11.522049 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa57166d_8b60_43e2_a03c_69ed60cc8e73.slice/crio-05dbff2948cade44efd000868bbab5b6897660fc8d26256412dced14ab122f89 WatchSource:0}: Error finding container 05dbff2948cade44efd000868bbab5b6897660fc8d26256412dced14ab122f89: Status 404 returned error can't find the container with id 05dbff2948cade44efd000868bbab5b6897660fc8d26256412dced14ab122f89 Jun 02 04:45:11.524554 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:11.524524 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-847b749778-p68nz"] Jun 02 04:45:11.528794 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:11.528771 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14a94fc_c798_4f5a_813a_9004c00c0fdf.slice/crio-31c8f9bd67c4b58303666c611b28052e6f164ef74346100675becf3dae053435 WatchSource:0}: Error finding container 31c8f9bd67c4b58303666c611b28052e6f164ef74346100675becf3dae053435: Status 404 returned error can't find the container with id 31c8f9bd67c4b58303666c611b28052e6f164ef74346100675becf3dae053435 Jun 02 04:45:12.449759 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:12.449707 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n9q5d" event={"ID":"fa57166d-8b60-43e2-a03c-69ed60cc8e73","Type":"ContainerStarted","Data":"05dbff2948cade44efd000868bbab5b6897660fc8d26256412dced14ab122f89"} Jun 02 04:45:12.451088 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:12.451057 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-847b749778-p68nz" event={"ID":"c14a94fc-c798-4f5a-813a-9004c00c0fdf","Type":"ContainerStarted","Data":"ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df"} Jun 02 04:45:12.451232 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:12.451096 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-847b749778-p68nz" event={"ID":"c14a94fc-c798-4f5a-813a-9004c00c0fdf","Type":"ContainerStarted","Data":"31c8f9bd67c4b58303666c611b28052e6f164ef74346100675becf3dae053435"} Jun 02 04:45:12.451388 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:12.451364 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:45:12.475441 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:12.475393 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-847b749778-p68nz" podStartSLOduration=163.475376529 podStartE2EDuration="2m43.475376529s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:45:12.474519161 +0000 UTC m=+164.022511997" watchObservedRunningTime="2026-06-02 04:45:12.475376529 +0000 UTC m=+164.023369364" Jun 02 04:45:14.458548 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:14.458513 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fg8d6" event={"ID":"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525","Type":"ContainerStarted","Data":"280ab4528d05817316f4553057a95f5efaa3ffe13fde1ec8a7d90acc3faed450"} Jun 02 04:45:14.458548 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:14.458556 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fg8d6" event={"ID":"1b4f34f7-87d4-4e3d-8b16-c6b4565b2525","Type":"ContainerStarted","Data":"54b2a60dc9fa610709c05cac5e27870b19ccb7c6bb393da99659ef62515f0aa8"} Jun 02 04:45:14.459079 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:14.458645 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fg8d6" Jun 02 04:45:14.459858 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:14.459817 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n9q5d" event={"ID":"fa57166d-8b60-43e2-a03c-69ed60cc8e73","Type":"ContainerStarted","Data":"655a20084022dad721e96a8f4c679858d3aa3e45e3e85253bd90a75e6a460d01"} Jun 02 04:45:14.485282 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:14.485237 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-fg8d6" podStartSLOduration=130.287536256 podStartE2EDuration="2m12.485224002s" podCreationTimestamp="2026-06-02 04:43:02 +0000 UTC" firstStartedPulling="2026-06-02 04:45:11.302377928 +0000 UTC m=+162.850370740" lastFinishedPulling="2026-06-02 04:45:13.500065657 +0000 UTC m=+165.048058486" observedRunningTime="2026-06-02 04:45:14.485045443 +0000 UTC m=+166.033038278" watchObservedRunningTime="2026-06-02 04:45:14.485224002 +0000 UTC m=+166.033216837" Jun 02 04:45:14.517513 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:14.517449 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n9q5d" podStartSLOduration=130.541486555 podStartE2EDuration="2m12.517429642s" podCreationTimestamp="2026-06-02 04:43:02 +0000 UTC" firstStartedPulling="2026-06-02 04:45:11.524870581 +0000 UTC m=+163.072863407" lastFinishedPulling="2026-06-02 04:45:13.500813668 +0000 UTC m=+165.048806494" observedRunningTime="2026-06-02 04:45:14.516226024 +0000 UTC m=+166.064218859" watchObservedRunningTime="2026-06-02 04:45:14.517429642 +0000 UTC m=+166.065422478" Jun 02 04:45:16.004263 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:16.004224 2582 scope.go:117] "RemoveContainer" containerID="458dcf4afdbdeacd813c3472506894bcdb2b0b1e0be058d42f914ed108d5aeec" Jun 02 04:45:16.467100 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:16.467016 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:45:16.467416 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:16.467401 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/1.log" Jun 02 04:45:16.467478 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:16.467435 2582 generic.go:358] "Generic (PLEG): container finished" podID="ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d" containerID="2b21def10cf7e0de0428ab87582b80356edcc13b8c4960f7406c4b1053786bcb" exitCode=255 Jun 02 04:45:16.467541 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:16.467517 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" event={"ID":"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d","Type":"ContainerDied","Data":"2b21def10cf7e0de0428ab87582b80356edcc13b8c4960f7406c4b1053786bcb"} Jun 02 04:45:16.467590 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:16.467572 2582 scope.go:117] "RemoveContainer" containerID="458dcf4afdbdeacd813c3472506894bcdb2b0b1e0be058d42f914ed108d5aeec" Jun 02 04:45:16.467991 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:16.467972 2582 scope.go:117] "RemoveContainer" containerID="2b21def10cf7e0de0428ab87582b80356edcc13b8c4960f7406c4b1053786bcb" Jun 02 04:45:16.468218 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:16.468190 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-drtb2_openshift-console-operator(ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" podUID="ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d" Jun 02 04:45:17.003816 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:17.003777 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:45:17.472641 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:17.472613 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:45:23.002752 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:23.002707 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:45:23.002752 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:23.002749 2582 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:45:23.003190 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:23.003084 2582 scope.go:117] "RemoveContainer" containerID="2b21def10cf7e0de0428ab87582b80356edcc13b8c4960f7406c4b1053786bcb" Jun 02 04:45:23.003292 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:23.003272 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-drtb2_openshift-console-operator(ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" podUID="ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d" Jun 02 04:45:24.399527 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.399487 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:45:24.402105 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.402077 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9180170-1e56-4a59-a093-3e766feb6289-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-kn98v\" (UID: \"c9180170-1e56-4a59-a093-3e766feb6289\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:45:24.465822 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.465790 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fg8d6" Jun 02 04:45:24.695360 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.695279 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" Jun 02 04:45:24.713180 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.713154 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-znbl9"] Jun 02 04:45:24.733550 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.733519 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-znbl9"] Jun 02 04:45:24.733723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.733587 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:24.736740 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.736715 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxtwx\"" Jun 02 04:45:24.736964 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.736948 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 04:45:24.737210 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.737195 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 04:45:24.831782 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.831751 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v"] Jun 02 04:45:24.835739 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:24.835711 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9180170_1e56_4a59_a093_3e766feb6289.slice/crio-9a15a0b3f898be61b6ad08fbd200ad7330469d61f58db3913cde44acad0ebc49 WatchSource:0}: Error finding container 9a15a0b3f898be61b6ad08fbd200ad7330469d61f58db3913cde44acad0ebc49: Status 404 returned error can't find the container with id 9a15a0b3f898be61b6ad08fbd200ad7330469d61f58db3913cde44acad0ebc49 Jun 02 04:45:24.902919 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.902888 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/558eb416-dd7b-4772-90ce-33ab1ca45b27-crio-socket\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:24.902919 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.902921 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/558eb416-dd7b-4772-90ce-33ab1ca45b27-data-volume\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:24.903146 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.902950 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/558eb416-dd7b-4772-90ce-33ab1ca45b27-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:24.903146 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.902976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/558eb416-dd7b-4772-90ce-33ab1ca45b27-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:24.903146 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:24.903090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxqsl\" (UniqueName: \"kubernetes.io/projected/558eb416-dd7b-4772-90ce-33ab1ca45b27-kube-api-access-rxqsl\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.004245 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.004158 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/558eb416-dd7b-4772-90ce-33ab1ca45b27-crio-socket\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.004245 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.004194 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/558eb416-dd7b-4772-90ce-33ab1ca45b27-data-volume\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.004245 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.004224 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/558eb416-dd7b-4772-90ce-33ab1ca45b27-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.004494 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.004246 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/558eb416-dd7b-4772-90ce-33ab1ca45b27-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.004494 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.004303 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/558eb416-dd7b-4772-90ce-33ab1ca45b27-crio-socket\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.004494 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.004318 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxqsl\" (UniqueName: \"kubernetes.io/projected/558eb416-dd7b-4772-90ce-33ab1ca45b27-kube-api-access-rxqsl\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.004646 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.004575 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/558eb416-dd7b-4772-90ce-33ab1ca45b27-data-volume\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.004821 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.004797 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/558eb416-dd7b-4772-90ce-33ab1ca45b27-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.007050 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.007024 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/558eb416-dd7b-4772-90ce-33ab1ca45b27-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.014905 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.014877 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxqsl\" (UniqueName: \"kubernetes.io/projected/558eb416-dd7b-4772-90ce-33ab1ca45b27-kube-api-access-rxqsl\") pod \"insights-runtime-extractor-znbl9\" (UID: \"558eb416-dd7b-4772-90ce-33ab1ca45b27\") " pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.045390 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.045361 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-znbl9" Jun 02 04:45:25.189727 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.189695 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-znbl9"] Jun 02 04:45:25.192654 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:25.192624 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558eb416_dd7b_4772_90ce_33ab1ca45b27.slice/crio-fe44018f00c00667b60cd5f97741209fc0552f64d54fd5e1eeeb25435c5d622f WatchSource:0}: Error finding container fe44018f00c00667b60cd5f97741209fc0552f64d54fd5e1eeeb25435c5d622f: Status 404 returned error can't find the container with id fe44018f00c00667b60cd5f97741209fc0552f64d54fd5e1eeeb25435c5d622f Jun 02 04:45:25.496526 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.496488 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znbl9" event={"ID":"558eb416-dd7b-4772-90ce-33ab1ca45b27","Type":"ContainerStarted","Data":"5511375031ea88c050b852d39a32cdb4bc50526b75f0037005da9f05d3537415"} Jun 02 04:45:25.496526 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.496525 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znbl9" event={"ID":"558eb416-dd7b-4772-90ce-33ab1ca45b27","Type":"ContainerStarted","Data":"fe44018f00c00667b60cd5f97741209fc0552f64d54fd5e1eeeb25435c5d622f"} Jun 02 04:45:25.497418 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:25.497391 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" event={"ID":"c9180170-1e56-4a59-a093-3e766feb6289","Type":"ContainerStarted","Data":"9a15a0b3f898be61b6ad08fbd200ad7330469d61f58db3913cde44acad0ebc49"} Jun 02 04:45:27.504851 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:27.504792 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znbl9" event={"ID":"558eb416-dd7b-4772-90ce-33ab1ca45b27","Type":"ContainerStarted","Data":"228ac4dac307ab3ba1e567c4ccc91975150ebca3423d0e0d2461c3f62cb3d9e7"} Jun 02 04:45:27.506143 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:27.506119 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" event={"ID":"c9180170-1e56-4a59-a093-3e766feb6289","Type":"ContainerStarted","Data":"61b66d2681d81c78a64e128d14622004aefa22bb188e5a7d89b1295171937a37"} Jun 02 04:45:27.523712 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:27.523670 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-kn98v" podStartSLOduration=33.068637216 podStartE2EDuration="35.523657909s" podCreationTimestamp="2026-06-02 04:44:52 +0000 UTC" firstStartedPulling="2026-06-02 04:45:24.837797965 +0000 UTC m=+176.385790783" lastFinishedPulling="2026-06-02 04:45:27.292818648 +0000 UTC m=+178.840811476" observedRunningTime="2026-06-02 04:45:27.522734391 +0000 UTC m=+179.070727227" watchObservedRunningTime="2026-06-02 04:45:27.523657909 +0000 UTC m=+179.071650745" Jun 02 04:45:27.842478 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:27.842443 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr"] Jun 02 04:45:27.864478 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:27.864447 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr"] Jun 02 04:45:27.864655 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:27.864578 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" Jun 02 04:45:27.867398 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:27.867374 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 04:45:27.867521 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:27.867417 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xsv9j\"" Jun 02 04:45:28.030347 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:28.030308 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/093c7b05-c8a1-4add-b32b-0a46adcc2188-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-qp4tr\" (UID: \"093c7b05-c8a1-4add-b32b-0a46adcc2188\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" Jun 02 04:45:28.131233 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:28.131141 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/093c7b05-c8a1-4add-b32b-0a46adcc2188-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-qp4tr\" (UID: \"093c7b05-c8a1-4add-b32b-0a46adcc2188\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" Jun 02 04:45:28.134134 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:28.134103 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/093c7b05-c8a1-4add-b32b-0a46adcc2188-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-qp4tr\" (UID: \"093c7b05-c8a1-4add-b32b-0a46adcc2188\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" Jun 02 04:45:28.176887 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:28.176852 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" Jun 02 04:45:28.688291 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:28.688261 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr"] Jun 02 04:45:28.691025 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:28.690998 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093c7b05_c8a1_4add_b32b_0a46adcc2188.slice/crio-e0009d0ed708cb5c6cb76ea9bf0efbd616c9f03316c4e2fe587be5956ed8d013 WatchSource:0}: Error finding container e0009d0ed708cb5c6cb76ea9bf0efbd616c9f03316c4e2fe587be5956ed8d013: Status 404 returned error can't find the container with id e0009d0ed708cb5c6cb76ea9bf0efbd616c9f03316c4e2fe587be5956ed8d013 Jun 02 04:45:29.514176 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:29.514118 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znbl9" event={"ID":"558eb416-dd7b-4772-90ce-33ab1ca45b27","Type":"ContainerStarted","Data":"bb21fcd37ce3b7512ebbccf5998760f97ee60b9a547e6c0f880b27b56cc55a5c"} Jun 02 04:45:29.515466 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:29.515435 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" event={"ID":"093c7b05-c8a1-4add-b32b-0a46adcc2188","Type":"ContainerStarted","Data":"e0009d0ed708cb5c6cb76ea9bf0efbd616c9f03316c4e2fe587be5956ed8d013"} Jun 02 04:45:29.533184 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:29.533133 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-znbl9" podStartSLOduration=2.256758195 podStartE2EDuration="5.533118139s" podCreationTimestamp="2026-06-02 04:45:24 +0000 UTC" firstStartedPulling="2026-06-02 04:45:25.305366548 +0000 UTC m=+176.853359387" lastFinishedPulling="2026-06-02 04:45:28.581726499 +0000 UTC m=+180.129719331" observedRunningTime="2026-06-02 04:45:29.531738147 +0000 UTC m=+181.079730984" watchObservedRunningTime="2026-06-02 04:45:29.533118139 +0000 UTC m=+181.081110974" Jun 02 04:45:30.520315 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:30.520278 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" event={"ID":"093c7b05-c8a1-4add-b32b-0a46adcc2188","Type":"ContainerStarted","Data":"23f803f8db7c659b9447dd3dea045a6f2d927e80d739aa46330510861a589c37"} Jun 02 04:45:30.537320 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:30.537182 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" podStartSLOduration=2.544492182 podStartE2EDuration="3.537165436s" podCreationTimestamp="2026-06-02 04:45:27 +0000 UTC" firstStartedPulling="2026-06-02 04:45:28.69284264 +0000 UTC m=+180.240835467" lastFinishedPulling="2026-06-02 04:45:29.685515895 +0000 UTC m=+181.233508721" observedRunningTime="2026-06-02 04:45:30.536678946 +0000 UTC m=+182.084671782" watchObservedRunningTime="2026-06-02 04:45:30.537165436 +0000 UTC m=+182.085158271" Jun 02 04:45:30.943723 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:30.943673 2582 patch_prober.go:28] interesting pod/image-registry-847b749778-p68nz container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 04:45:30.943921 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:30.943738 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-847b749778-p68nz" podUID="c14a94fc-c798-4f5a-813a-9004c00c0fdf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 04:45:31.522849 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:31.522802 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" Jun 02 04:45:31.527496 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:31.527460 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-qp4tr" Jun 02 04:45:33.457493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:33.457464 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:45:36.267527 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.267488 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rgmv6"] Jun 02 04:45:36.270295 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.270265 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.275250 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.275226 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 04:45:36.275847 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.275808 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 04:45:36.276178 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.276137 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 04:45:36.276423 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.276406 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 04:45:36.276573 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.276417 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xw5gq\"" Jun 02 04:45:36.298557 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.298707 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d1e75ba-69f1-4b32-9baa-3205c412328b-metrics-client-ca\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.298707 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298693 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.298815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298723 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-sys\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.298815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-textfile\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.298815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298777 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-tls\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.298815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298805 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-wtmp\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.299049 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298892 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-root\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.299049 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.298937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jj8j\" (UniqueName: \"kubernetes.io/projected/6d1e75ba-69f1-4b32-9baa-3205c412328b-kube-api-access-4jj8j\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400253 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400201 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400253 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400259 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-sys\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400285 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-textfile\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400310 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-tls\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400338 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-wtmp\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400393 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-root\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400418 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jj8j\" (UniqueName: \"kubernetes.io/projected/6d1e75ba-69f1-4b32-9baa-3205c412328b-kube-api-access-4jj8j\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400463 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.400797 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.400518 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d1e75ba-69f1-4b32-9baa-3205c412328b-metrics-client-ca\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.401018 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:36.400996 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 04:45:36.401193 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.401170 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d1e75ba-69f1-4b32-9baa-3205c412328b-metrics-client-ca\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.401262 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:36.401181 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-tls podName:6d1e75ba-69f1-4b32-9baa-3205c412328b nodeName:}" failed. No retries permitted until 2026-06-02 04:45:36.901160264 +0000 UTC m=+188.449153079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-tls") pod "node-exporter-rgmv6" (UID: "6d1e75ba-69f1-4b32-9baa-3205c412328b") : secret "node-exporter-tls" not found Jun 02 04:45:36.402005 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.401325 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-wtmp\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.402005 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.401367 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-root\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.402005 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.401951 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-accelerators-collector-config\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.402005 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.401972 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d1e75ba-69f1-4b32-9baa-3205c412328b-sys\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.402271 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.402131 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-textfile\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.404444 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.404424 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.409891 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.409869 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jj8j\" (UniqueName: \"kubernetes.io/projected/6d1e75ba-69f1-4b32-9baa-3205c412328b-kube-api-access-4jj8j\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.905152 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.905104 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-tls\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:36.907602 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:36.907569 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d1e75ba-69f1-4b32-9baa-3205c412328b-node-exporter-tls\") pod \"node-exporter-rgmv6\" (UID: \"6d1e75ba-69f1-4b32-9baa-3205c412328b\") " pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:37.182585 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.182502 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rgmv6" Jun 02 04:45:37.190807 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:37.190777 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1e75ba_69f1_4b32_9baa_3205c412328b.slice/crio-74df5f11057ab0a844b1ed0576c693fe7957134c95c0f7beb63a6ea1ef69b0ce WatchSource:0}: Error finding container 74df5f11057ab0a844b1ed0576c693fe7957134c95c0f7beb63a6ea1ef69b0ce: Status 404 returned error can't find the container with id 74df5f11057ab0a844b1ed0576c693fe7957134c95c0f7beb63a6ea1ef69b0ce Jun 02 04:45:37.340916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.340879 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:45:37.344859 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.344815 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.346935 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.346905 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 04:45:37.347081 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.346914 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 04:45:37.347081 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.346917 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 04:45:37.347341 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.347236 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 04:45:37.347341 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.347277 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 04:45:37.347341 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.347314 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6lk67\"" Jun 02 04:45:37.347541 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.347314 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 04:45:37.347541 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.347318 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 04:45:37.347541 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.347399 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 04:45:37.347541 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.347278 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 04:45:37.357782 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.357760 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:45:37.408442 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.408590 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408451 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.408590 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.408590 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.408758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408592 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.408758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408644 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.408758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28825\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-kube-api-access-28825\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.408758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-out\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.409044 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-web-config\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.409044 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408875 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.409044 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408915 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.409044 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.408985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.409044 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.409019 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.509865 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.509758 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-web-config\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.509865 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.509792 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.509865 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.509819 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510118 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.509874 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510118 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.509910 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510118 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.509937 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510118 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.509956 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510118 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.509985 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510118 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.510049 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510495 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:37.510131 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle podName:bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c nodeName:}" failed. No retries permitted until 2026-06-02 04:45:38.010057596 +0000 UTC m=+189.558050410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c") : configmap references non-existent config key: ca-bundle.crt Jun 02 04:45:37.510495 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.510185 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510495 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.510229 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510495 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.510265 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28825\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-kube-api-access-28825\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510495 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.510319 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-out\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.510939 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.510908 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.511243 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.511222 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.513409 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.513189 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.513409 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.513203 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.513409 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.513385 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-out\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.514141 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.514039 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.514141 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.514093 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-web-config\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.514266 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.514109 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.514266 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.514147 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-volume\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.515245 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.515226 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.515963 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.515939 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.520666 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.520644 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28825\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-kube-api-access-28825\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:37.540607 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:37.540577 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgmv6" event={"ID":"6d1e75ba-69f1-4b32-9baa-3205c412328b","Type":"ContainerStarted","Data":"74df5f11057ab0a844b1ed0576c693fe7957134c95c0f7beb63a6ea1ef69b0ce"} Jun 02 04:45:38.003995 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.003958 2582 scope.go:117] "RemoveContainer" containerID="2b21def10cf7e0de0428ab87582b80356edcc13b8c4960f7406c4b1053786bcb" Jun 02 04:45:38.016543 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.016271 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:38.017346 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.017323 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:38.255450 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.255355 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:45:38.418511 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.418480 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:45:38.421499 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:38.421452 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc62bae_6e04_4cf6_a34d_e5bf7ddec29c.slice/crio-57d18c2e80b96b8fcbea0ebce018be92febb4e6f1367ac1d54ce6cbe0568a53b WatchSource:0}: Error finding container 57d18c2e80b96b8fcbea0ebce018be92febb4e6f1367ac1d54ce6cbe0568a53b: Status 404 returned error can't find the container with id 57d18c2e80b96b8fcbea0ebce018be92febb4e6f1367ac1d54ce6cbe0568a53b Jun 02 04:45:38.545457 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.545431 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:45:38.545615 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.545547 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" event={"ID":"ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d","Type":"ContainerStarted","Data":"3ba1a852c1512e64e5158e876adea2e25e3471b5590b94519fc24461bf1039b0"} Jun 02 04:45:38.545891 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.545862 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:45:38.547383 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.547352 2582 generic.go:358] "Generic (PLEG): container finished" podID="6d1e75ba-69f1-4b32-9baa-3205c412328b" containerID="c3a7664c0640c9cdf79193a99c0422c10cd69ea8b24c687c6830b1057b1e8aef" exitCode=0 Jun 02 04:45:38.547520 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.547434 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgmv6" event={"ID":"6d1e75ba-69f1-4b32-9baa-3205c412328b","Type":"ContainerDied","Data":"c3a7664c0640c9cdf79193a99c0422c10cd69ea8b24c687c6830b1057b1e8aef"} Jun 02 04:45:38.548782 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.548750 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerStarted","Data":"57d18c2e80b96b8fcbea0ebce018be92febb4e6f1367ac1d54ce6cbe0568a53b"} Jun 02 04:45:38.551112 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.551093 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" Jun 02 04:45:38.573292 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:38.573232 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-drtb2" podStartSLOduration=43.923588751 podStartE2EDuration="46.573212123s" podCreationTimestamp="2026-06-02 04:44:52 +0000 UTC" firstStartedPulling="2026-06-02 04:44:53.141462032 +0000 UTC m=+144.689454848" lastFinishedPulling="2026-06-02 04:44:55.791085407 +0000 UTC m=+147.339078220" observedRunningTime="2026-06-02 04:45:38.568591519 +0000 UTC m=+190.116584354" watchObservedRunningTime="2026-06-02 04:45:38.573212123 +0000 UTC m=+190.121204960" Jun 02 04:45:39.399283 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.399247 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-784c68ddc5-nl6gf"] Jun 02 04:45:39.402982 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.402957 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.405487 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.405092 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 04:45:39.405487 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.405126 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 04:45:39.405487 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.405157 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 04:45:39.405487 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.405166 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 04:45:39.405487 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.405403 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 04:45:39.405862 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.405841 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-trc4b\"" Jun 02 04:45:39.406177 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.406154 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3o7s3soldkv0g\"" Jun 02 04:45:39.417672 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.417645 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-784c68ddc5-nl6gf"] Jun 02 04:45:39.445862 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.445804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-tls\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.446289 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.445871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.446289 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.445904 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-grpc-tls\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.446289 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.446126 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf8gl\" (UniqueName: \"kubernetes.io/projected/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-kube-api-access-vf8gl\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.446289 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.446206 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.446289 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.446282 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.446535 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.446314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.446535 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.446493 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-metrics-client-ca\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.547553 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.547512 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-tls\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.547553 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.547551 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.547796 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.547570 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-grpc-tls\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.547874 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.547785 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vf8gl\" (UniqueName: \"kubernetes.io/projected/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-kube-api-access-vf8gl\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.547874 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.547859 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.547984 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.547913 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.547984 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.547944 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.548075 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.547986 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-metrics-client-ca\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.549005 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.548969 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-metrics-client-ca\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.551856 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.551282 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.551856 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.551389 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-tls\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.551856 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.551549 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.551856 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.551727 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.552180 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.551934 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-grpc-tls\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.553373 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.553350 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.554575 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.554181 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgmv6" event={"ID":"6d1e75ba-69f1-4b32-9baa-3205c412328b","Type":"ContainerStarted","Data":"9c52d66a886578d7bfe8417094f539a4bb1dbb0178a977429e639dab97fb7438"} Jun 02 04:45:39.554575 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.554235 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rgmv6" event={"ID":"6d1e75ba-69f1-4b32-9baa-3205c412328b","Type":"ContainerStarted","Data":"935e4f4718379945d1e07b32a4fb206437ea139bd8a70a5a8f70675cdb373610"} Jun 02 04:45:39.555735 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.555712 2582 generic.go:358] "Generic (PLEG): container finished" podID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerID="71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14" exitCode=0 Jun 02 04:45:39.555810 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.555794 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerDied","Data":"71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14"} Jun 02 04:45:39.560990 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.560969 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf8gl\" (UniqueName: \"kubernetes.io/projected/029e16e4-dcf9-4309-a4bd-bae1bd4d3e80-kube-api-access-vf8gl\") pod \"thanos-querier-784c68ddc5-nl6gf\" (UID: \"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80\") " pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.576096 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.576042 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rgmv6" podStartSLOduration=2.620357403 podStartE2EDuration="3.576027536s" podCreationTimestamp="2026-06-02 04:45:36 +0000 UTC" firstStartedPulling="2026-06-02 04:45:37.192569615 +0000 UTC m=+188.740562435" lastFinishedPulling="2026-06-02 04:45:38.14823975 +0000 UTC m=+189.696232568" observedRunningTime="2026-06-02 04:45:39.575021611 +0000 UTC m=+191.123014445" watchObservedRunningTime="2026-06-02 04:45:39.576027536 +0000 UTC m=+191.124020373" Jun 02 04:45:39.720253 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.720153 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:39.864648 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:39.864582 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-784c68ddc5-nl6gf"] Jun 02 04:45:39.866692 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:39.866665 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod029e16e4_dcf9_4309_a4bd_bae1bd4d3e80.slice/crio-c0764092b8a3152cca6811b792dfe9ef6d741def5e60c29fba2b18c57a4ed686 WatchSource:0}: Error finding container c0764092b8a3152cca6811b792dfe9ef6d741def5e60c29fba2b18c57a4ed686: Status 404 returned error can't find the container with id c0764092b8a3152cca6811b792dfe9ef6d741def5e60c29fba2b18c57a4ed686 Jun 02 04:45:40.561287 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:40.561211 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" event={"ID":"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80","Type":"ContainerStarted","Data":"c0764092b8a3152cca6811b792dfe9ef6d741def5e60c29fba2b18c57a4ed686"} Jun 02 04:45:41.073513 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.073486 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx"] Jun 02 04:45:41.076529 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.076497 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" Jun 02 04:45:41.078782 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.078643 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 04:45:41.078782 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.078658 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-2w8hq\"" Jun 02 04:45:41.084743 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.084718 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx"] Jun 02 04:45:41.166981 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.166553 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3fb7970-46a2-47e5-963a-050cf7753abf-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-wm4qx\" (UID: \"e3fb7970-46a2-47e5-963a-050cf7753abf\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" Jun 02 04:45:41.268225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.268179 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3fb7970-46a2-47e5-963a-050cf7753abf-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-wm4qx\" (UID: \"e3fb7970-46a2-47e5-963a-050cf7753abf\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" Jun 02 04:45:41.268414 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:41.268351 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 04:45:41.268475 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:45:41.268437 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3fb7970-46a2-47e5-963a-050cf7753abf-monitoring-plugin-cert podName:e3fb7970-46a2-47e5-963a-050cf7753abf nodeName:}" failed. No retries permitted until 2026-06-02 04:45:41.768413812 +0000 UTC m=+193.316406628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e3fb7970-46a2-47e5-963a-050cf7753abf-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-wm4qx" (UID: "e3fb7970-46a2-47e5-963a-050cf7753abf") : secret "monitoring-plugin-cert" not found Jun 02 04:45:41.566243 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.566200 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerStarted","Data":"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd"} Jun 02 04:45:41.772859 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.772805 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3fb7970-46a2-47e5-963a-050cf7753abf-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-wm4qx\" (UID: \"e3fb7970-46a2-47e5-963a-050cf7753abf\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" Jun 02 04:45:41.775664 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:41.775644 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3fb7970-46a2-47e5-963a-050cf7753abf-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-wm4qx\" (UID: \"e3fb7970-46a2-47e5-963a-050cf7753abf\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" Jun 02 04:45:42.030134 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.030104 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" Jun 02 04:45:42.157240 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.157205 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx"] Jun 02 04:45:42.160154 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:42.160124 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fb7970_46a2_47e5_963a_050cf7753abf.slice/crio-588624953d21fa467debe66005cab9252e22dd67eba390359f578fed915f45c6 WatchSource:0}: Error finding container 588624953d21fa467debe66005cab9252e22dd67eba390359f578fed915f45c6: Status 404 returned error can't find the container with id 588624953d21fa467debe66005cab9252e22dd67eba390359f578fed915f45c6 Jun 02 04:45:42.572426 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.572393 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerStarted","Data":"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06"} Jun 02 04:45:42.572426 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.572436 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerStarted","Data":"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f"} Jun 02 04:45:42.572955 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.572451 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerStarted","Data":"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed"} Jun 02 04:45:42.572955 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.572466 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerStarted","Data":"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f"} Jun 02 04:45:42.574226 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.574197 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" event={"ID":"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80","Type":"ContainerStarted","Data":"0bc7ab4ba3bff62efd79c94c083e8e6d4c4076cf14e57fd1ecf27dd6ff5a8cb5"} Jun 02 04:45:42.574346 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.574233 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" event={"ID":"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80","Type":"ContainerStarted","Data":"e2c75d97e7520954911fbc97ef0d78d96d44bc3b610cbc8e36adf8bbf4d9a1a1"} Jun 02 04:45:42.574346 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.574247 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" event={"ID":"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80","Type":"ContainerStarted","Data":"f69674c2560eda3fd123bd484bef36ba2180f16abe5fce8b4323f21510883c01"} Jun 02 04:45:42.575270 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:42.575240 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" event={"ID":"e3fb7970-46a2-47e5-963a-050cf7753abf","Type":"ContainerStarted","Data":"588624953d21fa467debe66005cab9252e22dd67eba390359f578fed915f45c6"} Jun 02 04:45:43.581816 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:43.581769 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerStarted","Data":"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216"} Jun 02 04:45:43.585214 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:43.585184 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" event={"ID":"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80","Type":"ContainerStarted","Data":"ab83da58a36533192d647793a4e91220c5ca3970cc97210b23d24b90d995d0fc"} Jun 02 04:45:43.585214 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:43.585216 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" event={"ID":"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80","Type":"ContainerStarted","Data":"b934b52e57b505f3dbd7d96bea9172faa16ecafef2a3a4bd90c3d040a847f957"} Jun 02 04:45:43.585393 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:43.585228 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" event={"ID":"029e16e4-dcf9-4309-a4bd-bae1bd4d3e80","Type":"ContainerStarted","Data":"ecbee093d4fb08ba922e1c0c8043f86c91b7deabf5eac6e77f1d0a433b2c24c5"} Jun 02 04:45:43.585393 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:43.585376 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:43.615950 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:43.615889 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.346727353 podStartE2EDuration="6.615870816s" podCreationTimestamp="2026-06-02 04:45:37 +0000 UTC" firstStartedPulling="2026-06-02 04:45:38.423733322 +0000 UTC m=+189.971726134" lastFinishedPulling="2026-06-02 04:45:42.69287677 +0000 UTC m=+194.240869597" observedRunningTime="2026-06-02 04:45:43.61413065 +0000 UTC m=+195.162123485" watchObservedRunningTime="2026-06-02 04:45:43.615870816 +0000 UTC m=+195.163863842" Jun 02 04:45:43.641332 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:43.641264 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" podStartSLOduration=1.815532763 podStartE2EDuration="4.641244647s" podCreationTimestamp="2026-06-02 04:45:39 +0000 UTC" firstStartedPulling="2026-06-02 04:45:39.86862703 +0000 UTC m=+191.416619843" lastFinishedPulling="2026-06-02 04:45:42.694338915 +0000 UTC m=+194.242331727" observedRunningTime="2026-06-02 04:45:43.639461874 +0000 UTC m=+195.187454748" watchObservedRunningTime="2026-06-02 04:45:43.641244647 +0000 UTC m=+195.189237483" Jun 02 04:45:44.589651 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:44.589610 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" event={"ID":"e3fb7970-46a2-47e5-963a-050cf7753abf","Type":"ContainerStarted","Data":"dc563b5f03178cdaf89719e2a1d135e95190b557fa31d76936b2338825a3e9b7"} Jun 02 04:45:44.590139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:44.590096 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" Jun 02 04:45:44.594703 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:44.594670 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" Jun 02 04:45:44.607103 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:44.607059 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-wm4qx" podStartSLOduration=1.8660380170000002 podStartE2EDuration="3.607045272s" podCreationTimestamp="2026-06-02 04:45:41 +0000 UTC" firstStartedPulling="2026-06-02 04:45:42.162004963 +0000 UTC m=+193.709997777" lastFinishedPulling="2026-06-02 04:45:43.903012213 +0000 UTC m=+195.451005032" observedRunningTime="2026-06-02 04:45:44.606052382 +0000 UTC m=+196.154045216" watchObservedRunningTime="2026-06-02 04:45:44.607045272 +0000 UTC m=+196.155038107" Jun 02 04:45:46.960238 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:46.960200 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-847b749778-p68nz"] Jun 02 04:45:47.781702 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.781667 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-67b45f5fd-24w2g"] Jun 02 04:45:47.785060 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.785042 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:47.787275 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.787251 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 04:45:47.787383 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.787251 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 04:45:47.787383 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.787251 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 04:45:47.787870 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.787850 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 04:45:47.788037 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.787870 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 04:45:47.788145 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.787876 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 04:45:47.788145 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.787918 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 04:45:47.788145 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.787923 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vhwvf\"" Jun 02 04:45:47.795017 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.794998 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b45f5fd-24w2g"] Jun 02 04:45:47.925027 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.924986 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-serving-cert\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:47.925225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.925041 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-oauth-serving-cert\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:47.925225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.925059 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-service-ca\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:47.925225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.925076 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-config\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:47.925225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.925146 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-oauth-config\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:47.925225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:47.925194 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpfx4\" (UniqueName: \"kubernetes.io/projected/48d1c425-9d7b-469e-99b9-462ac80c7c7b-kube-api-access-cpfx4\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.026110 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.026061 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-oauth-config\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.026623 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.026116 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpfx4\" (UniqueName: \"kubernetes.io/projected/48d1c425-9d7b-469e-99b9-462ac80c7c7b-kube-api-access-cpfx4\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.026623 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.026205 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-serving-cert\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.026623 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.026248 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-oauth-serving-cert\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.026623 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.026267 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-service-ca\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.026623 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.026288 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-config\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.027006 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.026985 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-oauth-serving-cert\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.027061 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.027039 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-config\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.027138 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.027065 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-service-ca\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.029206 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.029182 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-oauth-config\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.029206 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.029193 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-serving-cert\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.042426 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.042359 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpfx4\" (UniqueName: \"kubernetes.io/projected/48d1c425-9d7b-469e-99b9-462ac80c7c7b-kube-api-access-cpfx4\") pod \"console-67b45f5fd-24w2g\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.095662 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.095634 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:48.228043 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.228012 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67b45f5fd-24w2g"] Jun 02 04:45:48.230649 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:45:48.230619 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d1c425_9d7b_469e_99b9_462ac80c7c7b.slice/crio-662f7f690376ace37ca9ba72d613900eed1399f104b6d79db2d1354df47a3989 WatchSource:0}: Error finding container 662f7f690376ace37ca9ba72d613900eed1399f104b6d79db2d1354df47a3989: Status 404 returned error can't find the container with id 662f7f690376ace37ca9ba72d613900eed1399f104b6d79db2d1354df47a3989 Jun 02 04:45:48.604824 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:48.604788 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b45f5fd-24w2g" event={"ID":"48d1c425-9d7b-469e-99b9-462ac80c7c7b","Type":"ContainerStarted","Data":"662f7f690376ace37ca9ba72d613900eed1399f104b6d79db2d1354df47a3989"} Jun 02 04:45:49.598989 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:49.598954 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-784c68ddc5-nl6gf" Jun 02 04:45:52.618469 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:52.618396 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b45f5fd-24w2g" event={"ID":"48d1c425-9d7b-469e-99b9-462ac80c7c7b","Type":"ContainerStarted","Data":"2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625"} Jun 02 04:45:52.639419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:52.639368 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-67b45f5fd-24w2g" podStartSLOduration=2.311127097 podStartE2EDuration="5.639353378s" podCreationTimestamp="2026-06-02 04:45:47 +0000 UTC" firstStartedPulling="2026-06-02 04:45:48.232564477 +0000 UTC m=+199.780557290" lastFinishedPulling="2026-06-02 04:45:51.560790745 +0000 UTC m=+203.108783571" observedRunningTime="2026-06-02 04:45:52.637526075 +0000 UTC m=+204.185518943" watchObservedRunningTime="2026-06-02 04:45:52.639353378 +0000 UTC m=+204.187346213" Jun 02 04:45:58.095896 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:58.095853 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:58.096286 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:58.095911 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:58.100638 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:58.100614 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:45:58.641454 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:45:58.641418 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:46:07.112254 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:07.112210 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b45f5fd-24w2g"] Jun 02 04:46:11.985360 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:11.985312 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-847b749778-p68nz" podUID="c14a94fc-c798-4f5a-813a-9004c00c0fdf" containerName="registry" containerID="cri-o://ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df" gracePeriod=30 Jun 02 04:46:12.231989 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.231963 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:46:12.239403 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239336 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14a94fc-c798-4f5a-813a-9004c00c0fdf-ca-trust-extracted\") pod \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " Jun 02 04:46:12.239403 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239383 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-installation-pull-secrets\") pod \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " Jun 02 04:46:12.239552 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239412 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-certificates\") pod \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " Jun 02 04:46:12.239552 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239463 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-trusted-ca\") pod \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " Jun 02 04:46:12.239552 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239488 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx7hq\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-kube-api-access-nx7hq\") pod \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " Jun 02 04:46:12.239552 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239522 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-image-registry-private-configuration\") pod \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " Jun 02 04:46:12.239552 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239549 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") pod \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " Jun 02 04:46:12.239871 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239575 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-bound-sa-token\") pod \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\" (UID: \"c14a94fc-c798-4f5a-813a-9004c00c0fdf\") " Jun 02 04:46:12.239965 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239936 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c14a94fc-c798-4f5a-813a-9004c00c0fdf" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:46:12.240023 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.239947 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c14a94fc-c798-4f5a-813a-9004c00c0fdf" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:46:12.240175 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.240155 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-trusted-ca\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:12.240251 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.240184 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-certificates\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:12.242366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.242299 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c14a94fc-c798-4f5a-813a-9004c00c0fdf" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:46:12.242610 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.242403 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c14a94fc-c798-4f5a-813a-9004c00c0fdf" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:46:12.242610 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.242530 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c14a94fc-c798-4f5a-813a-9004c00c0fdf" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:12.242751 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.242633 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c14a94fc-c798-4f5a-813a-9004c00c0fdf" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:12.242751 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.242680 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-kube-api-access-nx7hq" (OuterVolumeSpecName: "kube-api-access-nx7hq") pod "c14a94fc-c798-4f5a-813a-9004c00c0fdf" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf"). InnerVolumeSpecName "kube-api-access-nx7hq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:46:12.248101 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.248079 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c14a94fc-c798-4f5a-813a-9004c00c0fdf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c14a94fc-c798-4f5a-813a-9004c00c0fdf" (UID: "c14a94fc-c798-4f5a-813a-9004c00c0fdf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:46:12.341194 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.341149 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx7hq\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-kube-api-access-nx7hq\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:12.341194 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.341190 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-image-registry-private-configuration\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:12.341194 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.341205 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-registry-tls\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:12.341493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.341214 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c14a94fc-c798-4f5a-813a-9004c00c0fdf-bound-sa-token\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:12.341493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.341224 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c14a94fc-c798-4f5a-813a-9004c00c0fdf-ca-trust-extracted\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:12.341493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.341233 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c14a94fc-c798-4f5a-813a-9004c00c0fdf-installation-pull-secrets\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:12.677958 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.677924 2582 generic.go:358] "Generic (PLEG): container finished" podID="c14a94fc-c798-4f5a-813a-9004c00c0fdf" containerID="ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df" exitCode=0 Jun 02 04:46:12.678137 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.678013 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-847b749778-p68nz" event={"ID":"c14a94fc-c798-4f5a-813a-9004c00c0fdf","Type":"ContainerDied","Data":"ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df"} Jun 02 04:46:12.678137 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.678029 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847b749778-p68nz" Jun 02 04:46:12.678137 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.678065 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-847b749778-p68nz" event={"ID":"c14a94fc-c798-4f5a-813a-9004c00c0fdf","Type":"ContainerDied","Data":"31c8f9bd67c4b58303666c611b28052e6f164ef74346100675becf3dae053435"} Jun 02 04:46:12.678137 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.678081 2582 scope.go:117] "RemoveContainer" containerID="ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df" Jun 02 04:46:12.686385 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.686367 2582 scope.go:117] "RemoveContainer" containerID="ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df" Jun 02 04:46:12.686673 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:12.686653 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df\": container with ID starting with ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df not found: ID does not exist" containerID="ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df" Jun 02 04:46:12.686745 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.686686 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df"} err="failed to get container status \"ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df\": rpc error: code = NotFound desc = could not find container \"ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df\": container with ID starting with ca9f826ac62345147bc557bfe91db84a7356aefc8960c0f47a9f3ba75aeaf9df not found: ID does not exist" Jun 02 04:46:12.702224 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.702190 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-847b749778-p68nz"] Jun 02 04:46:12.708127 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:12.708101 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-847b749778-p68nz"] Jun 02 04:46:13.008269 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:13.008177 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14a94fc-c798-4f5a-813a-9004c00c0fdf" path="/var/lib/kubelet/pods/c14a94fc-c798-4f5a-813a-9004c00c0fdf/volumes" Jun 02 04:46:21.706798 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:21.706760 2582 generic.go:358] "Generic (PLEG): container finished" podID="7726b5ba-197e-4879-baee-9bbaf52ec489" containerID="d64fe11ebb3e1552f990c5632fa2e765948bf836db841fc71d530ecad2ef1382" exitCode=0 Jun 02 04:46:21.707186 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:21.706816 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-8sb54" event={"ID":"7726b5ba-197e-4879-baee-9bbaf52ec489","Type":"ContainerDied","Data":"d64fe11ebb3e1552f990c5632fa2e765948bf836db841fc71d530ecad2ef1382"} Jun 02 04:46:21.707234 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:21.707195 2582 scope.go:117] "RemoveContainer" containerID="d64fe11ebb3e1552f990c5632fa2e765948bf836db841fc71d530ecad2ef1382" Jun 02 04:46:22.711491 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:22.711455 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-8sb54" event={"ID":"7726b5ba-197e-4879-baee-9bbaf52ec489","Type":"ContainerStarted","Data":"ae53cdd963554b8d63e105c9176ecbe813c07b7751333304db2642f473c05eac"} Jun 02 04:46:29.733666 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:29.733580 2582 generic.go:358] "Generic (PLEG): container finished" podID="f2a95b92-40b9-467e-906e-66ff5228a3fc" containerID="73c21a483d84e5018d2a28e6bcb132b5860137e65b00cbe32f325205707e2a3f" exitCode=0 Jun 02 04:46:29.733666 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:29.733653 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" event={"ID":"f2a95b92-40b9-467e-906e-66ff5228a3fc","Type":"ContainerDied","Data":"73c21a483d84e5018d2a28e6bcb132b5860137e65b00cbe32f325205707e2a3f"} Jun 02 04:46:29.734093 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:29.733983 2582 scope.go:117] "RemoveContainer" containerID="73c21a483d84e5018d2a28e6bcb132b5860137e65b00cbe32f325205707e2a3f" Jun 02 04:46:30.738379 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:30.738339 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-72kbd" event={"ID":"f2a95b92-40b9-467e-906e-66ff5228a3fc","Type":"ContainerStarted","Data":"365d8edc5bbdeab8b75c34353c594247be0b3c374eac5997abf78da329af33a4"} Jun 02 04:46:32.133425 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.133360 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-67b45f5fd-24w2g" podUID="48d1c425-9d7b-469e-99b9-462ac80c7c7b" containerName="console" containerID="cri-o://2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625" gracePeriod=15 Jun 02 04:46:32.379082 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.379058 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67b45f5fd-24w2g_48d1c425-9d7b-469e-99b9-462ac80c7c7b/console/0.log" Jun 02 04:46:32.379208 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.379139 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:46:32.519768 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.519676 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-service-ca\") pod \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " Jun 02 04:46:32.519768 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.519728 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-oauth-config\") pod \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " Jun 02 04:46:32.519768 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.519752 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpfx4\" (UniqueName: \"kubernetes.io/projected/48d1c425-9d7b-469e-99b9-462ac80c7c7b-kube-api-access-cpfx4\") pod \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " Jun 02 04:46:32.520078 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.519780 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-config\") pod \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " Jun 02 04:46:32.520078 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.519873 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-serving-cert\") pod \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " Jun 02 04:46:32.520078 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.519998 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-oauth-serving-cert\") pod \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\" (UID: \"48d1c425-9d7b-469e-99b9-462ac80c7c7b\") " Jun 02 04:46:32.520239 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.520089 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-service-ca" (OuterVolumeSpecName: "service-ca") pod "48d1c425-9d7b-469e-99b9-462ac80c7c7b" (UID: "48d1c425-9d7b-469e-99b9-462ac80c7c7b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:46:32.520239 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.520167 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-config" (OuterVolumeSpecName: "console-config") pod "48d1c425-9d7b-469e-99b9-462ac80c7c7b" (UID: "48d1c425-9d7b-469e-99b9-462ac80c7c7b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:46:32.520455 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.520384 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "48d1c425-9d7b-469e-99b9-462ac80c7c7b" (UID: "48d1c425-9d7b-469e-99b9-462ac80c7c7b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:46:32.520455 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.520391 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-service-ca\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:32.520455 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.520451 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-config\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:32.522686 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.522654 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "48d1c425-9d7b-469e-99b9-462ac80c7c7b" (UID: "48d1c425-9d7b-469e-99b9-462ac80c7c7b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:32.522844 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.522702 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "48d1c425-9d7b-469e-99b9-462ac80c7c7b" (UID: "48d1c425-9d7b-469e-99b9-462ac80c7c7b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:32.522844 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.522722 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d1c425-9d7b-469e-99b9-462ac80c7c7b-kube-api-access-cpfx4" (OuterVolumeSpecName: "kube-api-access-cpfx4") pod "48d1c425-9d7b-469e-99b9-462ac80c7c7b" (UID: "48d1c425-9d7b-469e-99b9-462ac80c7c7b"). InnerVolumeSpecName "kube-api-access-cpfx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:46:32.621593 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.621560 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48d1c425-9d7b-469e-99b9-462ac80c7c7b-oauth-serving-cert\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:32.621593 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.621587 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-oauth-config\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:32.621593 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.621597 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpfx4\" (UniqueName: \"kubernetes.io/projected/48d1c425-9d7b-469e-99b9-462ac80c7c7b-kube-api-access-cpfx4\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:32.621593 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.621606 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48d1c425-9d7b-469e-99b9-462ac80c7c7b-console-serving-cert\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:32.746704 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.746667 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67b45f5fd-24w2g_48d1c425-9d7b-469e-99b9-462ac80c7c7b/console/0.log" Jun 02 04:46:32.746905 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.746718 2582 generic.go:358] "Generic (PLEG): container finished" podID="48d1c425-9d7b-469e-99b9-462ac80c7c7b" containerID="2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625" exitCode=2 Jun 02 04:46:32.746905 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.746751 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b45f5fd-24w2g" event={"ID":"48d1c425-9d7b-469e-99b9-462ac80c7c7b","Type":"ContainerDied","Data":"2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625"} Jun 02 04:46:32.746905 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.746800 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67b45f5fd-24w2g" event={"ID":"48d1c425-9d7b-469e-99b9-462ac80c7c7b","Type":"ContainerDied","Data":"662f7f690376ace37ca9ba72d613900eed1399f104b6d79db2d1354df47a3989"} Jun 02 04:46:32.746905 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.746800 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67b45f5fd-24w2g" Jun 02 04:46:32.746905 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.746812 2582 scope.go:117] "RemoveContainer" containerID="2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625" Jun 02 04:46:32.757429 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.757254 2582 scope.go:117] "RemoveContainer" containerID="2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625" Jun 02 04:46:32.757645 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:32.757622 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625\": container with ID starting with 2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625 not found: ID does not exist" containerID="2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625" Jun 02 04:46:32.757741 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.757654 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625"} err="failed to get container status \"2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625\": rpc error: code = NotFound desc = could not find container \"2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625\": container with ID starting with 2c677d46aaec9bba019d14654248ad2eb03c85664ac06bc004ed2c55680a7625 not found: ID does not exist" Jun 02 04:46:32.770486 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.770406 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67b45f5fd-24w2g"] Jun 02 04:46:32.773523 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:32.773499 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67b45f5fd-24w2g"] Jun 02 04:46:33.008696 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:33.008663 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48d1c425-9d7b-469e-99b9-462ac80c7c7b" path="/var/lib/kubelet/pods/48d1c425-9d7b-469e-99b9-462ac80c7c7b/volumes" Jun 02 04:46:40.899255 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:40.899200 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:46:40.901718 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:40.901691 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/401fe11a-e1ab-48a1-9211-60714444024a-metrics-certs\") pod \"network-metrics-daemon-pq546\" (UID: \"401fe11a-e1ab-48a1-9211-60714444024a\") " pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:46:41.007298 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:41.007267 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2ckqz\"" Jun 02 04:46:41.015050 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:41.015025 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pq546" Jun 02 04:46:41.168222 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:41.168081 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pq546"] Jun 02 04:46:41.170404 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:46:41.170378 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401fe11a_e1ab_48a1_9211_60714444024a.slice/crio-d600a3dfcb5bc8009604b2bc6e3c21f573e35cd36f18eba9f98470bcda569f72 WatchSource:0}: Error finding container d600a3dfcb5bc8009604b2bc6e3c21f573e35cd36f18eba9f98470bcda569f72: Status 404 returned error can't find the container with id d600a3dfcb5bc8009604b2bc6e3c21f573e35cd36f18eba9f98470bcda569f72 Jun 02 04:46:41.779566 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:41.779521 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pq546" event={"ID":"401fe11a-e1ab-48a1-9211-60714444024a","Type":"ContainerStarted","Data":"d600a3dfcb5bc8009604b2bc6e3c21f573e35cd36f18eba9f98470bcda569f72"} Jun 02 04:46:42.784126 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:42.784090 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pq546" event={"ID":"401fe11a-e1ab-48a1-9211-60714444024a","Type":"ContainerStarted","Data":"1ae2a38ce7a916641dc1f6890affa06c23058686a1d331f4cfd216845d4ae59d"} Jun 02 04:46:42.784126 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:42.784129 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pq546" event={"ID":"401fe11a-e1ab-48a1-9211-60714444024a","Type":"ContainerStarted","Data":"ec190fc2023c30156473eba4bd48252bfd3d50e43dab77b77d82b49c82df266d"} Jun 02 04:46:42.802492 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:42.802409 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pq546" podStartSLOduration=252.803257538 podStartE2EDuration="4m13.802386409s" podCreationTimestamp="2026-06-02 04:42:29 +0000 UTC" firstStartedPulling="2026-06-02 04:46:41.172264213 +0000 UTC m=+252.720257041" lastFinishedPulling="2026-06-02 04:46:42.171393095 +0000 UTC m=+253.719385912" observedRunningTime="2026-06-02 04:46:42.801560008 +0000 UTC m=+254.349552843" watchObservedRunningTime="2026-06-02 04:46:42.802386409 +0000 UTC m=+254.350379247" Jun 02 04:46:56.828847 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:56.828807 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:46:56.829338 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:56.829257 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="alertmanager" containerID="cri-o://ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd" gracePeriod=120 Jun 02 04:46:56.829409 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:56.829333 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy-web" containerID="cri-o://c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed" gracePeriod=120 Jun 02 04:46:56.829409 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:56.829392 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="prom-label-proxy" containerID="cri-o://b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216" gracePeriod=120 Jun 02 04:46:56.829513 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:56.829364 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="config-reloader" containerID="cri-o://c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f" gracePeriod=120 Jun 02 04:46:56.829513 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:56.829423 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy" containerID="cri-o://30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f" gracePeriod=120 Jun 02 04:46:56.829513 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:56.829337 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy-metric" containerID="cri-o://d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06" gracePeriod=120 Jun 02 04:46:57.829293 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:57.829261 2582 generic.go:358] "Generic (PLEG): container finished" podID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerID="b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216" exitCode=0 Jun 02 04:46:57.829293 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:57.829288 2582 generic.go:358] "Generic (PLEG): container finished" podID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerID="30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f" exitCode=0 Jun 02 04:46:57.829293 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:57.829296 2582 generic.go:358] "Generic (PLEG): container finished" podID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerID="c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f" exitCode=0 Jun 02 04:46:57.829293 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:57.829304 2582 generic.go:358] "Generic (PLEG): container finished" podID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerID="ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd" exitCode=0 Jun 02 04:46:57.829750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:57.829327 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerDied","Data":"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216"} Jun 02 04:46:57.829750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:57.829357 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerDied","Data":"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f"} Jun 02 04:46:57.829750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:57.829366 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerDied","Data":"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f"} Jun 02 04:46:57.829750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:57.829375 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerDied","Data":"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd"} Jun 02 04:46:58.079886 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.079814 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.242941 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.242908 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-volume\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.242941 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.242942 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-cluster-tls-config\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.242963 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-web-config\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.242996 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243015 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243048 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-main-tls\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243079 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-web\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243114 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28825\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-kube-api-access-28825\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243142 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-out\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243185 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243182 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-metrics-client-ca\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243562 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243237 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243562 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243271 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-tls-assets\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.243562 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243330 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-main-db\") pod \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\" (UID: \"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c\") " Jun 02 04:46:58.244413 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.243879 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:46:58.244413 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.244064 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:46:58.244413 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.244239 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:46:58.247702 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.247668 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:58.248118 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.248088 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-volume" (OuterVolumeSpecName: "config-volume") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:58.248232 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.248164 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:46:58.248444 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.248408 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:58.248550 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.248508 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:58.249211 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.249185 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:58.249321 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.249278 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-kube-api-access-28825" (OuterVolumeSpecName: "kube-api-access-28825") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "kube-api-access-28825". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:46:58.249385 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.249365 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-out" (OuterVolumeSpecName: "config-out") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:46:58.252208 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.252175 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:58.259431 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.259408 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-web-config" (OuterVolumeSpecName: "web-config") pod "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" (UID: "bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:46:58.344172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344085 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-main-db\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344117 2582 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-volume\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344126 2582 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-cluster-tls-config\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344136 2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-web-config\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344146 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344155 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344165 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-main-tls\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344172 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344174 2582 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344499 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344183 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28825\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-kube-api-access-28825\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344499 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344192 2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-config-out\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344499 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344200 2582 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-metrics-client-ca\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344499 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344208 2582 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.344499 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.344216 2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c-tls-assets\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:46:58.835406 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.835376 2582 generic.go:358] "Generic (PLEG): container finished" podID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerID="d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06" exitCode=0 Jun 02 04:46:58.835406 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.835402 2582 generic.go:358] "Generic (PLEG): container finished" podID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerID="c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed" exitCode=0 Jun 02 04:46:58.835889 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.835459 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerDied","Data":"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06"} Jun 02 04:46:58.835889 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.835482 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.835889 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.835503 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerDied","Data":"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed"} Jun 02 04:46:58.835889 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.835520 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c","Type":"ContainerDied","Data":"57d18c2e80b96b8fcbea0ebce018be92febb4e6f1367ac1d54ce6cbe0568a53b"} Jun 02 04:46:58.835889 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.835536 2582 scope.go:117] "RemoveContainer" containerID="b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216" Jun 02 04:46:58.844097 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.844070 2582 scope.go:117] "RemoveContainer" containerID="d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06" Jun 02 04:46:58.851419 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.851399 2582 scope.go:117] "RemoveContainer" containerID="30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f" Jun 02 04:46:58.857927 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.857911 2582 scope.go:117] "RemoveContainer" containerID="c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed" Jun 02 04:46:58.864371 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.864351 2582 scope.go:117] "RemoveContainer" containerID="c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f" Jun 02 04:46:58.867168 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.867141 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:46:58.871789 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.871755 2582 scope.go:117] "RemoveContainer" containerID="ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd" Jun 02 04:46:58.873479 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.873460 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:46:58.878928 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.878911 2582 scope.go:117] "RemoveContainer" containerID="71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14" Jun 02 04:46:58.885655 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.885631 2582 scope.go:117] "RemoveContainer" containerID="b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216" Jun 02 04:46:58.885947 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:58.885927 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216\": container with ID starting with b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216 not found: ID does not exist" containerID="b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216" Jun 02 04:46:58.886031 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.885961 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216"} err="failed to get container status \"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216\": rpc error: code = NotFound desc = could not find container \"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216\": container with ID starting with b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216 not found: ID does not exist" Jun 02 04:46:58.886031 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.885988 2582 scope.go:117] "RemoveContainer" containerID="d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06" Jun 02 04:46:58.886242 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:58.886224 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06\": container with ID starting with d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06 not found: ID does not exist" containerID="d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06" Jun 02 04:46:58.886306 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.886249 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06"} err="failed to get container status \"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06\": rpc error: code = NotFound desc = could not find container \"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06\": container with ID starting with d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06 not found: ID does not exist" Jun 02 04:46:58.886306 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.886268 2582 scope.go:117] "RemoveContainer" containerID="30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f" Jun 02 04:46:58.886504 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:58.886485 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f\": container with ID starting with 30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f not found: ID does not exist" containerID="30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f" Jun 02 04:46:58.886539 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.886511 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f"} err="failed to get container status \"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f\": rpc error: code = NotFound desc = could not find container \"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f\": container with ID starting with 30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f not found: ID does not exist" Jun 02 04:46:58.886539 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.886528 2582 scope.go:117] "RemoveContainer" containerID="c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed" Jun 02 04:46:58.886736 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:58.886721 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed\": container with ID starting with c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed not found: ID does not exist" containerID="c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed" Jun 02 04:46:58.886780 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.886739 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed"} err="failed to get container status \"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed\": rpc error: code = NotFound desc = could not find container \"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed\": container with ID starting with c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed not found: ID does not exist" Jun 02 04:46:58.886780 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.886751 2582 scope.go:117] "RemoveContainer" containerID="c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f" Jun 02 04:46:58.887016 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:58.886998 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f\": container with ID starting with c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f not found: ID does not exist" containerID="c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f" Jun 02 04:46:58.887072 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887029 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f"} err="failed to get container status \"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f\": rpc error: code = NotFound desc = could not find container \"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f\": container with ID starting with c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f not found: ID does not exist" Jun 02 04:46:58.887072 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887044 2582 scope.go:117] "RemoveContainer" containerID="ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd" Jun 02 04:46:58.887277 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:58.887261 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd\": container with ID starting with ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd not found: ID does not exist" containerID="ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd" Jun 02 04:46:58.887318 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887281 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd"} err="failed to get container status \"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd\": rpc error: code = NotFound desc = could not find container \"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd\": container with ID starting with ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd not found: ID does not exist" Jun 02 04:46:58.887318 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887296 2582 scope.go:117] "RemoveContainer" containerID="71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14" Jun 02 04:46:58.887510 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:46:58.887493 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14\": container with ID starting with 71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14 not found: ID does not exist" containerID="71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14" Jun 02 04:46:58.887554 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887515 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14"} err="failed to get container status \"71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14\": rpc error: code = NotFound desc = could not find container \"71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14\": container with ID starting with 71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14 not found: ID does not exist" Jun 02 04:46:58.887554 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887531 2582 scope.go:117] "RemoveContainer" containerID="b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216" Jun 02 04:46:58.887750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887728 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216"} err="failed to get container status \"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216\": rpc error: code = NotFound desc = could not find container \"b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216\": container with ID starting with b9909dfe5bf9e6192c8390707360c335176cad0219d1f5b91cf558c669dfa216 not found: ID does not exist" Jun 02 04:46:58.887817 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887753 2582 scope.go:117] "RemoveContainer" containerID="d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06" Jun 02 04:46:58.887998 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887980 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06"} err="failed to get container status \"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06\": rpc error: code = NotFound desc = could not find container \"d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06\": container with ID starting with d2dbff81507812fd3c8284df80c2fd964fb44f32322e6df69ce965a785576e06 not found: ID does not exist" Jun 02 04:46:58.888046 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.887999 2582 scope.go:117] "RemoveContainer" containerID="30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f" Jun 02 04:46:58.888218 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888179 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f"} err="failed to get container status \"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f\": rpc error: code = NotFound desc = could not find container \"30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f\": container with ID starting with 30b7868cf2a54f95e3409445a714f2999403e043bfea4eaf97c0dd52a03af89f not found: ID does not exist" Jun 02 04:46:58.888218 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888191 2582 scope.go:117] "RemoveContainer" containerID="c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed" Jun 02 04:46:58.888367 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888353 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed"} err="failed to get container status \"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed\": rpc error: code = NotFound desc = could not find container \"c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed\": container with ID starting with c6a5848cb89c478b6790897e12b750b05fc553f77b3cd39696dafcd7112910ed not found: ID does not exist" Jun 02 04:46:58.888408 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888368 2582 scope.go:117] "RemoveContainer" containerID="c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f" Jun 02 04:46:58.888539 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888523 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f"} err="failed to get container status \"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f\": rpc error: code = NotFound desc = could not find container \"c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f\": container with ID starting with c8f0470b0f367caf95f219dc0e0242fe83486d8b96f5b88840060dd8bd19b03f not found: ID does not exist" Jun 02 04:46:58.888586 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888538 2582 scope.go:117] "RemoveContainer" containerID="ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd" Jun 02 04:46:58.888731 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888713 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd"} err="failed to get container status \"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd\": rpc error: code = NotFound desc = could not find container \"ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd\": container with ID starting with ed03007aedc3836609d9838b78a7857ac19291d21c859d5a90fdd04fcdb56ebd not found: ID does not exist" Jun 02 04:46:58.888798 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888733 2582 scope.go:117] "RemoveContainer" containerID="71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14" Jun 02 04:46:58.888948 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.888933 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14"} err="failed to get container status \"71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14\": rpc error: code = NotFound desc = could not find container \"71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14\": container with ID starting with 71ecc8ebe689bdcf2316fcdd0e69c261b77a810912bae40a0057657da79a3f14 not found: ID does not exist" Jun 02 04:46:58.904396 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904370 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:46:58.904707 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904691 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy" Jun 02 04:46:58.904781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904710 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy" Jun 02 04:46:58.904781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904726 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="config-reloader" Jun 02 04:46:58.904781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904736 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="config-reloader" Jun 02 04:46:58.904781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904748 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="prom-label-proxy" Jun 02 04:46:58.904781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904756 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="prom-label-proxy" Jun 02 04:46:58.904781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904766 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d1c425-9d7b-469e-99b9-462ac80c7c7b" containerName="console" Jun 02 04:46:58.904781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904774 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d1c425-9d7b-469e-99b9-462ac80c7c7b" containerName="console" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904793 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="init-config-reloader" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904802 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="init-config-reloader" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904811 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="alertmanager" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904821 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="alertmanager" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904858 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy-metric" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904866 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy-metric" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904879 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy-web" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904887 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy-web" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904900 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14a94fc-c798-4f5a-813a-9004c00c0fdf" containerName="registry" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904907 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14a94fc-c798-4f5a-813a-9004c00c0fdf" containerName="registry" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.904994 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="c14a94fc-c798-4f5a-813a-9004c00c0fdf" containerName="registry" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.905008 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy-web" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.905019 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.905029 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="prom-label-proxy" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.905039 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="config-reloader" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.905049 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="kube-rbac-proxy-metric" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.905060 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" containerName="alertmanager" Jun 02 04:46:58.905139 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.905071 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="48d1c425-9d7b-469e-99b9-462ac80c7c7b" containerName="console" Jun 02 04:46:58.910398 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.910377 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.912881 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.912857 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 04:46:58.912881 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.912878 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 04:46:58.913023 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.912899 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6lk67\"" Jun 02 04:46:58.913023 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.912903 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 04:46:58.913234 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.913218 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 04:46:58.913405 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.913385 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 04:46:58.913717 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.913704 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 04:46:58.913757 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.913727 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 04:46:58.913989 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.913975 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 04:46:58.924533 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.922380 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 04:46:58.926719 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.926695 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:46:58.949596 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949596 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-web-config\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949653 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949691 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d49406e-265f-4759-966c-0928c916e1a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949881 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d49406e-265f-4759-966c-0928c916e1a0-config-out\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949881 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949807 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949881 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949824 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d49406e-265f-4759-966c-0928c916e1a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949981 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949899 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d49406e-265f-4759-966c-0928c916e1a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949981 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949922 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqjn6\" (UniqueName: \"kubernetes.io/projected/0d49406e-265f-4759-966c-0928c916e1a0-kube-api-access-cqjn6\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.949981 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949977 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.950071 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.949997 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:58.950071 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:58.950027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d49406e-265f-4759-966c-0928c916e1a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.008183 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.008146 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c" path="/var/lib/kubelet/pods/bcc62bae-6e04-4cf6-a34d-e5bf7ddec29c/volumes" Jun 02 04:46:59.050358 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050326 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.050358 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050361 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.050604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050378 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d49406e-265f-4759-966c-0928c916e1a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.050604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050413 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d49406e-265f-4759-966c-0928c916e1a0-config-out\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.050604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050456 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.050604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050475 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d49406e-265f-4759-966c-0928c916e1a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.050604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050509 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d49406e-265f-4759-966c-0928c916e1a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.050604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050532 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cqjn6\" (UniqueName: \"kubernetes.io/projected/0d49406e-265f-4759-966c-0928c916e1a0-kube-api-access-cqjn6\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.050604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050585 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.051251 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050615 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.051251 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050638 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d49406e-265f-4759-966c-0928c916e1a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.051251 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050665 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.051251 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050687 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-web-config\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.051251 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.050820 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0d49406e-265f-4759-966c-0928c916e1a0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.052145 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.052043 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d49406e-265f-4759-966c-0928c916e1a0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.052784 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.052737 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d49406e-265f-4759-966c-0928c916e1a0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.053782 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.053730 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d49406e-265f-4759-966c-0928c916e1a0-config-out\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.054422 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.054377 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-config-volume\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.054422 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.054387 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.054583 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.054422 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-web-config\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.054583 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.054501 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.054704 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.054677 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.054999 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.054984 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.055073 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.055052 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d49406e-265f-4759-966c-0928c916e1a0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.055931 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.055916 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0d49406e-265f-4759-966c-0928c916e1a0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.064704 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.064679 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqjn6\" (UniqueName: \"kubernetes.io/projected/0d49406e-265f-4759-966c-0928c916e1a0-kube-api-access-cqjn6\") pod \"alertmanager-main-0\" (UID: \"0d49406e-265f-4759-966c-0928c916e1a0\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.225670 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.225575 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 04:46:59.359719 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.359686 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 04:46:59.362480 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:46:59.362448 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d49406e_265f_4759_966c_0928c916e1a0.slice/crio-d44cd397ae0bb870ddda039e16a330f7f5a6fb778831839e757b363614832e9d WatchSource:0}: Error finding container d44cd397ae0bb870ddda039e16a330f7f5a6fb778831839e757b363614832e9d: Status 404 returned error can't find the container with id d44cd397ae0bb870ddda039e16a330f7f5a6fb778831839e757b363614832e9d Jun 02 04:46:59.840145 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.840111 2582 generic.go:358] "Generic (PLEG): container finished" podID="0d49406e-265f-4759-966c-0928c916e1a0" containerID="96f0055817648a15e9b183307afb69b421a4710b7a74f74523a2a9791c3400bd" exitCode=0 Jun 02 04:46:59.840584 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.840168 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d49406e-265f-4759-966c-0928c916e1a0","Type":"ContainerDied","Data":"96f0055817648a15e9b183307afb69b421a4710b7a74f74523a2a9791c3400bd"} Jun 02 04:46:59.840584 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:46:59.840197 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d49406e-265f-4759-966c-0928c916e1a0","Type":"ContainerStarted","Data":"d44cd397ae0bb870ddda039e16a330f7f5a6fb778831839e757b363614832e9d"} Jun 02 04:47:00.846724 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.846684 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d49406e-265f-4759-966c-0928c916e1a0","Type":"ContainerStarted","Data":"3b8e64bbe9efd8fb07fb2f8d5dac0aca01b489b6f2d944395998251e4b039963"} Jun 02 04:47:00.847143 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.846730 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d49406e-265f-4759-966c-0928c916e1a0","Type":"ContainerStarted","Data":"7cc531d7d36159c07cc1ca66a6f99498b971636521d6a784cd40fc6db776a57d"} Jun 02 04:47:00.847143 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.846743 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d49406e-265f-4759-966c-0928c916e1a0","Type":"ContainerStarted","Data":"bf77843768789815cee8b5bd50682d8829bb53a0335f509678924c9e18f41282"} Jun 02 04:47:00.847143 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.846756 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d49406e-265f-4759-966c-0928c916e1a0","Type":"ContainerStarted","Data":"ea6aa397f44a06f0fcbabeb632e93186d454a06410c1204bd5b6aa9108aa3733"} Jun 02 04:47:00.847143 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.846768 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d49406e-265f-4759-966c-0928c916e1a0","Type":"ContainerStarted","Data":"297fd8b422b51702116d5b96a5f7fdba1d46587f90f048010207251117299283"} Jun 02 04:47:00.847143 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.846781 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0d49406e-265f-4759-966c-0928c916e1a0","Type":"ContainerStarted","Data":"a7a3e7f2fd95772f383e8edbaeb5adcc412b5a697754717c2928ad080f09b5c6"} Jun 02 04:47:00.889804 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.889757 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.889744169 podStartE2EDuration="2.889744169s" podCreationTimestamp="2026-06-02 04:46:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:47:00.888269714 +0000 UTC m=+272.436262552" watchObservedRunningTime="2026-06-02 04:47:00.889744169 +0000 UTC m=+272.437737004" Jun 02 04:47:00.917583 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.917544 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c7457df66-bmz79"] Jun 02 04:47:00.921297 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.921274 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:00.927851 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.927798 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 04:47:00.928521 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.928496 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 04:47:00.928521 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.928518 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 04:47:00.928712 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.928522 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 04:47:00.928803 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.928783 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rlqcl\"" Jun 02 04:47:00.928942 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.928785 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 04:47:00.943246 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.943222 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7457df66-bmz79"] Jun 02 04:47:00.957640 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.957614 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 04:47:00.968718 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.968687 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-federate-client-tls\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:00.968916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.968725 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:00.968916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.968744 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-metrics-client-ca\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:00.968916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.968809 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-serving-certs-ca-bundle\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:00.968916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.968868 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-telemeter-client-tls\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:00.968916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.968885 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-secret-telemeter-client\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:00.968916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.968907 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8d6m\" (UniqueName: \"kubernetes.io/projected/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-kube-api-access-k8d6m\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:00.969255 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:00.969027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.070357 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.070304 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-telemeter-client-tls\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.070357 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.070368 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-secret-telemeter-client\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.070622 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.070413 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8d6m\" (UniqueName: \"kubernetes.io/projected/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-kube-api-access-k8d6m\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.070622 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.070496 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.070622 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.070529 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-federate-client-tls\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.070622 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.070560 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.070622 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.070585 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-metrics-client-ca\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.070914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.070637 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-serving-certs-ca-bundle\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.071576 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.071548 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-serving-certs-ca-bundle\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.071683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.071611 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-metrics-client-ca\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.071808 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.071782 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.073225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.073197 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.073346 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.073332 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-secret-telemeter-client\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.073389 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.073357 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-telemeter-client-tls\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.073502 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.073479 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-federate-client-tls\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.083744 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.083718 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8d6m\" (UniqueName: \"kubernetes.io/projected/c033e0d0-77e2-4727-9cb8-d01f786fdfa2-kube-api-access-k8d6m\") pod \"telemeter-client-5c7457df66-bmz79\" (UID: \"c033e0d0-77e2-4727-9cb8-d01f786fdfa2\") " pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.232762 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.232670 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" Jun 02 04:47:01.386840 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.386800 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7457df66-bmz79"] Jun 02 04:47:01.387685 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:47:01.387653 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc033e0d0_77e2_4727_9cb8_d01f786fdfa2.slice/crio-d8bde1b165676c3aa3f337fc43de560d7a990ea330eff21c8e2f88dcf9ec61c7 WatchSource:0}: Error finding container d8bde1b165676c3aa3f337fc43de560d7a990ea330eff21c8e2f88dcf9ec61c7: Status 404 returned error can't find the container with id d8bde1b165676c3aa3f337fc43de560d7a990ea330eff21c8e2f88dcf9ec61c7 Jun 02 04:47:01.851262 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:01.851214 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" event={"ID":"c033e0d0-77e2-4727-9cb8-d01f786fdfa2","Type":"ContainerStarted","Data":"d8bde1b165676c3aa3f337fc43de560d7a990ea330eff21c8e2f88dcf9ec61c7"} Jun 02 04:47:04.863739 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:04.863703 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" event={"ID":"c033e0d0-77e2-4727-9cb8-d01f786fdfa2","Type":"ContainerStarted","Data":"5342742912c0eec0849bdbf600cb507e91e90914919803353980dd9ecdc2144b"} Jun 02 04:47:04.863739 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:04.863745 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" event={"ID":"c033e0d0-77e2-4727-9cb8-d01f786fdfa2","Type":"ContainerStarted","Data":"366ff13ae9b7c5c9e2642bee897d1bfec63eb4518563120b77b17d3eec182b70"} Jun 02 04:47:04.864207 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:04.863760 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" event={"ID":"c033e0d0-77e2-4727-9cb8-d01f786fdfa2","Type":"ContainerStarted","Data":"8a5e7b148195774f028e0e536b2ca20ea3d26a568cad187d40dc4a64678cc246"} Jun 02 04:47:04.886561 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:04.886512 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c7457df66-bmz79" podStartSLOduration=2.479269868 podStartE2EDuration="4.886494779s" podCreationTimestamp="2026-06-02 04:47:00 +0000 UTC" firstStartedPulling="2026-06-02 04:47:01.389734214 +0000 UTC m=+272.937727027" lastFinishedPulling="2026-06-02 04:47:03.796959122 +0000 UTC m=+275.344951938" observedRunningTime="2026-06-02 04:47:04.886139063 +0000 UTC m=+276.434131893" watchObservedRunningTime="2026-06-02 04:47:04.886494779 +0000 UTC m=+276.434487615" Jun 02 04:47:05.643214 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.643178 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-75967867d6-4lqkh"] Jun 02 04:47:05.646918 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.646895 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.649562 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.649534 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 04:47:05.649687 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.649540 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 04:47:05.649687 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.649632 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 04:47:05.649851 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.649785 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 04:47:05.650224 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.650206 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vhwvf\"" Jun 02 04:47:05.650334 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.650316 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 04:47:05.650402 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.650343 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 04:47:05.650683 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.650663 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 04:47:05.654944 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.654807 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 04:47:05.659468 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.659382 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75967867d6-4lqkh"] Jun 02 04:47:05.712741 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.712707 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdkxh\" (UniqueName: \"kubernetes.io/projected/a08d7879-6e67-44cf-91c7-8f069fd849c0-kube-api-access-fdkxh\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.712908 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.712754 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-serving-cert\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.712908 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.712775 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-service-ca\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.712908 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.712847 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-oauth-config\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.712908 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.712876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-trusted-ca-bundle\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.713095 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.712931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-oauth-serving-cert\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.713095 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.712960 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-config\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.813811 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.813774 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-oauth-serving-cert\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.813811 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.813817 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-config\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.814080 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.813889 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdkxh\" (UniqueName: \"kubernetes.io/projected/a08d7879-6e67-44cf-91c7-8f069fd849c0-kube-api-access-fdkxh\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.814080 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.813931 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-serving-cert\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.814080 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.813951 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-service-ca\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.814080 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.813985 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-oauth-config\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.814080 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.814012 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-trusted-ca-bundle\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.814634 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.814607 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-config\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.814757 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.814607 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-oauth-serving-cert\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.814757 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.814644 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-service-ca\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.815355 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.815333 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-trusted-ca-bundle\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.816425 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.816408 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-oauth-config\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.816669 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.816652 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-serving-cert\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.824151 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.824127 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdkxh\" (UniqueName: \"kubernetes.io/projected/a08d7879-6e67-44cf-91c7-8f069fd849c0-kube-api-access-fdkxh\") pod \"console-75967867d6-4lqkh\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:05.958028 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:05.957931 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:06.100966 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:06.100937 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75967867d6-4lqkh"] Jun 02 04:47:06.103476 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:47:06.103447 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08d7879_6e67_44cf_91c7_8f069fd849c0.slice/crio-ea5daad7d60733213c84b0de0f81853368e03f3582ba7c5472b596af2ff3706f WatchSource:0}: Error finding container ea5daad7d60733213c84b0de0f81853368e03f3582ba7c5472b596af2ff3706f: Status 404 returned error can't find the container with id ea5daad7d60733213c84b0de0f81853368e03f3582ba7c5472b596af2ff3706f Jun 02 04:47:06.871626 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:06.871588 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75967867d6-4lqkh" event={"ID":"a08d7879-6e67-44cf-91c7-8f069fd849c0","Type":"ContainerStarted","Data":"60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd"} Jun 02 04:47:06.871626 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:06.871627 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75967867d6-4lqkh" event={"ID":"a08d7879-6e67-44cf-91c7-8f069fd849c0","Type":"ContainerStarted","Data":"ea5daad7d60733213c84b0de0f81853368e03f3582ba7c5472b596af2ff3706f"} Jun 02 04:47:06.890758 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:06.890707 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-75967867d6-4lqkh" podStartSLOduration=1.890694946 podStartE2EDuration="1.890694946s" podCreationTimestamp="2026-06-02 04:47:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:47:06.88962697 +0000 UTC m=+278.437619800" watchObservedRunningTime="2026-06-02 04:47:06.890694946 +0000 UTC m=+278.438687781" Jun 02 04:47:09.428411 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:47:09.428362 2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" podUID="0e126c07-8905-4d3d-b2f5-00616074853a" Jun 02 04:47:09.880186 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:09.880156 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:47:12.777928 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:12.777876 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:47:12.780516 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:12.780485 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e126c07-8905-4d3d-b2f5-00616074853a-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-cs4nm\" (UID: \"0e126c07-8905-4d3d-b2f5-00616074853a\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:47:12.885619 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:12.885589 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-skk6k\"" Jun 02 04:47:12.891714 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:12.891687 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" Jun 02 04:47:13.028326 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:13.028299 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm"] Jun 02 04:47:13.030284 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:47:13.030250 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e126c07_8905_4d3d_b2f5_00616074853a.slice/crio-67cbb332affaaca0298da425ea10b013acb6e3686cc3ff1ec1ef11029350b038 WatchSource:0}: Error finding container 67cbb332affaaca0298da425ea10b013acb6e3686cc3ff1ec1ef11029350b038: Status 404 returned error can't find the container with id 67cbb332affaaca0298da425ea10b013acb6e3686cc3ff1ec1ef11029350b038 Jun 02 04:47:13.892544 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:13.892509 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" event={"ID":"0e126c07-8905-4d3d-b2f5-00616074853a","Type":"ContainerStarted","Data":"67cbb332affaaca0298da425ea10b013acb6e3686cc3ff1ec1ef11029350b038"} Jun 02 04:47:14.899190 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:14.899146 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" event={"ID":"0e126c07-8905-4d3d-b2f5-00616074853a","Type":"ContainerStarted","Data":"9135c88d812e43dfeb417af4d7872e24f5e1aa0101a4bf6f42f8c12eb95a91b9"} Jun 02 04:47:14.918619 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:14.918570 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-cs4nm" podStartSLOduration=271.45001436 podStartE2EDuration="4m32.918554872s" podCreationTimestamp="2026-06-02 04:42:42 +0000 UTC" firstStartedPulling="2026-06-02 04:47:13.032214387 +0000 UTC m=+284.580207199" lastFinishedPulling="2026-06-02 04:47:14.500754893 +0000 UTC m=+286.048747711" observedRunningTime="2026-06-02 04:47:14.917771097 +0000 UTC m=+286.465763934" watchObservedRunningTime="2026-06-02 04:47:14.918554872 +0000 UTC m=+286.466547709" Jun 02 04:47:15.958658 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:15.958618 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:15.959066 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:15.958712 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:15.963385 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:15.963362 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:16.913174 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:16.913141 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:47:28.915670 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:28.915640 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:47:28.917493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:28.917464 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:47:28.921305 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:28.921279 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:47:28.923364 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:28.923338 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:47:28.927898 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:47:28.927878 2582 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 04:48:16.687699 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.687613 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7966c78b57-g2xbn"] Jun 02 04:48:16.695125 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.694966 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.702803 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.702772 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7966c78b57-g2xbn"] Jun 02 04:48:16.814282 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.814243 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-service-ca\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.814475 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.814293 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-serving-cert\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.814475 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.814310 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-oauth-serving-cert\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.814475 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.814395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-trusted-ca-bundle\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.814645 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.814481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-console-config\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.814645 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.814534 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-oauth-config\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.814645 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.814588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ls2d\" (UniqueName: \"kubernetes.io/projected/2a0f424e-4584-4125-994a-56b760c20e01-kube-api-access-6ls2d\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.915754 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.915722 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-service-ca\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.915978 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.915780 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-serving-cert\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.915978 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.915804 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-oauth-serving-cert\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.915978 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.915877 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-trusted-ca-bundle\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.915978 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.915919 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-console-config\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.915978 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.915950 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-oauth-config\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.916231 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.915987 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ls2d\" (UniqueName: \"kubernetes.io/projected/2a0f424e-4584-4125-994a-56b760c20e01-kube-api-access-6ls2d\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.916570 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.916538 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-service-ca\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.916705 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.916643 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-oauth-serving-cert\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.916705 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.916695 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-console-config\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.916800 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.916780 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-trusted-ca-bundle\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.918437 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.918416 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-serving-cert\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.918632 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.918613 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-oauth-config\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:16.924708 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:16.924683 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ls2d\" (UniqueName: \"kubernetes.io/projected/2a0f424e-4584-4125-994a-56b760c20e01-kube-api-access-6ls2d\") pod \"console-7966c78b57-g2xbn\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:17.006792 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:17.006706 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:17.140404 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:17.140368 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7966c78b57-g2xbn"] Jun 02 04:48:17.143745 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:48:17.143715 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a0f424e_4584_4125_994a_56b760c20e01.slice/crio-9bb4fa03a01f691fb79240329efc9285b3e887f7ef920a0103afd01052ede756 WatchSource:0}: Error finding container 9bb4fa03a01f691fb79240329efc9285b3e887f7ef920a0103afd01052ede756: Status 404 returned error can't find the container with id 9bb4fa03a01f691fb79240329efc9285b3e887f7ef920a0103afd01052ede756 Jun 02 04:48:17.145546 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:17.145530 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 04:48:18.087687 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:18.087648 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7966c78b57-g2xbn" event={"ID":"2a0f424e-4584-4125-994a-56b760c20e01","Type":"ContainerStarted","Data":"9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4"} Jun 02 04:48:18.088082 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:18.087697 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7966c78b57-g2xbn" event={"ID":"2a0f424e-4584-4125-994a-56b760c20e01","Type":"ContainerStarted","Data":"9bb4fa03a01f691fb79240329efc9285b3e887f7ef920a0103afd01052ede756"} Jun 02 04:48:18.105518 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:18.105462 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7966c78b57-g2xbn" podStartSLOduration=2.105447594 podStartE2EDuration="2.105447594s" podCreationTimestamp="2026-06-02 04:48:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:48:18.104206363 +0000 UTC m=+349.652199198" watchObservedRunningTime="2026-06-02 04:48:18.105447594 +0000 UTC m=+349.653440429" Jun 02 04:48:27.008245 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:27.008214 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:27.008643 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:27.008254 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:27.012234 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:27.012213 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:27.120783 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:27.120752 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:48:27.170391 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:27.170356 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75967867d6-4lqkh"] Jun 02 04:48:52.196693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.196628 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-75967867d6-4lqkh" podUID="a08d7879-6e67-44cf-91c7-8f069fd849c0" containerName="console" containerID="cri-o://60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd" gracePeriod=15 Jun 02 04:48:52.435053 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.435027 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75967867d6-4lqkh_a08d7879-6e67-44cf-91c7-8f069fd849c0/console/0.log" Jun 02 04:48:52.435190 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.435089 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:48:52.535594 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.535503 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-trusted-ca-bundle\") pod \"a08d7879-6e67-44cf-91c7-8f069fd849c0\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " Jun 02 04:48:52.535594 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.535545 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-config\") pod \"a08d7879-6e67-44cf-91c7-8f069fd849c0\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " Jun 02 04:48:52.535781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.535597 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-oauth-serving-cert\") pod \"a08d7879-6e67-44cf-91c7-8f069fd849c0\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " Jun 02 04:48:52.535781 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.535657 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-oauth-config\") pod \"a08d7879-6e67-44cf-91c7-8f069fd849c0\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " Jun 02 04:48:52.535901 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.535782 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdkxh\" (UniqueName: \"kubernetes.io/projected/a08d7879-6e67-44cf-91c7-8f069fd849c0-kube-api-access-fdkxh\") pod \"a08d7879-6e67-44cf-91c7-8f069fd849c0\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " Jun 02 04:48:52.535901 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.535867 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-serving-cert\") pod \"a08d7879-6e67-44cf-91c7-8f069fd849c0\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " Jun 02 04:48:52.535901 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.535887 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-service-ca\") pod \"a08d7879-6e67-44cf-91c7-8f069fd849c0\" (UID: \"a08d7879-6e67-44cf-91c7-8f069fd849c0\") " Jun 02 04:48:52.536055 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.536027 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a08d7879-6e67-44cf-91c7-8f069fd849c0" (UID: "a08d7879-6e67-44cf-91c7-8f069fd849c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:48:52.536115 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.536067 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a08d7879-6e67-44cf-91c7-8f069fd849c0" (UID: "a08d7879-6e67-44cf-91c7-8f069fd849c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:48:52.536115 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.536088 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-config" (OuterVolumeSpecName: "console-config") pod "a08d7879-6e67-44cf-91c7-8f069fd849c0" (UID: "a08d7879-6e67-44cf-91c7-8f069fd849c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:48:52.536327 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.536308 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "a08d7879-6e67-44cf-91c7-8f069fd849c0" (UID: "a08d7879-6e67-44cf-91c7-8f069fd849c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:48:52.536407 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.536335 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-trusted-ca-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:48:52.536407 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.536359 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-config\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:48:52.536407 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.536374 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-oauth-serving-cert\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:48:52.537960 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.537936 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a08d7879-6e67-44cf-91c7-8f069fd849c0" (UID: "a08d7879-6e67-44cf-91c7-8f069fd849c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:48:52.538126 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.538105 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a08d7879-6e67-44cf-91c7-8f069fd849c0-kube-api-access-fdkxh" (OuterVolumeSpecName: "kube-api-access-fdkxh") pod "a08d7879-6e67-44cf-91c7-8f069fd849c0" (UID: "a08d7879-6e67-44cf-91c7-8f069fd849c0"). InnerVolumeSpecName "kube-api-access-fdkxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:48:52.538210 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.538191 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a08d7879-6e67-44cf-91c7-8f069fd849c0" (UID: "a08d7879-6e67-44cf-91c7-8f069fd849c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:48:52.636990 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.636949 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-oauth-config\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:48:52.636990 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.636980 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdkxh\" (UniqueName: \"kubernetes.io/projected/a08d7879-6e67-44cf-91c7-8f069fd849c0-kube-api-access-fdkxh\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:48:52.636990 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.636990 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a08d7879-6e67-44cf-91c7-8f069fd849c0-console-serving-cert\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:48:52.636990 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:52.637000 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a08d7879-6e67-44cf-91c7-8f069fd849c0-service-ca\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:48:53.194402 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.194371 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75967867d6-4lqkh_a08d7879-6e67-44cf-91c7-8f069fd849c0/console/0.log" Jun 02 04:48:53.194589 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.194414 2582 generic.go:358] "Generic (PLEG): container finished" podID="a08d7879-6e67-44cf-91c7-8f069fd849c0" containerID="60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd" exitCode=2 Jun 02 04:48:53.194589 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.194447 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75967867d6-4lqkh" event={"ID":"a08d7879-6e67-44cf-91c7-8f069fd849c0","Type":"ContainerDied","Data":"60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd"} Jun 02 04:48:53.194589 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.194499 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75967867d6-4lqkh" event={"ID":"a08d7879-6e67-44cf-91c7-8f069fd849c0","Type":"ContainerDied","Data":"ea5daad7d60733213c84b0de0f81853368e03f3582ba7c5472b596af2ff3706f"} Jun 02 04:48:53.194589 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.194510 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75967867d6-4lqkh" Jun 02 04:48:53.194589 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.194516 2582 scope.go:117] "RemoveContainer" containerID="60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd" Jun 02 04:48:53.203559 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.203384 2582 scope.go:117] "RemoveContainer" containerID="60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd" Jun 02 04:48:53.203801 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:48:53.203674 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd\": container with ID starting with 60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd not found: ID does not exist" containerID="60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd" Jun 02 04:48:53.203801 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.203706 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd"} err="failed to get container status \"60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd\": rpc error: code = NotFound desc = could not find container \"60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd\": container with ID starting with 60a2c99809d0397bf36f242dcb4afe9669ae1dbd895a3924dd1a89fc408feffd not found: ID does not exist" Jun 02 04:48:53.212001 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.211978 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75967867d6-4lqkh"] Jun 02 04:48:53.215915 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:53.215892 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75967867d6-4lqkh"] Jun 02 04:48:55.007864 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:48:55.007810 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a08d7879-6e67-44cf-91c7-8f069fd849c0" path="/var/lib/kubelet/pods/a08d7879-6e67-44cf-91c7-8f069fd849c0/volumes" Jun 02 04:49:14.338075 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.338041 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn"] Jun 02 04:49:14.338511 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.338370 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a08d7879-6e67-44cf-91c7-8f069fd849c0" containerName="console" Jun 02 04:49:14.338511 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.338382 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a08d7879-6e67-44cf-91c7-8f069fd849c0" containerName="console" Jun 02 04:49:14.338511 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.338439 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="a08d7879-6e67-44cf-91c7-8f069fd849c0" containerName="console" Jun 02 04:49:14.342970 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.342952 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.345384 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.345353 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lwkd4\"" Jun 02 04:49:14.345517 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.345395 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 04:49:14.345517 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.345395 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 04:49:14.350727 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.350683 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn"] Jun 02 04:49:14.527463 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.527425 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.527637 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.527487 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdqqd\" (UniqueName: \"kubernetes.io/projected/39afa60b-d8c5-4151-9185-05480a99df85-kube-api-access-vdqqd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.527637 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.527528 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.628947 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.628854 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.628947 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.628904 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdqqd\" (UniqueName: \"kubernetes.io/projected/39afa60b-d8c5-4151-9185-05480a99df85-kube-api-access-vdqqd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.628947 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.628937 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.629264 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.629243 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.629301 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.629276 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.637773 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.637751 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdqqd\" (UniqueName: \"kubernetes.io/projected/39afa60b-d8c5-4151-9185-05480a99df85-kube-api-access-vdqqd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.652652 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.652625 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:14.784411 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:14.784386 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn"] Jun 02 04:49:14.787029 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:49:14.786998 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39afa60b_d8c5_4151_9185_05480a99df85.slice/crio-5d00444f64723e06d1fbd18305ce93208973cdf36d88d2f6c62b74af7f6db49e WatchSource:0}: Error finding container 5d00444f64723e06d1fbd18305ce93208973cdf36d88d2f6c62b74af7f6db49e: Status 404 returned error can't find the container with id 5d00444f64723e06d1fbd18305ce93208973cdf36d88d2f6c62b74af7f6db49e Jun 02 04:49:15.264978 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:15.264939 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" event={"ID":"39afa60b-d8c5-4151-9185-05480a99df85","Type":"ContainerStarted","Data":"5d00444f64723e06d1fbd18305ce93208973cdf36d88d2f6c62b74af7f6db49e"} Jun 02 04:49:20.285134 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:20.285096 2582 generic.go:358] "Generic (PLEG): container finished" podID="39afa60b-d8c5-4151-9185-05480a99df85" containerID="1cdeddbf963869bafcee10cf2f6c8acf723a6fad99b8545a3e56db71b38f03b7" exitCode=0 Jun 02 04:49:20.285520 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:20.285145 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" event={"ID":"39afa60b-d8c5-4151-9185-05480a99df85","Type":"ContainerDied","Data":"1cdeddbf963869bafcee10cf2f6c8acf723a6fad99b8545a3e56db71b38f03b7"} Jun 02 04:49:22.299956 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:22.299920 2582 generic.go:358] "Generic (PLEG): container finished" podID="39afa60b-d8c5-4151-9185-05480a99df85" containerID="8d60b95d4c2c56967d3514fb9e7739d60ccd74145ad509b9b44b690edcd6eef1" exitCode=0 Jun 02 04:49:22.300327 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:22.299980 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" event={"ID":"39afa60b-d8c5-4151-9185-05480a99df85","Type":"ContainerDied","Data":"8d60b95d4c2c56967d3514fb9e7739d60ccd74145ad509b9b44b690edcd6eef1"} Jun 02 04:49:29.327422 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:29.327384 2582 generic.go:358] "Generic (PLEG): container finished" podID="39afa60b-d8c5-4151-9185-05480a99df85" containerID="681774562a5ebacd61211ebfca90b4a7492e719dd6dae2fc7ff676f88e73ab20" exitCode=0 Jun 02 04:49:29.327775 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:29.327445 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" event={"ID":"39afa60b-d8c5-4151-9185-05480a99df85","Type":"ContainerDied","Data":"681774562a5ebacd61211ebfca90b4a7492e719dd6dae2fc7ff676f88e73ab20"} Jun 02 04:49:30.462585 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.462561 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:30.571696 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.571664 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-util\") pod \"39afa60b-d8c5-4151-9185-05480a99df85\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " Jun 02 04:49:30.571883 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.571742 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdqqd\" (UniqueName: \"kubernetes.io/projected/39afa60b-d8c5-4151-9185-05480a99df85-kube-api-access-vdqqd\") pod \"39afa60b-d8c5-4151-9185-05480a99df85\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " Jun 02 04:49:30.571883 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.571791 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-bundle\") pod \"39afa60b-d8c5-4151-9185-05480a99df85\" (UID: \"39afa60b-d8c5-4151-9185-05480a99df85\") " Jun 02 04:49:30.572417 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.572385 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-bundle" (OuterVolumeSpecName: "bundle") pod "39afa60b-d8c5-4151-9185-05480a99df85" (UID: "39afa60b-d8c5-4151-9185-05480a99df85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:49:30.574076 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.574047 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39afa60b-d8c5-4151-9185-05480a99df85-kube-api-access-vdqqd" (OuterVolumeSpecName: "kube-api-access-vdqqd") pod "39afa60b-d8c5-4151-9185-05480a99df85" (UID: "39afa60b-d8c5-4151-9185-05480a99df85"). InnerVolumeSpecName "kube-api-access-vdqqd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:49:30.575877 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.575857 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-util" (OuterVolumeSpecName: "util") pod "39afa60b-d8c5-4151-9185-05480a99df85" (UID: "39afa60b-d8c5-4151-9185-05480a99df85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:49:30.673180 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.673092 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:49:30.673180 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.673124 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdqqd\" (UniqueName: \"kubernetes.io/projected/39afa60b-d8c5-4151-9185-05480a99df85-kube-api-access-vdqqd\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:49:30.673180 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:30.673134 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39afa60b-d8c5-4151-9185-05480a99df85-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:49:31.334434 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:31.334403 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" event={"ID":"39afa60b-d8c5-4151-9185-05480a99df85","Type":"ContainerDied","Data":"5d00444f64723e06d1fbd18305ce93208973cdf36d88d2f6c62b74af7f6db49e"} Jun 02 04:49:31.334434 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:31.334433 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d00444f64723e06d1fbd18305ce93208973cdf36d88d2f6c62b74af7f6db49e" Jun 02 04:49:31.334434 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:31.334433 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19df6xgn" Jun 02 04:49:37.352101 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.352065 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc"] Jun 02 04:49:37.352542 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.352406 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39afa60b-d8c5-4151-9185-05480a99df85" containerName="pull" Jun 02 04:49:37.352542 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.352418 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39afa60b-d8c5-4151-9185-05480a99df85" containerName="pull" Jun 02 04:49:37.352542 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.352441 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39afa60b-d8c5-4151-9185-05480a99df85" containerName="extract" Jun 02 04:49:37.352542 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.352449 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39afa60b-d8c5-4151-9185-05480a99df85" containerName="extract" Jun 02 04:49:37.352542 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.352478 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39afa60b-d8c5-4151-9185-05480a99df85" containerName="util" Jun 02 04:49:37.352542 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.352484 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39afa60b-d8c5-4151-9185-05480a99df85" containerName="util" Jun 02 04:49:37.352542 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.352540 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="39afa60b-d8c5-4151-9185-05480a99df85" containerName="extract" Jun 02 04:49:37.383289 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.383262 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc"] Jun 02 04:49:37.383438 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.383376 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" Jun 02 04:49:37.385876 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.385848 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 04:49:37.386234 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.386212 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vk8qb\"" Jun 02 04:49:37.386334 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.386237 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:49:37.432793 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.432756 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87fpz\" (UniqueName: \"kubernetes.io/projected/2faeddf8-b0a4-410f-9a5a-2608945caebd-kube-api-access-87fpz\") pod \"cert-manager-operator-controller-manager-54b9655956-qtnnc\" (UID: \"2faeddf8-b0a4-410f-9a5a-2608945caebd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" Jun 02 04:49:37.432965 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.432800 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2faeddf8-b0a4-410f-9a5a-2608945caebd-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qtnnc\" (UID: \"2faeddf8-b0a4-410f-9a5a-2608945caebd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" Jun 02 04:49:37.533818 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.533780 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87fpz\" (UniqueName: \"kubernetes.io/projected/2faeddf8-b0a4-410f-9a5a-2608945caebd-kube-api-access-87fpz\") pod \"cert-manager-operator-controller-manager-54b9655956-qtnnc\" (UID: \"2faeddf8-b0a4-410f-9a5a-2608945caebd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" Jun 02 04:49:37.533818 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.533822 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2faeddf8-b0a4-410f-9a5a-2608945caebd-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qtnnc\" (UID: \"2faeddf8-b0a4-410f-9a5a-2608945caebd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" Jun 02 04:49:37.534166 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.534148 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2faeddf8-b0a4-410f-9a5a-2608945caebd-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-qtnnc\" (UID: \"2faeddf8-b0a4-410f-9a5a-2608945caebd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" Jun 02 04:49:37.542703 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.542668 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87fpz\" (UniqueName: \"kubernetes.io/projected/2faeddf8-b0a4-410f-9a5a-2608945caebd-kube-api-access-87fpz\") pod \"cert-manager-operator-controller-manager-54b9655956-qtnnc\" (UID: \"2faeddf8-b0a4-410f-9a5a-2608945caebd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" Jun 02 04:49:37.692962 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.692875 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" Jun 02 04:49:37.831396 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:37.831340 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc"] Jun 02 04:49:37.835029 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:49:37.835002 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2faeddf8_b0a4_410f_9a5a_2608945caebd.slice/crio-1c8e37560955249fb754a0742563155ceda4665f6e497cde7be45d2875ea2221 WatchSource:0}: Error finding container 1c8e37560955249fb754a0742563155ceda4665f6e497cde7be45d2875ea2221: Status 404 returned error can't find the container with id 1c8e37560955249fb754a0742563155ceda4665f6e497cde7be45d2875ea2221 Jun 02 04:49:38.356549 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:38.356506 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" event={"ID":"2faeddf8-b0a4-410f-9a5a-2608945caebd","Type":"ContainerStarted","Data":"1c8e37560955249fb754a0742563155ceda4665f6e497cde7be45d2875ea2221"} Jun 02 04:49:40.368519 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:40.368428 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" event={"ID":"2faeddf8-b0a4-410f-9a5a-2608945caebd","Type":"ContainerStarted","Data":"cc6ff9e76f63a8b938758afcb957e646afbf1d66b9f12a071241edbaca815d52"} Jun 02 04:49:40.400090 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:40.400030 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-qtnnc" podStartSLOduration=1.149750131 podStartE2EDuration="3.400015836s" podCreationTimestamp="2026-06-02 04:49:37 +0000 UTC" firstStartedPulling="2026-06-02 04:49:37.837368965 +0000 UTC m=+429.385361782" lastFinishedPulling="2026-06-02 04:49:40.087634664 +0000 UTC m=+431.635627487" observedRunningTime="2026-06-02 04:49:40.399151992 +0000 UTC m=+431.947144828" watchObservedRunningTime="2026-06-02 04:49:40.400015836 +0000 UTC m=+431.948008670" Jun 02 04:49:41.294256 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.294211 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s"] Jun 02 04:49:41.316174 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.316144 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s"] Jun 02 04:49:41.316341 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.316287 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.318506 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.318478 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 04:49:41.319096 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.319067 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 04:49:41.319404 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.319381 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lwkd4\"" Jun 02 04:49:41.366424 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.366389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxz5j\" (UniqueName: \"kubernetes.io/projected/afe29941-7d67-4a47-9b7d-e152925462b7-kube-api-access-gxz5j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.366588 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.366447 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.366588 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.366511 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.467907 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.467870 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.468341 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.467973 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxz5j\" (UniqueName: \"kubernetes.io/projected/afe29941-7d67-4a47-9b7d-e152925462b7-kube-api-access-gxz5j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.468341 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.468014 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.468341 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.468237 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.468471 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.468336 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.476310 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.476279 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxz5j\" (UniqueName: \"kubernetes.io/projected/afe29941-7d67-4a47-9b7d-e152925462b7-kube-api-access-gxz5j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.626903 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.626865 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:41.756063 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:41.756027 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s"] Jun 02 04:49:41.759182 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:49:41.759151 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe29941_7d67_4a47_9b7d_e152925462b7.slice/crio-7aedf4bb173856b962aaaceca6aadd8dd7c4f18569c417ddfe597e733d7f39de WatchSource:0}: Error finding container 7aedf4bb173856b962aaaceca6aadd8dd7c4f18569c417ddfe597e733d7f39de: Status 404 returned error can't find the container with id 7aedf4bb173856b962aaaceca6aadd8dd7c4f18569c417ddfe597e733d7f39de Jun 02 04:49:42.376590 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:42.376557 2582 generic.go:358] "Generic (PLEG): container finished" podID="afe29941-7d67-4a47-9b7d-e152925462b7" containerID="d977ee87f07a46134b7457c9040f1e11c82be85b660c5b8e0be098163d529654" exitCode=0 Jun 02 04:49:42.376767 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:42.376614 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" event={"ID":"afe29941-7d67-4a47-9b7d-e152925462b7","Type":"ContainerDied","Data":"d977ee87f07a46134b7457c9040f1e11c82be85b660c5b8e0be098163d529654"} Jun 02 04:49:42.376767 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:42.376637 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" event={"ID":"afe29941-7d67-4a47-9b7d-e152925462b7","Type":"ContainerStarted","Data":"7aedf4bb173856b962aaaceca6aadd8dd7c4f18569c417ddfe597e733d7f39de"} Jun 02 04:49:43.684215 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.684174 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-9f2ws"] Jun 02 04:49:43.689328 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.689291 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:43.691622 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.691594 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 04:49:43.692219 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.692200 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 04:49:43.692328 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.692203 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kctmx\"" Jun 02 04:49:43.697118 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.697095 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-9f2ws"] Jun 02 04:49:43.790792 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.790751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p6bt\" (UniqueName: \"kubernetes.io/projected/36ec7d4e-def8-4bf7-9a37-6c686b5737d1-kube-api-access-5p6bt\") pod \"cert-manager-webhook-587ccfb98-9f2ws\" (UID: \"36ec7d4e-def8-4bf7-9a37-6c686b5737d1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:43.790996 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.790818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36ec7d4e-def8-4bf7-9a37-6c686b5737d1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-9f2ws\" (UID: \"36ec7d4e-def8-4bf7-9a37-6c686b5737d1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:43.892396 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.892362 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36ec7d4e-def8-4bf7-9a37-6c686b5737d1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-9f2ws\" (UID: \"36ec7d4e-def8-4bf7-9a37-6c686b5737d1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:43.892576 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.892486 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5p6bt\" (UniqueName: \"kubernetes.io/projected/36ec7d4e-def8-4bf7-9a37-6c686b5737d1-kube-api-access-5p6bt\") pod \"cert-manager-webhook-587ccfb98-9f2ws\" (UID: \"36ec7d4e-def8-4bf7-9a37-6c686b5737d1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:43.901086 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.901029 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36ec7d4e-def8-4bf7-9a37-6c686b5737d1-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-9f2ws\" (UID: \"36ec7d4e-def8-4bf7-9a37-6c686b5737d1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:43.901227 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:43.901095 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p6bt\" (UniqueName: \"kubernetes.io/projected/36ec7d4e-def8-4bf7-9a37-6c686b5737d1-kube-api-access-5p6bt\") pod \"cert-manager-webhook-587ccfb98-9f2ws\" (UID: \"36ec7d4e-def8-4bf7-9a37-6c686b5737d1\") " pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:44.010183 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:44.010102 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:44.390186 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:44.388634 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-9f2ws"] Jun 02 04:49:44.392019 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:49:44.391966 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36ec7d4e_def8_4bf7_9a37_6c686b5737d1.slice/crio-79aedad66d841e1bf236ac25e6b0b3ba1c385e0f8cb1f682f19c565cf8e8284f WatchSource:0}: Error finding container 79aedad66d841e1bf236ac25e6b0b3ba1c385e0f8cb1f682f19c565cf8e8284f: Status 404 returned error can't find the container with id 79aedad66d841e1bf236ac25e6b0b3ba1c385e0f8cb1f682f19c565cf8e8284f Jun 02 04:49:44.396545 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:44.396515 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" event={"ID":"afe29941-7d67-4a47-9b7d-e152925462b7","Type":"ContainerStarted","Data":"64aff8e07672c0f5cd9488324bb55936ef9fd3a9893410954f8ea5f2f3d6cd7e"} Jun 02 04:49:45.402159 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:45.402119 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" event={"ID":"36ec7d4e-def8-4bf7-9a37-6c686b5737d1","Type":"ContainerStarted","Data":"79aedad66d841e1bf236ac25e6b0b3ba1c385e0f8cb1f682f19c565cf8e8284f"} Jun 02 04:49:45.404082 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:45.404044 2582 generic.go:358] "Generic (PLEG): container finished" podID="afe29941-7d67-4a47-9b7d-e152925462b7" containerID="64aff8e07672c0f5cd9488324bb55936ef9fd3a9893410954f8ea5f2f3d6cd7e" exitCode=0 Jun 02 04:49:45.404212 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:45.404097 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" event={"ID":"afe29941-7d67-4a47-9b7d-e152925462b7","Type":"ContainerDied","Data":"64aff8e07672c0f5cd9488324bb55936ef9fd3a9893410954f8ea5f2f3d6cd7e"} Jun 02 04:49:46.410712 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.410622 2582 generic.go:358] "Generic (PLEG): container finished" podID="afe29941-7d67-4a47-9b7d-e152925462b7" containerID="b0d3bc885a3d1ccd9ef5c3e22df24aa964583a95a633c7ebdd4e137488d27a0e" exitCode=0 Jun 02 04:49:46.411173 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.410709 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" event={"ID":"afe29941-7d67-4a47-9b7d-e152925462b7","Type":"ContainerDied","Data":"b0d3bc885a3d1ccd9ef5c3e22df24aa964583a95a633c7ebdd4e137488d27a0e"} Jun 02 04:49:46.467554 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.467518 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-h2kgc"] Jun 02 04:49:46.469898 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.469878 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" Jun 02 04:49:46.472080 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.472057 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-8wdbr\"" Jun 02 04:49:46.484160 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.484128 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-h2kgc"] Jun 02 04:49:46.614072 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.614029 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c77273ed-ed87-4d05-bf74-c4354c94952f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-h2kgc\" (UID: \"c77273ed-ed87-4d05-bf74-c4354c94952f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" Jun 02 04:49:46.614267 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.614180 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8bhc\" (UniqueName: \"kubernetes.io/projected/c77273ed-ed87-4d05-bf74-c4354c94952f-kube-api-access-v8bhc\") pod \"cert-manager-cainjector-68b757865b-h2kgc\" (UID: \"c77273ed-ed87-4d05-bf74-c4354c94952f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" Jun 02 04:49:46.715360 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.715265 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c77273ed-ed87-4d05-bf74-c4354c94952f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-h2kgc\" (UID: \"c77273ed-ed87-4d05-bf74-c4354c94952f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" Jun 02 04:49:46.715519 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.715379 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8bhc\" (UniqueName: \"kubernetes.io/projected/c77273ed-ed87-4d05-bf74-c4354c94952f-kube-api-access-v8bhc\") pod \"cert-manager-cainjector-68b757865b-h2kgc\" (UID: \"c77273ed-ed87-4d05-bf74-c4354c94952f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" Jun 02 04:49:46.724275 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.724249 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c77273ed-ed87-4d05-bf74-c4354c94952f-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-h2kgc\" (UID: \"c77273ed-ed87-4d05-bf74-c4354c94952f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" Jun 02 04:49:46.724420 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.724401 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8bhc\" (UniqueName: \"kubernetes.io/projected/c77273ed-ed87-4d05-bf74-c4354c94952f-kube-api-access-v8bhc\") pod \"cert-manager-cainjector-68b757865b-h2kgc\" (UID: \"c77273ed-ed87-4d05-bf74-c4354c94952f\") " pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" Jun 02 04:49:46.780220 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:46.780170 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" Jun 02 04:49:47.234985 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.234956 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-h2kgc"] Jun 02 04:49:47.236116 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:49:47.236087 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc77273ed_ed87_4d05_bf74_c4354c94952f.slice/crio-cc05dba13969aaded4fbb997fdf139a65ec30f749cea17a479b80f98cdc21bf5 WatchSource:0}: Error finding container cc05dba13969aaded4fbb997fdf139a65ec30f749cea17a479b80f98cdc21bf5: Status 404 returned error can't find the container with id cc05dba13969aaded4fbb997fdf139a65ec30f749cea17a479b80f98cdc21bf5 Jun 02 04:49:47.415317 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.415217 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" event={"ID":"c77273ed-ed87-4d05-bf74-c4354c94952f","Type":"ContainerStarted","Data":"a15ad19f0be783f91c7dc11318a742b03b724acca12cda7e5b4a1ab364c301c3"} Jun 02 04:49:47.415317 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.415264 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" event={"ID":"c77273ed-ed87-4d05-bf74-c4354c94952f","Type":"ContainerStarted","Data":"cc05dba13969aaded4fbb997fdf139a65ec30f749cea17a479b80f98cdc21bf5"} Jun 02 04:49:47.416775 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.416745 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" event={"ID":"36ec7d4e-def8-4bf7-9a37-6c686b5737d1","Type":"ContainerStarted","Data":"3f94def69498f4370649456da130373f04c49b4244ebf62c6d6de37e547a2afe"} Jun 02 04:49:47.416914 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.416883 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:49:47.434476 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.433543 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-h2kgc" podStartSLOduration=1.4335170640000001 podStartE2EDuration="1.433517064s" podCreationTimestamp="2026-06-02 04:49:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 04:49:47.432120232 +0000 UTC m=+438.980113068" watchObservedRunningTime="2026-06-02 04:49:47.433517064 +0000 UTC m=+438.981509899" Jun 02 04:49:47.449453 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.449314 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" podStartSLOduration=1.704621005 podStartE2EDuration="4.449292223s" podCreationTimestamp="2026-06-02 04:49:43 +0000 UTC" firstStartedPulling="2026-06-02 04:49:44.39448027 +0000 UTC m=+435.942473083" lastFinishedPulling="2026-06-02 04:49:47.139150997 +0000 UTC m=+438.687144301" observedRunningTime="2026-06-02 04:49:47.448174945 +0000 UTC m=+438.996167804" watchObservedRunningTime="2026-06-02 04:49:47.449292223 +0000 UTC m=+438.997285066" Jun 02 04:49:47.550879 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.550819 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:47.625743 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.625711 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-util\") pod \"afe29941-7d67-4a47-9b7d-e152925462b7\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " Jun 02 04:49:47.625949 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.625759 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxz5j\" (UniqueName: \"kubernetes.io/projected/afe29941-7d67-4a47-9b7d-e152925462b7-kube-api-access-gxz5j\") pod \"afe29941-7d67-4a47-9b7d-e152925462b7\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " Jun 02 04:49:47.625949 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.625813 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-bundle\") pod \"afe29941-7d67-4a47-9b7d-e152925462b7\" (UID: \"afe29941-7d67-4a47-9b7d-e152925462b7\") " Jun 02 04:49:47.626324 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.626297 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-bundle" (OuterVolumeSpecName: "bundle") pod "afe29941-7d67-4a47-9b7d-e152925462b7" (UID: "afe29941-7d67-4a47-9b7d-e152925462b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:49:47.628242 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.628215 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afe29941-7d67-4a47-9b7d-e152925462b7-kube-api-access-gxz5j" (OuterVolumeSpecName: "kube-api-access-gxz5j") pod "afe29941-7d67-4a47-9b7d-e152925462b7" (UID: "afe29941-7d67-4a47-9b7d-e152925462b7"). InnerVolumeSpecName "kube-api-access-gxz5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:49:47.630181 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.630155 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-util" (OuterVolumeSpecName: "util") pod "afe29941-7d67-4a47-9b7d-e152925462b7" (UID: "afe29941-7d67-4a47-9b7d-e152925462b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:49:47.727167 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.727064 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:49:47.727167 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.727101 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxz5j\" (UniqueName: \"kubernetes.io/projected/afe29941-7d67-4a47-9b7d-e152925462b7-kube-api-access-gxz5j\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:49:47.727167 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:47.727111 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afe29941-7d67-4a47-9b7d-e152925462b7-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:49:48.421728 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:48.421697 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" Jun 02 04:49:48.421728 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:48.421710 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flww5s" event={"ID":"afe29941-7d67-4a47-9b7d-e152925462b7","Type":"ContainerDied","Data":"7aedf4bb173856b962aaaceca6aadd8dd7c4f18569c417ddfe597e733d7f39de"} Jun 02 04:49:48.422338 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:48.421741 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7aedf4bb173856b962aaaceca6aadd8dd7c4f18569c417ddfe597e733d7f39de" Jun 02 04:49:53.424532 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:49:53.424502 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-9f2ws" Jun 02 04:50:01.869246 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.869205 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq"] Jun 02 04:50:01.869763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.869735 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe29941-7d67-4a47-9b7d-e152925462b7" containerName="extract" Jun 02 04:50:01.869763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.869757 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe29941-7d67-4a47-9b7d-e152925462b7" containerName="extract" Jun 02 04:50:01.869931 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.869792 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe29941-7d67-4a47-9b7d-e152925462b7" containerName="pull" Jun 02 04:50:01.869931 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.869801 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe29941-7d67-4a47-9b7d-e152925462b7" containerName="pull" Jun 02 04:50:01.869931 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.869820 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe29941-7d67-4a47-9b7d-e152925462b7" containerName="util" Jun 02 04:50:01.869931 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.869854 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe29941-7d67-4a47-9b7d-e152925462b7" containerName="util" Jun 02 04:50:01.870125 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.869945 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="afe29941-7d67-4a47-9b7d-e152925462b7" containerName="extract" Jun 02 04:50:01.872712 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.872691 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:01.874756 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.874730 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 04:50:01.874892 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.874779 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lwkd4\"" Jun 02 04:50:01.875227 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.875212 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 04:50:01.881716 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:01.881691 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq"] Jun 02 04:50:02.044083 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.044033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.044270 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.044108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqcft\" (UniqueName: \"kubernetes.io/projected/e48da062-0e4b-42f1-be1a-a97364cdfe48-kube-api-access-dqcft\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.044270 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.044229 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.145524 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.145436 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.145524 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.145487 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.145524 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.145524 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dqcft\" (UniqueName: \"kubernetes.io/projected/e48da062-0e4b-42f1-be1a-a97364cdfe48-kube-api-access-dqcft\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.145925 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.145902 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.145970 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.145911 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.155095 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.155054 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqcft\" (UniqueName: \"kubernetes.io/projected/e48da062-0e4b-42f1-be1a-a97364cdfe48-kube-api-access-dqcft\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.183155 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.183121 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:02.316209 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.316184 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq"] Jun 02 04:50:02.318293 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:50:02.318261 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48da062_0e4b_42f1_be1a_a97364cdfe48.slice/crio-0dd24ce572c69c438d724e541fe317ea04f9afaee9a96e7d67f95c87a89527f7 WatchSource:0}: Error finding container 0dd24ce572c69c438d724e541fe317ea04f9afaee9a96e7d67f95c87a89527f7: Status 404 returned error can't find the container with id 0dd24ce572c69c438d724e541fe317ea04f9afaee9a96e7d67f95c87a89527f7 Jun 02 04:50:02.476237 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.476196 2582 generic.go:358] "Generic (PLEG): container finished" podID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerID="e5cba726d25af739aed6b92dbcd0e257697e6c643a44e8058f73e1ea7cb605e7" exitCode=0 Jun 02 04:50:02.476426 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.476277 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" event={"ID":"e48da062-0e4b-42f1-be1a-a97364cdfe48","Type":"ContainerDied","Data":"e5cba726d25af739aed6b92dbcd0e257697e6c643a44e8058f73e1ea7cb605e7"} Jun 02 04:50:02.476426 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:02.476323 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" event={"ID":"e48da062-0e4b-42f1-be1a-a97364cdfe48","Type":"ContainerStarted","Data":"0dd24ce572c69c438d724e541fe317ea04f9afaee9a96e7d67f95c87a89527f7"} Jun 02 04:50:03.482050 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:03.481962 2582 generic.go:358] "Generic (PLEG): container finished" podID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerID="4c71ae882434f10a7207b671e22f83fc520b6604f5717299d3454136af93a4bb" exitCode=0 Jun 02 04:50:03.482050 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:03.482004 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" event={"ID":"e48da062-0e4b-42f1-be1a-a97364cdfe48","Type":"ContainerDied","Data":"4c71ae882434f10a7207b671e22f83fc520b6604f5717299d3454136af93a4bb"} Jun 02 04:50:04.487342 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:04.487307 2582 generic.go:358] "Generic (PLEG): container finished" podID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerID="6de0c44939b3ffac30807a643f311d43a6e0cd9fcd00de71f1b7d0cd8666c218" exitCode=0 Jun 02 04:50:04.487728 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:04.487397 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" event={"ID":"e48da062-0e4b-42f1-be1a-a97364cdfe48","Type":"ContainerDied","Data":"6de0c44939b3ffac30807a643f311d43a6e0cd9fcd00de71f1b7d0cd8666c218"} Jun 02 04:50:05.620033 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.620010 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:05.776345 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.776258 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqcft\" (UniqueName: \"kubernetes.io/projected/e48da062-0e4b-42f1-be1a-a97364cdfe48-kube-api-access-dqcft\") pod \"e48da062-0e4b-42f1-be1a-a97364cdfe48\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " Jun 02 04:50:05.776345 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.776298 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-bundle\") pod \"e48da062-0e4b-42f1-be1a-a97364cdfe48\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " Jun 02 04:50:05.776345 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.776327 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-util\") pod \"e48da062-0e4b-42f1-be1a-a97364cdfe48\" (UID: \"e48da062-0e4b-42f1-be1a-a97364cdfe48\") " Jun 02 04:50:05.777003 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.776976 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-bundle" (OuterVolumeSpecName: "bundle") pod "e48da062-0e4b-42f1-be1a-a97364cdfe48" (UID: "e48da062-0e4b-42f1-be1a-a97364cdfe48"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:50:05.778588 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.778554 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e48da062-0e4b-42f1-be1a-a97364cdfe48-kube-api-access-dqcft" (OuterVolumeSpecName: "kube-api-access-dqcft") pod "e48da062-0e4b-42f1-be1a-a97364cdfe48" (UID: "e48da062-0e4b-42f1-be1a-a97364cdfe48"). InnerVolumeSpecName "kube-api-access-dqcft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:50:05.781761 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.781740 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-util" (OuterVolumeSpecName: "util") pod "e48da062-0e4b-42f1-be1a-a97364cdfe48" (UID: "e48da062-0e4b-42f1-be1a-a97364cdfe48"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:50:05.877538 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.877497 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqcft\" (UniqueName: \"kubernetes.io/projected/e48da062-0e4b-42f1-be1a-a97364cdfe48-kube-api-access-dqcft\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:05.877538 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.877530 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:05.877737 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:05.877553 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e48da062-0e4b-42f1-be1a-a97364cdfe48-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:06.496322 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:06.496278 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" event={"ID":"e48da062-0e4b-42f1-be1a-a97364cdfe48","Type":"ContainerDied","Data":"0dd24ce572c69c438d724e541fe317ea04f9afaee9a96e7d67f95c87a89527f7"} Jun 02 04:50:06.496322 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:06.496315 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dd24ce572c69c438d724e541fe317ea04f9afaee9a96e7d67f95c87a89527f7" Jun 02 04:50:06.496522 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:06.496324 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdvg2jq" Jun 02 04:50:13.836293 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.836257 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f"] Jun 02 04:50:13.836693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.836601 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerName="extract" Jun 02 04:50:13.836693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.836612 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerName="extract" Jun 02 04:50:13.836693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.836622 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerName="util" Jun 02 04:50:13.836693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.836627 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerName="util" Jun 02 04:50:13.836693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.836634 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerName="pull" Jun 02 04:50:13.836693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.836639 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerName="pull" Jun 02 04:50:13.836693 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.836695 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="e48da062-0e4b-42f1-be1a-a97364cdfe48" containerName="extract" Jun 02 04:50:13.839286 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.839264 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:13.841584 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.841559 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4kpvc\"" Jun 02 04:50:13.841714 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.841570 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 04:50:13.841714 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.841607 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 04:50:13.841714 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.841647 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 04:50:13.841714 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.841687 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 04:50:13.856238 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.856209 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f"] Jun 02 04:50:13.950142 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.950103 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce4886e-75af-49d8-8292-1f336be42bdd-tmp\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:13.950340 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.950165 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cce4886e-75af-49d8-8292-1f336be42bdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:13.950340 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.950239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj4z7\" (UniqueName: \"kubernetes.io/projected/cce4886e-75af-49d8-8292-1f336be42bdd-kube-api-access-lj4z7\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:13.950340 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.950301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cce4886e-75af-49d8-8292-1f336be42bdd-manifests\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:13.950340 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:13.950324 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cce4886e-75af-49d8-8292-1f336be42bdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.051323 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.051286 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cce4886e-75af-49d8-8292-1f336be42bdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.051504 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.051378 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lj4z7\" (UniqueName: \"kubernetes.io/projected/cce4886e-75af-49d8-8292-1f336be42bdd-kube-api-access-lj4z7\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.051504 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.051402 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cce4886e-75af-49d8-8292-1f336be42bdd-manifests\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.051504 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.051421 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cce4886e-75af-49d8-8292-1f336be42bdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.051504 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.051453 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce4886e-75af-49d8-8292-1f336be42bdd-tmp\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.051916 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.051889 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cce4886e-75af-49d8-8292-1f336be42bdd-manifests\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.053671 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.053648 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cce4886e-75af-49d8-8292-1f336be42bdd-tmp\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.054014 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.053994 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cce4886e-75af-49d8-8292-1f336be42bdd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.054099 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.054051 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cce4886e-75af-49d8-8292-1f336be42bdd-webhook-cert\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.058925 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.058906 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj4z7\" (UniqueName: \"kubernetes.io/projected/cce4886e-75af-49d8-8292-1f336be42bdd-kube-api-access-lj4z7\") pod \"opendatahub-operator-controller-manager-55fcdd494f-8fn9f\" (UID: \"cce4886e-75af-49d8-8292-1f336be42bdd\") " pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.149614 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.149523 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:14.288697 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.288668 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f"] Jun 02 04:50:14.291441 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:50:14.291408 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce4886e_75af_49d8_8292_1f336be42bdd.slice/crio-8da1bfcb9284a50dcd3df971cffbf5f96cf45c9d87e87a8916b48983ce789d67 WatchSource:0}: Error finding container 8da1bfcb9284a50dcd3df971cffbf5f96cf45c9d87e87a8916b48983ce789d67: Status 404 returned error can't find the container with id 8da1bfcb9284a50dcd3df971cffbf5f96cf45c9d87e87a8916b48983ce789d67 Jun 02 04:50:14.524202 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:14.524108 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" event={"ID":"cce4886e-75af-49d8-8292-1f336be42bdd","Type":"ContainerStarted","Data":"8da1bfcb9284a50dcd3df971cffbf5f96cf45c9d87e87a8916b48983ce789d67"} Jun 02 04:50:17.538738 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:17.538650 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" event={"ID":"cce4886e-75af-49d8-8292-1f336be42bdd","Type":"ContainerStarted","Data":"bbb622b0f05aa6e17bf51ed6c172a30c7e0817ab616cc6533d0e7e3b54029a2c"} Jun 02 04:50:18.544168 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:18.544078 2582 generic.go:358] "Generic (PLEG): container finished" podID="cce4886e-75af-49d8-8292-1f336be42bdd" containerID="bbb622b0f05aa6e17bf51ed6c172a30c7e0817ab616cc6533d0e7e3b54029a2c" exitCode=0 Jun 02 04:50:18.544168 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:18.544154 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" event={"ID":"cce4886e-75af-49d8-8292-1f336be42bdd","Type":"ContainerDied","Data":"bbb622b0f05aa6e17bf51ed6c172a30c7e0817ab616cc6533d0e7e3b54029a2c"} Jun 02 04:50:19.549742 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:19.549702 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" event={"ID":"cce4886e-75af-49d8-8292-1f336be42bdd","Type":"ContainerStarted","Data":"bd79daac1d470d4a4deb021920f875b0e2e287e00e99cde6edc620be14795c60"} Jun 02 04:50:19.550247 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:19.549860 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:19.570600 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:19.570554 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" podStartSLOduration=1.9096735649999999 podStartE2EDuration="6.570541974s" podCreationTimestamp="2026-06-02 04:50:13 +0000 UTC" firstStartedPulling="2026-06-02 04:50:14.293890484 +0000 UTC m=+465.841883296" lastFinishedPulling="2026-06-02 04:50:18.954758886 +0000 UTC m=+470.502751705" observedRunningTime="2026-06-02 04:50:19.569394184 +0000 UTC m=+471.117387019" watchObservedRunningTime="2026-06-02 04:50:19.570541974 +0000 UTC m=+471.118534808" Jun 02 04:50:30.555760 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:30.555724 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55fcdd494f-8fn9f" Jun 02 04:50:31.464292 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.464253 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb"] Jun 02 04:50:31.472866 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.472822 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.474964 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.474942 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 04:50:31.475566 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.475547 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 04:50:31.475661 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.475645 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 04:50:31.475724 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.475679 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 04:50:31.475724 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.475682 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 04:50:31.475861 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.475773 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fxwpl\"" Jun 02 04:50:31.477493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.477470 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712d0f76-132a-4af8-980e-4f6dd0cbaf31-cert\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.477604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.477557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/712d0f76-132a-4af8-980e-4f6dd0cbaf31-manager-config\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.477604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.477587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/712d0f76-132a-4af8-980e-4f6dd0cbaf31-metrics-cert\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.477722 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.477699 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62nht\" (UniqueName: \"kubernetes.io/projected/712d0f76-132a-4af8-980e-4f6dd0cbaf31-kube-api-access-62nht\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.479697 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.479675 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb"] Jun 02 04:50:31.578358 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.578324 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/712d0f76-132a-4af8-980e-4f6dd0cbaf31-manager-config\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.578887 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.578364 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/712d0f76-132a-4af8-980e-4f6dd0cbaf31-metrics-cert\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.578887 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.578438 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62nht\" (UniqueName: \"kubernetes.io/projected/712d0f76-132a-4af8-980e-4f6dd0cbaf31-kube-api-access-62nht\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.578887 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.578617 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712d0f76-132a-4af8-980e-4f6dd0cbaf31-cert\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.579058 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.578944 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/712d0f76-132a-4af8-980e-4f6dd0cbaf31-manager-config\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.580979 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.580962 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/712d0f76-132a-4af8-980e-4f6dd0cbaf31-metrics-cert\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.581088 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.581070 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712d0f76-132a-4af8-980e-4f6dd0cbaf31-cert\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.586970 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.586945 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62nht\" (UniqueName: \"kubernetes.io/projected/712d0f76-132a-4af8-980e-4f6dd0cbaf31-kube-api-access-62nht\") pod \"lws-controller-manager-6f46596686-hr5sb\" (UID: \"712d0f76-132a-4af8-980e-4f6dd0cbaf31\") " pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.783939 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.783847 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:31.919225 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:31.919196 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb"] Jun 02 04:50:31.921717 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:50:31.921679 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712d0f76_132a_4af8_980e_4f6dd0cbaf31.slice/crio-29c1385d68499ea775ac7e3f183ac18d66e984e56a23e20e7379ce396fb176f7 WatchSource:0}: Error finding container 29c1385d68499ea775ac7e3f183ac18d66e984e56a23e20e7379ce396fb176f7: Status 404 returned error can't find the container with id 29c1385d68499ea775ac7e3f183ac18d66e984e56a23e20e7379ce396fb176f7 Jun 02 04:50:32.607579 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.607542 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" event={"ID":"712d0f76-132a-4af8-980e-4f6dd0cbaf31","Type":"ContainerStarted","Data":"29c1385d68499ea775ac7e3f183ac18d66e984e56a23e20e7379ce396fb176f7"} Jun 02 04:50:32.823882 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.823822 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2"] Jun 02 04:50:32.827808 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.827777 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:32.830579 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.830546 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lwkd4\"" Jun 02 04:50:32.831029 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.831008 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 04:50:32.831234 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.831214 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 04:50:32.844606 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.844552 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2"] Jun 02 04:50:32.887262 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.887173 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:32.887262 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.887249 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:32.887548 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.887278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvnng\" (UniqueName: \"kubernetes.io/projected/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-kube-api-access-nvnng\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:32.988951 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.988821 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:32.988951 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.988923 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvnng\" (UniqueName: \"kubernetes.io/projected/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-kube-api-access-nvnng\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:32.989190 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.989048 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:32.989316 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.989291 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:32.989417 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:32.989388 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:33.001543 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:33.001505 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvnng\" (UniqueName: \"kubernetes.io/projected/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-kube-api-access-nvnng\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:33.140435 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:33.140351 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:33.320524 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:33.320488 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2"] Jun 02 04:50:33.567519 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:50:33.567434 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759690c8_f1d6_4d97_823d_7e1eb05e1ad0.slice/crio-e37ae0b7de45d43cd37e8d21b654139ed7e9edce2e709424fdd179a268c81611 WatchSource:0}: Error finding container e37ae0b7de45d43cd37e8d21b654139ed7e9edce2e709424fdd179a268c81611: Status 404 returned error can't find the container with id e37ae0b7de45d43cd37e8d21b654139ed7e9edce2e709424fdd179a268c81611 Jun 02 04:50:33.613324 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:33.613288 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" event={"ID":"759690c8-f1d6-4d97-823d-7e1eb05e1ad0","Type":"ContainerStarted","Data":"e37ae0b7de45d43cd37e8d21b654139ed7e9edce2e709424fdd179a268c81611"} Jun 02 04:50:34.618774 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:34.618739 2582 generic.go:358] "Generic (PLEG): container finished" podID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerID="ad91c3d5bc06c9e6012f60818d379e43b506fe5ebf9e5852cf5abfa961651b4e" exitCode=0 Jun 02 04:50:34.619244 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:34.618824 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" event={"ID":"759690c8-f1d6-4d97-823d-7e1eb05e1ad0","Type":"ContainerDied","Data":"ad91c3d5bc06c9e6012f60818d379e43b506fe5ebf9e5852cf5abfa961651b4e"} Jun 02 04:50:34.620184 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:34.620158 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" event={"ID":"712d0f76-132a-4af8-980e-4f6dd0cbaf31","Type":"ContainerStarted","Data":"5e07a07c33a747dedf02b8e609ef898ba9f10d3c66df98a6082c99d0acd4cb1c"} Jun 02 04:50:34.620278 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:34.620264 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:34.655414 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:34.655359 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" podStartSLOduration=1.951339307 podStartE2EDuration="3.655344412s" podCreationTimestamp="2026-06-02 04:50:31 +0000 UTC" firstStartedPulling="2026-06-02 04:50:31.923589893 +0000 UTC m=+483.471582707" lastFinishedPulling="2026-06-02 04:50:33.627594985 +0000 UTC m=+485.175587812" observedRunningTime="2026-06-02 04:50:34.653100642 +0000 UTC m=+486.201093477" watchObservedRunningTime="2026-06-02 04:50:34.655344412 +0000 UTC m=+486.203337246" Jun 02 04:50:35.625602 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:35.625562 2582 generic.go:358] "Generic (PLEG): container finished" podID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerID="22fa8e1055ac4068d447e1bba9f3713fd6c4a1ef669350cbf7204a0c5e45cf36" exitCode=0 Jun 02 04:50:35.625996 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:35.625634 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" event={"ID":"759690c8-f1d6-4d97-823d-7e1eb05e1ad0","Type":"ContainerDied","Data":"22fa8e1055ac4068d447e1bba9f3713fd6c4a1ef669350cbf7204a0c5e45cf36"} Jun 02 04:50:36.631679 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:36.631641 2582 generic.go:358] "Generic (PLEG): container finished" podID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerID="460d36ab0366b92c2f5457ed4e821467054decd3985b1d221479dcc8c8d1a232" exitCode=0 Jun 02 04:50:36.632086 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:36.631690 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" event={"ID":"759690c8-f1d6-4d97-823d-7e1eb05e1ad0","Type":"ContainerDied","Data":"460d36ab0366b92c2f5457ed4e821467054decd3985b1d221479dcc8c8d1a232"} Jun 02 04:50:37.759064 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.759037 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:37.833946 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.833907 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvnng\" (UniqueName: \"kubernetes.io/projected/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-kube-api-access-nvnng\") pod \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " Jun 02 04:50:37.834109 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.834013 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-bundle\") pod \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " Jun 02 04:50:37.834109 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.834035 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-util\") pod \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\" (UID: \"759690c8-f1d6-4d97-823d-7e1eb05e1ad0\") " Jun 02 04:50:37.834890 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.834860 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-bundle" (OuterVolumeSpecName: "bundle") pod "759690c8-f1d6-4d97-823d-7e1eb05e1ad0" (UID: "759690c8-f1d6-4d97-823d-7e1eb05e1ad0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:50:37.836189 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.836162 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-kube-api-access-nvnng" (OuterVolumeSpecName: "kube-api-access-nvnng") pod "759690c8-f1d6-4d97-823d-7e1eb05e1ad0" (UID: "759690c8-f1d6-4d97-823d-7e1eb05e1ad0"). InnerVolumeSpecName "kube-api-access-nvnng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:50:37.841761 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.841736 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-util" (OuterVolumeSpecName: "util") pod "759690c8-f1d6-4d97-823d-7e1eb05e1ad0" (UID: "759690c8-f1d6-4d97-823d-7e1eb05e1ad0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:50:37.935547 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.935460 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:37.935547 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.935488 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:37.935547 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:37.935498 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvnng\" (UniqueName: \"kubernetes.io/projected/759690c8-f1d6-4d97-823d-7e1eb05e1ad0-kube-api-access-nvnng\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:38.640752 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:38.640724 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" Jun 02 04:50:38.640752 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:38.640742 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835mn8k2" event={"ID":"759690c8-f1d6-4d97-823d-7e1eb05e1ad0","Type":"ContainerDied","Data":"e37ae0b7de45d43cd37e8d21b654139ed7e9edce2e709424fdd179a268c81611"} Jun 02 04:50:38.640985 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:38.640777 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e37ae0b7de45d43cd37e8d21b654139ed7e9edce2e709424fdd179a268c81611" Jun 02 04:50:45.627974 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:45.627936 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f46596686-hr5sb" Jun 02 04:50:47.013438 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.013401 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv"] Jun 02 04:50:47.013797 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.013759 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerName="util" Jun 02 04:50:47.013797 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.013771 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerName="util" Jun 02 04:50:47.013797 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.013798 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerName="extract" Jun 02 04:50:47.013933 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.013804 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerName="extract" Jun 02 04:50:47.013933 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.013816 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerName="pull" Jun 02 04:50:47.013933 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.013821 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerName="pull" Jun 02 04:50:47.013933 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.013902 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="759690c8-f1d6-4d97-823d-7e1eb05e1ad0" containerName="extract" Jun 02 04:50:47.017155 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.017138 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.052275 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.052239 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 04:50:47.052431 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.052271 2582 status_manager.go:895] "Failed to get status for pod" podUID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" err="pods \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" is forbidden: User \"system:node:ip-10-0-129-50.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-129-50.ec2.internal' and this object" Jun 02 04:50:47.052619 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.052604 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 04:50:47.052732 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.052715 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lwkd4\"" Jun 02 04:50:47.055567 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.055539 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv"] Jun 02 04:50:47.114995 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.114959 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.115177 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.115022 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.115177 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.115091 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7x7\" (UniqueName: \"kubernetes.io/projected/9a00b25e-7828-410a-b874-da0b2d7e1e4d-kube-api-access-sg7x7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.215805 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.215763 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7x7\" (UniqueName: \"kubernetes.io/projected/9a00b25e-7828-410a-b874-da0b2d7e1e4d-kube-api-access-sg7x7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.216004 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.215861 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.216004 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.215902 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.216343 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.216319 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.216379 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.216331 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.240715 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.240681 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7x7\" (UniqueName: \"kubernetes.io/projected/9a00b25e-7828-410a-b874-da0b2d7e1e4d-kube-api-access-sg7x7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.326273 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.326237 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:47.496785 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.496741 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv"] Jun 02 04:50:47.498766 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:50:47.498736 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a00b25e_7828_410a_b874_da0b2d7e1e4d.slice/crio-13f01ad062d00e0a6b1a129a0a0d78ef9934d76b14b78de8cea05dd0648c757d WatchSource:0}: Error finding container 13f01ad062d00e0a6b1a129a0a0d78ef9934d76b14b78de8cea05dd0648c757d: Status 404 returned error can't find the container with id 13f01ad062d00e0a6b1a129a0a0d78ef9934d76b14b78de8cea05dd0648c757d Jun 02 04:50:47.674927 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.674893 2582 generic.go:358] "Generic (PLEG): container finished" podID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerID="f050b454451bf6dd74e81538bf70c85a7eb679fa2e262f45dde1639b465164e6" exitCode=0 Jun 02 04:50:47.675119 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.674987 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" event={"ID":"9a00b25e-7828-410a-b874-da0b2d7e1e4d","Type":"ContainerDied","Data":"f050b454451bf6dd74e81538bf70c85a7eb679fa2e262f45dde1639b465164e6"} Jun 02 04:50:47.675119 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:47.675029 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" event={"ID":"9a00b25e-7828-410a-b874-da0b2d7e1e4d","Type":"ContainerStarted","Data":"13f01ad062d00e0a6b1a129a0a0d78ef9934d76b14b78de8cea05dd0648c757d"} Jun 02 04:50:48.681285 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.681243 2582 generic.go:358] "Generic (PLEG): container finished" podID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerID="d56bf0233e43e9661a112aec002544872b8f1ce7752f036a619b2946f7b78811" exitCode=0 Jun 02 04:50:48.681679 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.681318 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" event={"ID":"9a00b25e-7828-410a-b874-da0b2d7e1e4d","Type":"ContainerDied","Data":"d56bf0233e43e9661a112aec002544872b8f1ce7752f036a619b2946f7b78811"} Jun 02 04:50:48.684822 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.684798 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5bb69db85-fjt9v"] Jun 02 04:50:48.688181 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.688164 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" Jun 02 04:50:48.691451 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.690569 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 04:50:48.691451 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.690810 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m5rkv\"" Jun 02 04:50:48.701584 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.701553 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5bb69db85-fjt9v"] Jun 02 04:50:48.731204 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.731175 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t6fd\" (UniqueName: \"kubernetes.io/projected/f8530439-4ef0-41b2-bf6a-bdb8f102ddd1-kube-api-access-6t6fd\") pod \"dashboard-redirect-5bb69db85-fjt9v\" (UID: \"f8530439-4ef0-41b2-bf6a-bdb8f102ddd1\") " pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" Jun 02 04:50:48.731344 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.731236 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f8530439-4ef0-41b2-bf6a-bdb8f102ddd1-redirect-config\") pod \"dashboard-redirect-5bb69db85-fjt9v\" (UID: \"f8530439-4ef0-41b2-bf6a-bdb8f102ddd1\") " pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" Jun 02 04:50:48.832003 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.831963 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6t6fd\" (UniqueName: \"kubernetes.io/projected/f8530439-4ef0-41b2-bf6a-bdb8f102ddd1-kube-api-access-6t6fd\") pod \"dashboard-redirect-5bb69db85-fjt9v\" (UID: \"f8530439-4ef0-41b2-bf6a-bdb8f102ddd1\") " pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" Jun 02 04:50:48.832188 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.832038 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f8530439-4ef0-41b2-bf6a-bdb8f102ddd1-redirect-config\") pod \"dashboard-redirect-5bb69db85-fjt9v\" (UID: \"f8530439-4ef0-41b2-bf6a-bdb8f102ddd1\") " pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" Jun 02 04:50:48.832739 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.832716 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f8530439-4ef0-41b2-bf6a-bdb8f102ddd1-redirect-config\") pod \"dashboard-redirect-5bb69db85-fjt9v\" (UID: \"f8530439-4ef0-41b2-bf6a-bdb8f102ddd1\") " pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" Jun 02 04:50:48.846276 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:48.846247 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t6fd\" (UniqueName: \"kubernetes.io/projected/f8530439-4ef0-41b2-bf6a-bdb8f102ddd1-kube-api-access-6t6fd\") pod \"dashboard-redirect-5bb69db85-fjt9v\" (UID: \"f8530439-4ef0-41b2-bf6a-bdb8f102ddd1\") " pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" Jun 02 04:50:49.005133 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:49.005047 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" Jun 02 04:50:49.141797 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:49.141769 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5bb69db85-fjt9v"] Jun 02 04:50:49.143819 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:50:49.143790 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8530439_4ef0_41b2_bf6a_bdb8f102ddd1.slice/crio-6ee8c0cdddba6c50fbde80c7d6a401cdea5443692e020115aaa2be22b149a9ae WatchSource:0}: Error finding container 6ee8c0cdddba6c50fbde80c7d6a401cdea5443692e020115aaa2be22b149a9ae: Status 404 returned error can't find the container with id 6ee8c0cdddba6c50fbde80c7d6a401cdea5443692e020115aaa2be22b149a9ae Jun 02 04:50:49.685763 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:49.685719 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" event={"ID":"f8530439-4ef0-41b2-bf6a-bdb8f102ddd1","Type":"ContainerStarted","Data":"6ee8c0cdddba6c50fbde80c7d6a401cdea5443692e020115aaa2be22b149a9ae"} Jun 02 04:50:49.687501 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:49.687473 2582 generic.go:358] "Generic (PLEG): container finished" podID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerID="bcb211f29f5b76e8011bd2fd8643c2375de73878aa56bb4b1b4c763dfd5486f6" exitCode=0 Jun 02 04:50:49.687625 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:49.687567 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" event={"ID":"9a00b25e-7828-410a-b874-da0b2d7e1e4d","Type":"ContainerDied","Data":"bcb211f29f5b76e8011bd2fd8643c2375de73878aa56bb4b1b4c763dfd5486f6"} Jun 02 04:50:51.064108 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.064080 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:51.150133 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.150100 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-bundle\") pod \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " Jun 02 04:50:51.150280 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.150231 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-util\") pod \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " Jun 02 04:50:51.150344 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.150277 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg7x7\" (UniqueName: \"kubernetes.io/projected/9a00b25e-7828-410a-b874-da0b2d7e1e4d-kube-api-access-sg7x7\") pod \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\" (UID: \"9a00b25e-7828-410a-b874-da0b2d7e1e4d\") " Jun 02 04:50:51.151178 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.151153 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-bundle" (OuterVolumeSpecName: "bundle") pod "9a00b25e-7828-410a-b874-da0b2d7e1e4d" (UID: "9a00b25e-7828-410a-b874-da0b2d7e1e4d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:50:51.152750 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.152722 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a00b25e-7828-410a-b874-da0b2d7e1e4d-kube-api-access-sg7x7" (OuterVolumeSpecName: "kube-api-access-sg7x7") pod "9a00b25e-7828-410a-b874-da0b2d7e1e4d" (UID: "9a00b25e-7828-410a-b874-da0b2d7e1e4d"). InnerVolumeSpecName "kube-api-access-sg7x7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:50:51.159180 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.159137 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-util" (OuterVolumeSpecName: "util") pod "9a00b25e-7828-410a-b874-da0b2d7e1e4d" (UID: "9a00b25e-7828-410a-b874-da0b2d7e1e4d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:50:51.251173 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.251137 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:51.251173 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.251170 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg7x7\" (UniqueName: \"kubernetes.io/projected/9a00b25e-7828-410a-b874-da0b2d7e1e4d-kube-api-access-sg7x7\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:51.251173 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.251182 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a00b25e-7828-410a-b874-da0b2d7e1e4d-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:50:51.697317 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.697284 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" Jun 02 04:50:51.697317 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.697293 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7zhtv" event={"ID":"9a00b25e-7828-410a-b874-da0b2d7e1e4d","Type":"ContainerDied","Data":"13f01ad062d00e0a6b1a129a0a0d78ef9934d76b14b78de8cea05dd0648c757d"} Jun 02 04:50:51.697560 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.697328 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13f01ad062d00e0a6b1a129a0a0d78ef9934d76b14b78de8cea05dd0648c757d" Jun 02 04:50:51.698692 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.698659 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" event={"ID":"f8530439-4ef0-41b2-bf6a-bdb8f102ddd1","Type":"ContainerStarted","Data":"2ca3e102cd9019f04d01f4e95c0ad1febeb43634572cca122b453cc772da299c"} Jun 02 04:50:51.732493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:51.732445 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5bb69db85-fjt9v" podStartSLOduration=1.755517818 podStartE2EDuration="3.732430843s" podCreationTimestamp="2026-06-02 04:50:48 +0000 UTC" firstStartedPulling="2026-06-02 04:50:49.145090504 +0000 UTC m=+500.693083317" lastFinishedPulling="2026-06-02 04:50:51.122003529 +0000 UTC m=+502.669996342" observedRunningTime="2026-06-02 04:50:51.730205416 +0000 UTC m=+503.278198251" watchObservedRunningTime="2026-06-02 04:50:51.732430843 +0000 UTC m=+503.280423677" Jun 02 04:50:53.564553 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.564517 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd"] Jun 02 04:50:53.564942 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.564912 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerName="pull" Jun 02 04:50:53.564942 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.564926 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerName="pull" Jun 02 04:50:53.564942 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.564940 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerName="util" Jun 02 04:50:53.565042 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.564945 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerName="util" Jun 02 04:50:53.565042 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.564959 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerName="extract" Jun 02 04:50:53.565042 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.564965 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerName="extract" Jun 02 04:50:53.565042 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.565027 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a00b25e-7828-410a-b874-da0b2d7e1e4d" containerName="extract" Jun 02 04:50:53.567507 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.567489 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.569700 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.569614 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 04:50:53.569700 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.569676 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 04:50:53.569700 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.569685 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 04:50:53.569958 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.569679 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 04:50:53.569958 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.569740 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vj2g4\"" Jun 02 04:50:53.569958 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.569676 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 04:50:53.570226 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.570209 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 04:50:53.578953 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.578929 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd"] Jun 02 04:50:53.670383 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.670343 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9290a13-842b-4838-a616-2ca7394e4717-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.670571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.670414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.670571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.670431 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d9290a13-842b-4838-a616-2ca7394e4717-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.670571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.670478 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.670571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.670525 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9290a13-842b-4838-a616-2ca7394e4717-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.670571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.670551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.670733 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.670591 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcd29\" (UniqueName: \"kubernetes.io/projected/d9290a13-842b-4838-a616-2ca7394e4717-kube-api-access-hcd29\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.772155 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.772121 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9290a13-842b-4838-a616-2ca7394e4717-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.772343 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.772162 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.772343 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.772181 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d9290a13-842b-4838-a616-2ca7394e4717-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.772343 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.772217 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.772343 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.772261 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9290a13-842b-4838-a616-2ca7394e4717-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.772343 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.772287 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.772343 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.772304 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcd29\" (UniqueName: \"kubernetes.io/projected/d9290a13-842b-4838-a616-2ca7394e4717-kube-api-access-hcd29\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.773134 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.772939 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d9290a13-842b-4838-a616-2ca7394e4717-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.774761 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.774736 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9290a13-842b-4838-a616-2ca7394e4717-local-certs\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.774888 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.774816 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-cacerts\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.775289 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.775273 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.775332 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.775290 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d9290a13-842b-4838-a616-2ca7394e4717-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.780033 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.780009 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9290a13-842b-4838-a616-2ca7394e4717-istio-token\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.780283 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.780262 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcd29\" (UniqueName: \"kubernetes.io/projected/d9290a13-842b-4838-a616-2ca7394e4717-kube-api-access-hcd29\") pod \"istiod-openshift-gateway-798958bb55-4gccd\" (UID: \"d9290a13-842b-4838-a616-2ca7394e4717\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:53.878596 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:53.878553 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:54.016890 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:54.016861 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd"] Jun 02 04:50:54.019038 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:50:54.019012 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9290a13_842b_4838_a616_2ca7394e4717.slice/crio-d0ab82d037412853c46d1de34161dd558d2ce3c6948debde240834d410d7cd12 WatchSource:0}: Error finding container d0ab82d037412853c46d1de34161dd558d2ce3c6948debde240834d410d7cd12: Status 404 returned error can't find the container with id d0ab82d037412853c46d1de34161dd558d2ce3c6948debde240834d410d7cd12 Jun 02 04:50:54.710458 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:54.710415 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" event={"ID":"d9290a13-842b-4838-a616-2ca7394e4717","Type":"ContainerStarted","Data":"d0ab82d037412853c46d1de34161dd558d2ce3c6948debde240834d410d7cd12"} Jun 02 04:50:56.530311 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:56.530253 2582 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 02 04:50:56.530611 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:56.530345 2582 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 02 04:50:56.720482 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:56.720440 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" event={"ID":"d9290a13-842b-4838-a616-2ca7394e4717","Type":"ContainerStarted","Data":"3a678f613612cd0d95a0e8b08c7073cd1772100ce0b4cd6c942efe5fd27ab4fe"} Jun 02 04:50:56.720659 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:56.720557 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:50:56.742595 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:56.742540 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" podStartSLOduration=1.233708683 podStartE2EDuration="3.742523547s" podCreationTimestamp="2026-06-02 04:50:53 +0000 UTC" firstStartedPulling="2026-06-02 04:50:54.021115575 +0000 UTC m=+505.569108388" lastFinishedPulling="2026-06-02 04:50:56.529930427 +0000 UTC m=+508.077923252" observedRunningTime="2026-06-02 04:50:56.740187783 +0000 UTC m=+508.288180628" watchObservedRunningTime="2026-06-02 04:50:56.742523547 +0000 UTC m=+508.290516381" Jun 02 04:50:57.739388 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:57.739348 2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-4gccd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 04:50:57.739779 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:50:57.739413 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" podUID="d9290a13-842b-4838-a616-2ca7394e4717" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 04:51:00.738852 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:00.738797 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-4gccd" Jun 02 04:51:45.788646 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.788570 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn"] Jun 02 04:51:45.798990 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.798960 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.799929 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.799903 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn"] Jun 02 04:51:45.801208 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.801185 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 04:51:45.801330 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.801239 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 04:51:45.801596 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.801578 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vjddx\"" Jun 02 04:51:45.828726 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.828693 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.828726 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.828727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.828954 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.828802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4mvz\" (UniqueName: \"kubernetes.io/projected/59006bc7-c1d5-4c67-9afb-d8761031a607-kube-api-access-n4mvz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.929531 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.929497 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.929531 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.929533 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.929739 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.929604 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4mvz\" (UniqueName: \"kubernetes.io/projected/59006bc7-c1d5-4c67-9afb-d8761031a607-kube-api-access-n4mvz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.929935 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.929913 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.930005 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.929988 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:45.937423 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:45.937397 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4mvz\" (UniqueName: \"kubernetes.io/projected/59006bc7-c1d5-4c67-9afb-d8761031a607-kube-api-access-n4mvz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:46.109606 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.109554 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:46.248141 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.248113 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn"] Jun 02 04:51:46.250258 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:51:46.250227 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59006bc7_c1d5_4c67_9afb_d8761031a607.slice/crio-fdd2aca43cc0a9c8c7405604dedf14f1d13a7904b8fb238b4978dd26e03c7c00 WatchSource:0}: Error finding container fdd2aca43cc0a9c8c7405604dedf14f1d13a7904b8fb238b4978dd26e03c7c00: Status 404 returned error can't find the container with id fdd2aca43cc0a9c8c7405604dedf14f1d13a7904b8fb238b4978dd26e03c7c00 Jun 02 04:51:46.389481 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.389400 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw"] Jun 02 04:51:46.392042 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.392026 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.400217 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.400189 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw"] Jun 02 04:51:46.434359 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.434329 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.434489 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.434369 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknn5\" (UniqueName: \"kubernetes.io/projected/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-kube-api-access-vknn5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.434537 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.434507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.535679 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.535643 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vknn5\" (UniqueName: \"kubernetes.io/projected/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-kube-api-access-vknn5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.535875 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.535727 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.535875 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.535759 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.536104 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.536087 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.536159 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.536141 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.543749 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.543719 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknn5\" (UniqueName: \"kubernetes.io/projected/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-kube-api-access-vknn5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.728554 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.728464 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:46.859272 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.859247 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw"] Jun 02 04:51:46.861904 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:51:46.861875 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f54af0_5da5_4592_a8d5_54e8294ba1f8.slice/crio-3af9878b88a6364aa81930ffe91e3fda92e3a7d4301582fa3edc9fd0c49ae5f1 WatchSource:0}: Error finding container 3af9878b88a6364aa81930ffe91e3fda92e3a7d4301582fa3edc9fd0c49ae5f1: Status 404 returned error can't find the container with id 3af9878b88a6364aa81930ffe91e3fda92e3a7d4301582fa3edc9fd0c49ae5f1 Jun 02 04:51:46.925000 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.924968 2582 generic.go:358] "Generic (PLEG): container finished" podID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerID="0ff5081678223f7ac6a6c7f0bd3bb91bfdd885e4c3195ba3b7314524691670ab" exitCode=0 Jun 02 04:51:46.925149 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.925060 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" event={"ID":"59006bc7-c1d5-4c67-9afb-d8761031a607","Type":"ContainerDied","Data":"0ff5081678223f7ac6a6c7f0bd3bb91bfdd885e4c3195ba3b7314524691670ab"} Jun 02 04:51:46.925149 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.925102 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" event={"ID":"59006bc7-c1d5-4c67-9afb-d8761031a607","Type":"ContainerStarted","Data":"fdd2aca43cc0a9c8c7405604dedf14f1d13a7904b8fb238b4978dd26e03c7c00"} Jun 02 04:51:46.926926 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.926884 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" event={"ID":"f8f54af0-5da5-4592-a8d5-54e8294ba1f8","Type":"ContainerStarted","Data":"e1d0fbec6e85f542bf0e6131a5d522c48228e6675684b78f2bc314e835010fba"} Jun 02 04:51:46.926926 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.926921 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" event={"ID":"f8f54af0-5da5-4592-a8d5-54e8294ba1f8","Type":"ContainerStarted","Data":"3af9878b88a6364aa81930ffe91e3fda92e3a7d4301582fa3edc9fd0c49ae5f1"} Jun 02 04:51:46.987503 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.987426 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97"] Jun 02 04:51:46.990123 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.990105 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:46.998560 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:46.998535 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97"] Jun 02 04:51:47.040493 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.040465 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.040636 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.040510 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.040699 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.040648 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4gd9\" (UniqueName: \"kubernetes.io/projected/11422f6b-c079-482c-bfdd-cca48486fa18-kube-api-access-w4gd9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.141814 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.141763 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4gd9\" (UniqueName: \"kubernetes.io/projected/11422f6b-c079-482c-bfdd-cca48486fa18-kube-api-access-w4gd9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.142014 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.141866 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.142014 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.141907 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.142235 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.142214 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.142273 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.142237 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.149987 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.149960 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4gd9\" (UniqueName: \"kubernetes.io/projected/11422f6b-c079-482c-bfdd-cca48486fa18-kube-api-access-w4gd9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.336405 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.336372 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:47.475559 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.475534 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97"] Jun 02 04:51:47.477620 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:51:47.477592 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11422f6b_c079_482c_bfdd_cca48486fa18.slice/crio-b9795b6206ea0ac8d0b68af897e030a16c5228820f97bbb6fda0aa28709c5c97 WatchSource:0}: Error finding container b9795b6206ea0ac8d0b68af897e030a16c5228820f97bbb6fda0aa28709c5c97: Status 404 returned error can't find the container with id b9795b6206ea0ac8d0b68af897e030a16c5228820f97bbb6fda0aa28709c5c97 Jun 02 04:51:47.582418 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.582378 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h"] Jun 02 04:51:47.586362 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.586339 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.594988 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.594961 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h"] Jun 02 04:51:47.645473 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.645441 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.645607 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.645511 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sngwn\" (UniqueName: \"kubernetes.io/projected/0afc2544-97a9-4afd-b465-d3194209d801-kube-api-access-sngwn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.645607 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.645555 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.746266 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.746239 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.746388 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.746279 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sngwn\" (UniqueName: \"kubernetes.io/projected/0afc2544-97a9-4afd-b465-d3194209d801-kube-api-access-sngwn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.746388 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.746323 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.746706 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.746683 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.746792 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.746734 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.754682 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.754656 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sngwn\" (UniqueName: \"kubernetes.io/projected/0afc2544-97a9-4afd-b465-d3194209d801-kube-api-access-sngwn\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:47.932874 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.932755 2582 generic.go:358] "Generic (PLEG): container finished" podID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerID="e5de3e9fdf5962bfede31a9dd1babb2afdd59b3bd3582a71412ebaf2cc893259" exitCode=0 Jun 02 04:51:47.932874 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.932861 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" event={"ID":"59006bc7-c1d5-4c67-9afb-d8761031a607","Type":"ContainerDied","Data":"e5de3e9fdf5962bfede31a9dd1babb2afdd59b3bd3582a71412ebaf2cc893259"} Jun 02 04:51:47.934314 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.934290 2582 generic.go:358] "Generic (PLEG): container finished" podID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerID="e1d0fbec6e85f542bf0e6131a5d522c48228e6675684b78f2bc314e835010fba" exitCode=0 Jun 02 04:51:47.934449 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.934370 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" event={"ID":"f8f54af0-5da5-4592-a8d5-54e8294ba1f8","Type":"ContainerDied","Data":"e1d0fbec6e85f542bf0e6131a5d522c48228e6675684b78f2bc314e835010fba"} Jun 02 04:51:47.935875 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.935853 2582 generic.go:358] "Generic (PLEG): container finished" podID="11422f6b-c079-482c-bfdd-cca48486fa18" containerID="a50c4a80603891dd8e6065051a26aed470d5c3b9cfb8285ff6558cf853891945" exitCode=0 Jun 02 04:51:47.935969 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.935888 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" event={"ID":"11422f6b-c079-482c-bfdd-cca48486fa18","Type":"ContainerDied","Data":"a50c4a80603891dd8e6065051a26aed470d5c3b9cfb8285ff6558cf853891945"} Jun 02 04:51:47.935969 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.935910 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" event={"ID":"11422f6b-c079-482c-bfdd-cca48486fa18","Type":"ContainerStarted","Data":"b9795b6206ea0ac8d0b68af897e030a16c5228820f97bbb6fda0aa28709c5c97"} Jun 02 04:51:47.952240 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:47.952218 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:48.096984 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.096956 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h"] Jun 02 04:51:48.131785 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:51:48.131744 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0afc2544_97a9_4afd_b465_d3194209d801.slice/crio-fe8fd5dd9aef25b71d263b15c635e255e41f55ea7dfac13ead4068afac34f482 WatchSource:0}: Error finding container fe8fd5dd9aef25b71d263b15c635e255e41f55ea7dfac13ead4068afac34f482: Status 404 returned error can't find the container with id fe8fd5dd9aef25b71d263b15c635e255e41f55ea7dfac13ead4068afac34f482 Jun 02 04:51:48.942981 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.942945 2582 generic.go:358] "Generic (PLEG): container finished" podID="11422f6b-c079-482c-bfdd-cca48486fa18" containerID="6226c3859ce178d2986951999a94385c1e834bbe5b436562b1e47e2a1e628d5e" exitCode=0 Jun 02 04:51:48.943367 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.943031 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" event={"ID":"11422f6b-c079-482c-bfdd-cca48486fa18","Type":"ContainerDied","Data":"6226c3859ce178d2986951999a94385c1e834bbe5b436562b1e47e2a1e628d5e"} Jun 02 04:51:48.945168 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.945146 2582 generic.go:358] "Generic (PLEG): container finished" podID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerID="20050e71ebf3e2bd8336abbec0eed634a96070fc4c91e29603e8df4e9087cea4" exitCode=0 Jun 02 04:51:48.945271 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.945210 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" event={"ID":"59006bc7-c1d5-4c67-9afb-d8761031a607","Type":"ContainerDied","Data":"20050e71ebf3e2bd8336abbec0eed634a96070fc4c91e29603e8df4e9087cea4"} Jun 02 04:51:48.946622 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.946600 2582 generic.go:358] "Generic (PLEG): container finished" podID="0afc2544-97a9-4afd-b465-d3194209d801" containerID="03db43627af247107fe6bf254f8e3004d40a096fd005feba431e67872aa1d332" exitCode=0 Jun 02 04:51:48.946739 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.946674 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" event={"ID":"0afc2544-97a9-4afd-b465-d3194209d801","Type":"ContainerDied","Data":"03db43627af247107fe6bf254f8e3004d40a096fd005feba431e67872aa1d332"} Jun 02 04:51:48.946739 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.946690 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" event={"ID":"0afc2544-97a9-4afd-b465-d3194209d801","Type":"ContainerStarted","Data":"fe8fd5dd9aef25b71d263b15c635e255e41f55ea7dfac13ead4068afac34f482"} Jun 02 04:51:48.948428 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.948405 2582 generic.go:358] "Generic (PLEG): container finished" podID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerID="f393a74c015636758c768cb1e42b072704fa2cb79fb73a2adf05c94a8bf6bf7d" exitCode=0 Jun 02 04:51:48.948599 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:48.948521 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" event={"ID":"f8f54af0-5da5-4592-a8d5-54e8294ba1f8","Type":"ContainerDied","Data":"f393a74c015636758c768cb1e42b072704fa2cb79fb73a2adf05c94a8bf6bf7d"} Jun 02 04:51:49.953903 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:49.953806 2582 generic.go:358] "Generic (PLEG): container finished" podID="0afc2544-97a9-4afd-b465-d3194209d801" containerID="eae86ced4ee53f4a98f11dfde02defe6113a577ddf7f2b7e5d163ef7c57f44ee" exitCode=0 Jun 02 04:51:49.954286 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:49.953899 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" event={"ID":"0afc2544-97a9-4afd-b465-d3194209d801","Type":"ContainerDied","Data":"eae86ced4ee53f4a98f11dfde02defe6113a577ddf7f2b7e5d163ef7c57f44ee"} Jun 02 04:51:49.955909 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:49.955887 2582 generic.go:358] "Generic (PLEG): container finished" podID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerID="82d46cd38b87a8f6a1a1e3733cd8893388b3d6d31f582fd8d778e813b0c2551c" exitCode=0 Jun 02 04:51:49.956009 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:49.955966 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" event={"ID":"f8f54af0-5da5-4592-a8d5-54e8294ba1f8","Type":"ContainerDied","Data":"82d46cd38b87a8f6a1a1e3733cd8893388b3d6d31f582fd8d778e813b0c2551c"} Jun 02 04:51:49.957881 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:49.957860 2582 generic.go:358] "Generic (PLEG): container finished" podID="11422f6b-c079-482c-bfdd-cca48486fa18" containerID="1419234afe91018d02e3f01b1196021543aa7a27e7416ad4e20e6cca11b36620" exitCode=0 Jun 02 04:51:49.957990 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:49.957935 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" event={"ID":"11422f6b-c079-482c-bfdd-cca48486fa18","Type":"ContainerDied","Data":"1419234afe91018d02e3f01b1196021543aa7a27e7416ad4e20e6cca11b36620"} Jun 02 04:51:50.114313 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.114283 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:50.170764 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.170725 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-bundle\") pod \"59006bc7-c1d5-4c67-9afb-d8761031a607\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " Jun 02 04:51:50.170764 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.170764 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4mvz\" (UniqueName: \"kubernetes.io/projected/59006bc7-c1d5-4c67-9afb-d8761031a607-kube-api-access-n4mvz\") pod \"59006bc7-c1d5-4c67-9afb-d8761031a607\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " Jun 02 04:51:50.171039 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.170806 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-util\") pod \"59006bc7-c1d5-4c67-9afb-d8761031a607\" (UID: \"59006bc7-c1d5-4c67-9afb-d8761031a607\") " Jun 02 04:51:50.171239 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.171213 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-bundle" (OuterVolumeSpecName: "bundle") pod "59006bc7-c1d5-4c67-9afb-d8761031a607" (UID: "59006bc7-c1d5-4c67-9afb-d8761031a607"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:51:50.173187 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.173160 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59006bc7-c1d5-4c67-9afb-d8761031a607-kube-api-access-n4mvz" (OuterVolumeSpecName: "kube-api-access-n4mvz") pod "59006bc7-c1d5-4c67-9afb-d8761031a607" (UID: "59006bc7-c1d5-4c67-9afb-d8761031a607"). InnerVolumeSpecName "kube-api-access-n4mvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:51:50.176115 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.176087 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-util" (OuterVolumeSpecName: "util") pod "59006bc7-c1d5-4c67-9afb-d8761031a607" (UID: "59006bc7-c1d5-4c67-9afb-d8761031a607"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:51:50.272003 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.271922 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:50.272003 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.271957 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4mvz\" (UniqueName: \"kubernetes.io/projected/59006bc7-c1d5-4c67-9afb-d8761031a607-kube-api-access-n4mvz\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:50.272003 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.271969 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59006bc7-c1d5-4c67-9afb-d8761031a607-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:50.966068 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.966031 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" event={"ID":"59006bc7-c1d5-4c67-9afb-d8761031a607","Type":"ContainerDied","Data":"fdd2aca43cc0a9c8c7405604dedf14f1d13a7904b8fb238b4978dd26e03c7c00"} Jun 02 04:51:50.966068 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.966059 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn" Jun 02 04:51:50.966545 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.966075 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdd2aca43cc0a9c8c7405604dedf14f1d13a7904b8fb238b4978dd26e03c7c00" Jun 02 04:51:50.967938 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.967912 2582 generic.go:358] "Generic (PLEG): container finished" podID="0afc2544-97a9-4afd-b465-d3194209d801" containerID="feab7dba7073068a6a517daeab180749752570bfb5d4d42e9fa950279cf2e718" exitCode=0 Jun 02 04:51:50.968047 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:50.968011 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" event={"ID":"0afc2544-97a9-4afd-b465-d3194209d801","Type":"ContainerDied","Data":"feab7dba7073068a6a517daeab180749752570bfb5d4d42e9fa950279cf2e718"} Jun 02 04:51:51.123117 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.123093 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:51.126464 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.126425 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:51.180968 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.180935 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4gd9\" (UniqueName: \"kubernetes.io/projected/11422f6b-c079-482c-bfdd-cca48486fa18-kube-api-access-w4gd9\") pod \"11422f6b-c079-482c-bfdd-cca48486fa18\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " Jun 02 04:51:51.181137 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.180997 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vknn5\" (UniqueName: \"kubernetes.io/projected/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-kube-api-access-vknn5\") pod \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " Jun 02 04:51:51.181137 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.181031 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-bundle\") pod \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " Jun 02 04:51:51.181137 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.181127 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-util\") pod \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\" (UID: \"f8f54af0-5da5-4592-a8d5-54e8294ba1f8\") " Jun 02 04:51:51.181316 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.181167 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-bundle\") pod \"11422f6b-c079-482c-bfdd-cca48486fa18\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " Jun 02 04:51:51.181316 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.181205 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-util\") pod \"11422f6b-c079-482c-bfdd-cca48486fa18\" (UID: \"11422f6b-c079-482c-bfdd-cca48486fa18\") " Jun 02 04:51:51.181912 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.181858 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-bundle" (OuterVolumeSpecName: "bundle") pod "f8f54af0-5da5-4592-a8d5-54e8294ba1f8" (UID: "f8f54af0-5da5-4592-a8d5-54e8294ba1f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:51:51.181912 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.181854 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-bundle" (OuterVolumeSpecName: "bundle") pod "11422f6b-c079-482c-bfdd-cca48486fa18" (UID: "11422f6b-c079-482c-bfdd-cca48486fa18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:51:51.183414 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.183384 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11422f6b-c079-482c-bfdd-cca48486fa18-kube-api-access-w4gd9" (OuterVolumeSpecName: "kube-api-access-w4gd9") pod "11422f6b-c079-482c-bfdd-cca48486fa18" (UID: "11422f6b-c079-482c-bfdd-cca48486fa18"). InnerVolumeSpecName "kube-api-access-w4gd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:51:51.183677 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.183638 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-kube-api-access-vknn5" (OuterVolumeSpecName: "kube-api-access-vknn5") pod "f8f54af0-5da5-4592-a8d5-54e8294ba1f8" (UID: "f8f54af0-5da5-4592-a8d5-54e8294ba1f8"). InnerVolumeSpecName "kube-api-access-vknn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:51:51.190366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.190335 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-util" (OuterVolumeSpecName: "util") pod "f8f54af0-5da5-4592-a8d5-54e8294ba1f8" (UID: "f8f54af0-5da5-4592-a8d5-54e8294ba1f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:51:51.190569 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.190540 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-util" (OuterVolumeSpecName: "util") pod "11422f6b-c079-482c-bfdd-cca48486fa18" (UID: "11422f6b-c079-482c-bfdd-cca48486fa18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:51:51.282823 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.282728 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vknn5\" (UniqueName: \"kubernetes.io/projected/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-kube-api-access-vknn5\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:51.282823 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.282763 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:51.282823 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.282772 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8f54af0-5da5-4592-a8d5-54e8294ba1f8-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:51.282823 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.282781 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:51.282823 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.282789 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11422f6b-c079-482c-bfdd-cca48486fa18-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:51.282823 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.282797 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4gd9\" (UniqueName: \"kubernetes.io/projected/11422f6b-c079-482c-bfdd-cca48486fa18-kube-api-access-w4gd9\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:51.974322 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.974292 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" Jun 02 04:51:51.974746 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.974292 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw" event={"ID":"f8f54af0-5da5-4592-a8d5-54e8294ba1f8","Type":"ContainerDied","Data":"3af9878b88a6364aa81930ffe91e3fda92e3a7d4301582fa3edc9fd0c49ae5f1"} Jun 02 04:51:51.974746 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.974419 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3af9878b88a6364aa81930ffe91e3fda92e3a7d4301582fa3edc9fd0c49ae5f1" Jun 02 04:51:51.976147 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.976129 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" Jun 02 04:51:51.976147 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.976139 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97" event={"ID":"11422f6b-c079-482c-bfdd-cca48486fa18","Type":"ContainerDied","Data":"b9795b6206ea0ac8d0b68af897e030a16c5228820f97bbb6fda0aa28709c5c97"} Jun 02 04:51:51.976290 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:51.976161 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9795b6206ea0ac8d0b68af897e030a16c5228820f97bbb6fda0aa28709c5c97" Jun 02 04:51:52.109471 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.109448 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:51:52.190557 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.190526 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sngwn\" (UniqueName: \"kubernetes.io/projected/0afc2544-97a9-4afd-b465-d3194209d801-kube-api-access-sngwn\") pod \"0afc2544-97a9-4afd-b465-d3194209d801\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " Jun 02 04:51:52.190749 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.190581 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-bundle\") pod \"0afc2544-97a9-4afd-b465-d3194209d801\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " Jun 02 04:51:52.190749 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.190720 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-util\") pod \"0afc2544-97a9-4afd-b465-d3194209d801\" (UID: \"0afc2544-97a9-4afd-b465-d3194209d801\") " Jun 02 04:51:52.191164 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.191136 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-bundle" (OuterVolumeSpecName: "bundle") pod "0afc2544-97a9-4afd-b465-d3194209d801" (UID: "0afc2544-97a9-4afd-b465-d3194209d801"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:51:52.192821 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.192791 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0afc2544-97a9-4afd-b465-d3194209d801-kube-api-access-sngwn" (OuterVolumeSpecName: "kube-api-access-sngwn") pod "0afc2544-97a9-4afd-b465-d3194209d801" (UID: "0afc2544-97a9-4afd-b465-d3194209d801"). InnerVolumeSpecName "kube-api-access-sngwn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:51:52.196353 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.196318 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-util" (OuterVolumeSpecName: "util") pod "0afc2544-97a9-4afd-b465-d3194209d801" (UID: "0afc2544-97a9-4afd-b465-d3194209d801"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:51:52.291552 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.291470 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:52.291552 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.291499 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sngwn\" (UniqueName: \"kubernetes.io/projected/0afc2544-97a9-4afd-b465-d3194209d801-kube-api-access-sngwn\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:52.291552 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.291511 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0afc2544-97a9-4afd-b465-d3194209d801-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:51:52.982071 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.982039 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" event={"ID":"0afc2544-97a9-4afd-b465-d3194209d801","Type":"ContainerDied","Data":"fe8fd5dd9aef25b71d263b15c635e255e41f55ea7dfac13ead4068afac34f482"} Jun 02 04:51:52.982071 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.982073 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe8fd5dd9aef25b71d263b15c635e255e41f55ea7dfac13ead4068afac34f482" Jun 02 04:51:52.982497 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:51:52.982095 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h" Jun 02 04:52:18.114962 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:18.114924 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7966c78b57-g2xbn"] Jun 02 04:52:28.958727 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:28.958696 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:52:28.959718 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:28.959696 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:52:28.963275 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:28.963249 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:52:28.964122 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:28.964104 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:52:34.841111 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841073 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4"] Jun 02 04:52:34.841571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841508 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerName="util" Jun 02 04:52:34.841571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841522 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerName="util" Jun 02 04:52:34.841571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841533 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afc2544-97a9-4afd-b465-d3194209d801" containerName="extract" Jun 02 04:52:34.841571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841538 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afc2544-97a9-4afd-b465-d3194209d801" containerName="extract" Jun 02 04:52:34.841571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841548 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11422f6b-c079-482c-bfdd-cca48486fa18" containerName="extract" Jun 02 04:52:34.841571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841553 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="11422f6b-c079-482c-bfdd-cca48486fa18" containerName="extract" Jun 02 04:52:34.841571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841560 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11422f6b-c079-482c-bfdd-cca48486fa18" containerName="pull" Jun 02 04:52:34.841571 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841565 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="11422f6b-c079-482c-bfdd-cca48486fa18" containerName="pull" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841580 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11422f6b-c079-482c-bfdd-cca48486fa18" containerName="util" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841584 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="11422f6b-c079-482c-bfdd-cca48486fa18" containerName="util" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841591 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerName="extract" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841596 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerName="extract" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841602 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerName="util" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841607 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerName="util" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841613 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afc2544-97a9-4afd-b465-d3194209d801" containerName="pull" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841618 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afc2544-97a9-4afd-b465-d3194209d801" containerName="pull" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841625 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerName="pull" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841629 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerName="pull" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841635 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0afc2544-97a9-4afd-b465-d3194209d801" containerName="util" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841640 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0afc2544-97a9-4afd-b465-d3194209d801" containerName="util" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841646 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerName="pull" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841650 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerName="pull" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841656 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerName="extract" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841660 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerName="extract" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841716 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8f54af0-5da5-4592-a8d5-54e8294ba1f8" containerName="extract" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841725 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="59006bc7-c1d5-4c67-9afb-d8761031a607" containerName="extract" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841732 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="11422f6b-c079-482c-bfdd-cca48486fa18" containerName="extract" Jun 02 04:52:34.841815 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.841739 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="0afc2544-97a9-4afd-b465-d3194209d801" containerName="extract" Jun 02 04:52:34.845017 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.845001 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:34.847272 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.847243 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 04:52:34.847445 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.847332 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7jnt5\"" Jun 02 04:52:34.847518 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.847498 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 04:52:34.858824 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.858801 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4"] Jun 02 04:52:34.975153 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.975096 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvw6p\" (UniqueName: \"kubernetes.io/projected/5ae25c6b-e674-4b7c-99e2-3da1f3694687-kube-api-access-wvw6p\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l27n4\" (UID: \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:34.975344 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:34.975223 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae25c6b-e674-4b7c-99e2-3da1f3694687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l27n4\" (UID: \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:35.076029 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:35.075989 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw6p\" (UniqueName: \"kubernetes.io/projected/5ae25c6b-e674-4b7c-99e2-3da1f3694687-kube-api-access-wvw6p\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l27n4\" (UID: \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:35.076311 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:35.076067 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae25c6b-e674-4b7c-99e2-3da1f3694687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l27n4\" (UID: \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:35.076479 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:35.076458 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae25c6b-e674-4b7c-99e2-3da1f3694687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l27n4\" (UID: \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:35.085620 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:35.085597 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvw6p\" (UniqueName: \"kubernetes.io/projected/5ae25c6b-e674-4b7c-99e2-3da1f3694687-kube-api-access-wvw6p\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l27n4\" (UID: \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:35.155482 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:35.155395 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:35.318132 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:35.318107 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4"] Jun 02 04:52:35.319964 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:52:35.319932 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae25c6b_e674_4b7c_99e2_3da1f3694687.slice/crio-872f64b41745e5e0958b428caabe95321ea27884b142eab5fb49cd4e8887a3eb WatchSource:0}: Error finding container 872f64b41745e5e0958b428caabe95321ea27884b142eab5fb49cd4e8887a3eb: Status 404 returned error can't find the container with id 872f64b41745e5e0958b428caabe95321ea27884b142eab5fb49cd4e8887a3eb Jun 02 04:52:36.155352 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:36.155312 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" event={"ID":"5ae25c6b-e674-4b7c-99e2-3da1f3694687","Type":"ContainerStarted","Data":"872f64b41745e5e0958b428caabe95321ea27884b142eab5fb49cd4e8887a3eb"} Jun 02 04:52:40.179494 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:40.179458 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" event={"ID":"5ae25c6b-e674-4b7c-99e2-3da1f3694687","Type":"ContainerStarted","Data":"a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67"} Jun 02 04:52:40.201331 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:40.201270 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" podStartSLOduration=1.924736372 podStartE2EDuration="6.201255644s" podCreationTimestamp="2026-06-02 04:52:34 +0000 UTC" firstStartedPulling="2026-06-02 04:52:35.322239206 +0000 UTC m=+606.870232018" lastFinishedPulling="2026-06-02 04:52:39.598758474 +0000 UTC m=+611.146751290" observedRunningTime="2026-06-02 04:52:40.199634972 +0000 UTC m=+611.747627821" watchObservedRunningTime="2026-06-02 04:52:40.201255644 +0000 UTC m=+611.749248479" Jun 02 04:52:41.183145 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:41.183112 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:52:43.137670 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.137604 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7966c78b57-g2xbn" podUID="2a0f424e-4584-4125-994a-56b760c20e01" containerName="console" containerID="cri-o://9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4" gracePeriod=15 Jun 02 04:52:43.409476 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.409452 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7966c78b57-g2xbn_2a0f424e-4584-4125-994a-56b760c20e01/console/0.log" Jun 02 04:52:43.409603 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.409513 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:52:43.554923 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.554887 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ls2d\" (UniqueName: \"kubernetes.io/projected/2a0f424e-4584-4125-994a-56b760c20e01-kube-api-access-6ls2d\") pod \"2a0f424e-4584-4125-994a-56b760c20e01\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " Jun 02 04:52:43.554923 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.554931 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-service-ca\") pod \"2a0f424e-4584-4125-994a-56b760c20e01\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " Jun 02 04:52:43.555133 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.554954 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-console-config\") pod \"2a0f424e-4584-4125-994a-56b760c20e01\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " Jun 02 04:52:43.555133 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.554980 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-trusted-ca-bundle\") pod \"2a0f424e-4584-4125-994a-56b760c20e01\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " Jun 02 04:52:43.555133 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.555021 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-oauth-serving-cert\") pod \"2a0f424e-4584-4125-994a-56b760c20e01\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " Jun 02 04:52:43.555133 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.555058 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-serving-cert\") pod \"2a0f424e-4584-4125-994a-56b760c20e01\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " Jun 02 04:52:43.555133 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.555114 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-oauth-config\") pod \"2a0f424e-4584-4125-994a-56b760c20e01\" (UID: \"2a0f424e-4584-4125-994a-56b760c20e01\") " Jun 02 04:52:43.555391 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.555353 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-console-config" (OuterVolumeSpecName: "console-config") pod "2a0f424e-4584-4125-994a-56b760c20e01" (UID: "2a0f424e-4584-4125-994a-56b760c20e01"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:52:43.555459 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.555382 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-service-ca" (OuterVolumeSpecName: "service-ca") pod "2a0f424e-4584-4125-994a-56b760c20e01" (UID: "2a0f424e-4584-4125-994a-56b760c20e01"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:52:43.555572 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.555543 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2a0f424e-4584-4125-994a-56b760c20e01" (UID: "2a0f424e-4584-4125-994a-56b760c20e01"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:52:43.555627 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.555553 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2a0f424e-4584-4125-994a-56b760c20e01" (UID: "2a0f424e-4584-4125-994a-56b760c20e01"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 04:52:43.557363 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.557338 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a0f424e-4584-4125-994a-56b760c20e01-kube-api-access-6ls2d" (OuterVolumeSpecName: "kube-api-access-6ls2d") pod "2a0f424e-4584-4125-994a-56b760c20e01" (UID: "2a0f424e-4584-4125-994a-56b760c20e01"). InnerVolumeSpecName "kube-api-access-6ls2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:52:43.557557 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.557537 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2a0f424e-4584-4125-994a-56b760c20e01" (UID: "2a0f424e-4584-4125-994a-56b760c20e01"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:52:43.557602 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.557572 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2a0f424e-4584-4125-994a-56b760c20e01" (UID: "2a0f424e-4584-4125-994a-56b760c20e01"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 04:52:43.655972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.655876 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-trusted-ca-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:52:43.655972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.655909 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-oauth-serving-cert\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:52:43.655972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.655923 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-serving-cert\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:52:43.655972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.655936 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a0f424e-4584-4125-994a-56b760c20e01-console-oauth-config\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:52:43.655972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.655948 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ls2d\" (UniqueName: \"kubernetes.io/projected/2a0f424e-4584-4125-994a-56b760c20e01-kube-api-access-6ls2d\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:52:43.655972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.655962 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-service-ca\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:52:43.655972 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:43.655974 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a0f424e-4584-4125-994a-56b760c20e01-console-config\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:52:44.196640 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.196608 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7966c78b57-g2xbn_2a0f424e-4584-4125-994a-56b760c20e01/console/0.log" Jun 02 04:52:44.197100 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.196653 2582 generic.go:358] "Generic (PLEG): container finished" podID="2a0f424e-4584-4125-994a-56b760c20e01" containerID="9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4" exitCode=2 Jun 02 04:52:44.197100 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.196730 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7966c78b57-g2xbn" Jun 02 04:52:44.197100 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.196729 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7966c78b57-g2xbn" event={"ID":"2a0f424e-4584-4125-994a-56b760c20e01","Type":"ContainerDied","Data":"9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4"} Jun 02 04:52:44.197100 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.196849 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7966c78b57-g2xbn" event={"ID":"2a0f424e-4584-4125-994a-56b760c20e01","Type":"ContainerDied","Data":"9bb4fa03a01f691fb79240329efc9285b3e887f7ef920a0103afd01052ede756"} Jun 02 04:52:44.197100 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.196870 2582 scope.go:117] "RemoveContainer" containerID="9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4" Jun 02 04:52:44.207544 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.207521 2582 scope.go:117] "RemoveContainer" containerID="9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4" Jun 02 04:52:44.207885 ip-10-0-129-50 kubenswrapper[2582]: E0602 04:52:44.207860 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4\": container with ID starting with 9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4 not found: ID does not exist" containerID="9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4" Jun 02 04:52:44.207941 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.207898 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4"} err="failed to get container status \"9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4\": rpc error: code = NotFound desc = could not find container \"9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4\": container with ID starting with 9cbe75c82c426ed03dfabb5f3d5d3d2a30c7eaf189b6640c03e8e709883439e4 not found: ID does not exist" Jun 02 04:52:44.217925 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.217898 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7966c78b57-g2xbn"] Jun 02 04:52:44.221814 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:44.221791 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7966c78b57-g2xbn"] Jun 02 04:52:45.014097 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:45.014064 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a0f424e-4584-4125-994a-56b760c20e01" path="/var/lib/kubelet/pods/2a0f424e-4584-4125-994a-56b760c20e01/volumes" Jun 02 04:52:52.189589 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:52:52.189555 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 04:53:45.200022 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.199975 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2"] Jun 02 04:53:45.200587 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.200542 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a0f424e-4584-4125-994a-56b760c20e01" containerName="console" Jun 02 04:53:45.200587 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.200564 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a0f424e-4584-4125-994a-56b760c20e01" containerName="console" Jun 02 04:53:45.200715 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.200665 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a0f424e-4584-4125-994a-56b760c20e01" containerName="console" Jun 02 04:53:45.205181 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.205158 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.210574 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.210548 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-lwkd4\"" Jun 02 04:53:45.210710 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.210603 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 04:53:45.211024 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.211008 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 04:53:45.223032 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.223006 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2"] Jun 02 04:53:45.311844 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.311795 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.312036 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.311911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bm52\" (UniqueName: \"kubernetes.io/projected/b5d1e210-9463-469c-ae21-6901f84d2005-kube-api-access-2bm52\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.312036 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.311947 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.412762 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.412724 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.412950 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.412781 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bm52\" (UniqueName: \"kubernetes.io/projected/b5d1e210-9463-469c-ae21-6901f84d2005-kube-api-access-2bm52\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.412950 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.412809 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.413149 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.413127 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.413187 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.413166 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.425475 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.425454 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bm52\" (UniqueName: \"kubernetes.io/projected/b5d1e210-9463-469c-ae21-6901f84d2005-kube-api-access-2bm52\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.514774 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.514689 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:45.655171 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.655145 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2"] Jun 02 04:53:45.656856 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:53:45.656808 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d1e210_9463_469c_ae21_6901f84d2005.slice/crio-ecfd17179c3273e82f965688c7731c665d22c766a307e8f3e5bad70a93f523bd WatchSource:0}: Error finding container ecfd17179c3273e82f965688c7731c665d22c766a307e8f3e5bad70a93f523bd: Status 404 returned error can't find the container with id ecfd17179c3273e82f965688c7731c665d22c766a307e8f3e5bad70a93f523bd Jun 02 04:53:45.658802 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:45.658778 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 04:53:46.455610 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:46.455579 2582 generic.go:358] "Generic (PLEG): container finished" podID="b5d1e210-9463-469c-ae21-6901f84d2005" containerID="cdd8e51a66a7baf716170b2664c14daab45ef0d34659ef38b1b30273463dd984" exitCode=0 Jun 02 04:53:46.456067 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:46.455671 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" event={"ID":"b5d1e210-9463-469c-ae21-6901f84d2005","Type":"ContainerDied","Data":"cdd8e51a66a7baf716170b2664c14daab45ef0d34659ef38b1b30273463dd984"} Jun 02 04:53:46.456067 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:46.455709 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" event={"ID":"b5d1e210-9463-469c-ae21-6901f84d2005","Type":"ContainerStarted","Data":"ecfd17179c3273e82f965688c7731c665d22c766a307e8f3e5bad70a93f523bd"} Jun 02 04:53:47.461065 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:47.461028 2582 generic.go:358] "Generic (PLEG): container finished" podID="b5d1e210-9463-469c-ae21-6901f84d2005" containerID="e6b6ed17abf3bd4f99529095ce6413bc9d2dfe1a8b3a440b30e0805d35f84904" exitCode=0 Jun 02 04:53:47.461451 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:47.461113 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" event={"ID":"b5d1e210-9463-469c-ae21-6901f84d2005","Type":"ContainerDied","Data":"e6b6ed17abf3bd4f99529095ce6413bc9d2dfe1a8b3a440b30e0805d35f84904"} Jun 02 04:53:48.466366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:48.466333 2582 generic.go:358] "Generic (PLEG): container finished" podID="b5d1e210-9463-469c-ae21-6901f84d2005" containerID="9158290b3035aebec7672725b49e258894467998589566683d4f81997aaf5885" exitCode=0 Jun 02 04:53:48.466731 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:48.466477 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" event={"ID":"b5d1e210-9463-469c-ae21-6901f84d2005","Type":"ContainerDied","Data":"9158290b3035aebec7672725b49e258894467998589566683d4f81997aaf5885"} Jun 02 04:53:49.606568 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.606543 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:53:49.652549 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.652517 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-util\") pod \"b5d1e210-9463-469c-ae21-6901f84d2005\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " Jun 02 04:53:49.652728 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.652614 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-bundle\") pod \"b5d1e210-9463-469c-ae21-6901f84d2005\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " Jun 02 04:53:49.652728 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.652651 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bm52\" (UniqueName: \"kubernetes.io/projected/b5d1e210-9463-469c-ae21-6901f84d2005-kube-api-access-2bm52\") pod \"b5d1e210-9463-469c-ae21-6901f84d2005\" (UID: \"b5d1e210-9463-469c-ae21-6901f84d2005\") " Jun 02 04:53:49.653168 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.653134 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-bundle" (OuterVolumeSpecName: "bundle") pod "b5d1e210-9463-469c-ae21-6901f84d2005" (UID: "b5d1e210-9463-469c-ae21-6901f84d2005"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:53:49.654898 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.654870 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5d1e210-9463-469c-ae21-6901f84d2005-kube-api-access-2bm52" (OuterVolumeSpecName: "kube-api-access-2bm52") pod "b5d1e210-9463-469c-ae21-6901f84d2005" (UID: "b5d1e210-9463-469c-ae21-6901f84d2005"). InnerVolumeSpecName "kube-api-access-2bm52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:53:49.658051 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.658014 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-util" (OuterVolumeSpecName: "util") pod "b5d1e210-9463-469c-ae21-6901f84d2005" (UID: "b5d1e210-9463-469c-ae21-6901f84d2005"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 04:53:49.754056 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.753961 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-bundle\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:53:49.754056 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.754001 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bm52\" (UniqueName: \"kubernetes.io/projected/b5d1e210-9463-469c-ae21-6901f84d2005-kube-api-access-2bm52\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:53:49.754056 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:49.754012 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b5d1e210-9463-469c-ae21-6901f84d2005-util\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:53:50.476103 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:50.476065 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" event={"ID":"b5d1e210-9463-469c-ae21-6901f84d2005","Type":"ContainerDied","Data":"ecfd17179c3273e82f965688c7731c665d22c766a307e8f3e5bad70a93f523bd"} Jun 02 04:53:50.476103 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:50.476099 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecfd17179c3273e82f965688c7731c665d22c766a307e8f3e5bad70a93f523bd" Jun 02 04:53:50.476279 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:53:50.476106 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a708rtd2" Jun 02 04:54:07.959298 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.959260 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:54:07.959670 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.959655 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d1e210-9463-469c-ae21-6901f84d2005" containerName="pull" Jun 02 04:54:07.959670 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.959666 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d1e210-9463-469c-ae21-6901f84d2005" containerName="pull" Jun 02 04:54:07.959747 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.959678 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d1e210-9463-469c-ae21-6901f84d2005" containerName="util" Jun 02 04:54:07.959747 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.959683 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d1e210-9463-469c-ae21-6901f84d2005" containerName="util" Jun 02 04:54:07.959747 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.959697 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5d1e210-9463-469c-ae21-6901f84d2005" containerName="extract" Jun 02 04:54:07.959747 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.959703 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5d1e210-9463-469c-ae21-6901f84d2005" containerName="extract" Jun 02 04:54:07.959888 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.959756 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5d1e210-9463-469c-ae21-6901f84d2005" containerName="extract" Jun 02 04:54:07.963055 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.963037 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 04:54:07.965479 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.965458 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 04:54:07.965935 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.965916 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 04:54:07.965985 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.965932 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 04:54:07.966327 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.966311 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-ntgrp\"" Jun 02 04:54:07.973510 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:07.973484 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:54:08.113590 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:08.113544 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tkz4\" (UniqueName: \"kubernetes.io/projected/241e78e5-0e1a-4d91-a1fb-70dd3127757c-kube-api-access-2tkz4\") pod \"maas-keycloak-0\" (UID: \"241e78e5-0e1a-4d91-a1fb-70dd3127757c\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:54:08.214665 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:08.214571 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tkz4\" (UniqueName: \"kubernetes.io/projected/241e78e5-0e1a-4d91-a1fb-70dd3127757c-kube-api-access-2tkz4\") pod \"maas-keycloak-0\" (UID: \"241e78e5-0e1a-4d91-a1fb-70dd3127757c\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:54:08.224912 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:08.224888 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tkz4\" (UniqueName: \"kubernetes.io/projected/241e78e5-0e1a-4d91-a1fb-70dd3127757c-kube-api-access-2tkz4\") pod \"maas-keycloak-0\" (UID: \"241e78e5-0e1a-4d91-a1fb-70dd3127757c\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:54:08.273430 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:08.273397 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 04:54:08.417278 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:08.417251 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:54:08.418733 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:54:08.418704 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241e78e5_0e1a_4d91_a1fb_70dd3127757c.slice/crio-a4fe48ebf7af6cf2c189cbaf36ad647177c6d23b640b5fea158323cc58a79239 WatchSource:0}: Error finding container a4fe48ebf7af6cf2c189cbaf36ad647177c6d23b640b5fea158323cc58a79239: Status 404 returned error can't find the container with id a4fe48ebf7af6cf2c189cbaf36ad647177c6d23b640b5fea158323cc58a79239 Jun 02 04:54:08.552059 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:08.551974 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"241e78e5-0e1a-4d91-a1fb-70dd3127757c","Type":"ContainerStarted","Data":"a4fe48ebf7af6cf2c189cbaf36ad647177c6d23b640b5fea158323cc58a79239"} Jun 02 04:54:13.582177 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:13.582128 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"241e78e5-0e1a-4d91-a1fb-70dd3127757c","Type":"ContainerStarted","Data":"ad2a832fb7a11da7a6fa76b5a0503801bf824099dbe90edb0a944772338a39e6"} Jun 02 04:54:13.603028 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:13.602972 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.170033817 podStartE2EDuration="6.602958633s" podCreationTimestamp="2026-06-02 04:54:07 +0000 UTC" firstStartedPulling="2026-06-02 04:54:08.419924258 +0000 UTC m=+699.967917070" lastFinishedPulling="2026-06-02 04:54:12.85284907 +0000 UTC m=+704.400841886" observedRunningTime="2026-06-02 04:54:13.599575518 +0000 UTC m=+705.147568353" watchObservedRunningTime="2026-06-02 04:54:13.602958633 +0000 UTC m=+705.150951468" Jun 02 04:54:14.274188 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:14.274145 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 04:54:14.276301 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:14.276260 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:15.274104 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:15.274046 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:16.274425 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:16.274364 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:17.274538 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:17.274486 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:18.274685 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:18.274370 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 04:54:18.275775 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:18.275724 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:19.274035 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:19.273985 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:20.274366 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:20.274317 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:21.274159 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:21.274108 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:22.274398 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:22.274338 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:23.275021 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:23.274959 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:24.274742 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:24.274677 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:25.273890 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:25.273845 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.46:9000/health/started\": dial tcp 10.132.0.46:9000: connect: connection refused" Jun 02 04:54:26.395604 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:26.395551 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 04:54:26.415223 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:26.415168 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 04:54:36.402458 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:54:36.402417 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:18.368114 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.368073 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-9jqfw"] Jun 02 04:55:18.370689 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.370668 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" Jun 02 04:55:18.373018 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.372995 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 04:55:18.386844 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.386799 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-9jqfw"] Jun 02 04:55:18.487436 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.487398 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxpjb\" (UniqueName: \"kubernetes.io/projected/ea2083ce-0fd1-42da-971a-ec1ba9b03f5b-kube-api-access-sxpjb\") pod \"payload-processing-58b6c8fdc7-9jqfw\" (UID: \"ea2083ce-0fd1-42da-971a-ec1ba9b03f5b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" Jun 02 04:55:18.588080 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.588040 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxpjb\" (UniqueName: \"kubernetes.io/projected/ea2083ce-0fd1-42da-971a-ec1ba9b03f5b-kube-api-access-sxpjb\") pod \"payload-processing-58b6c8fdc7-9jqfw\" (UID: \"ea2083ce-0fd1-42da-971a-ec1ba9b03f5b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" Jun 02 04:55:18.606905 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.606875 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxpjb\" (UniqueName: \"kubernetes.io/projected/ea2083ce-0fd1-42da-971a-ec1ba9b03f5b-kube-api-access-sxpjb\") pod \"payload-processing-58b6c8fdc7-9jqfw\" (UID: \"ea2083ce-0fd1-42da-971a-ec1ba9b03f5b\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" Jun 02 04:55:18.681544 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.681442 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" Jun 02 04:55:18.816854 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.816808 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-9jqfw"] Jun 02 04:55:18.818738 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:55:18.818704 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2083ce_0fd1_42da_971a_ec1ba9b03f5b.slice/crio-4ab9a5ab50dfb45d3357a240d58ccac3c682e315c97ce197c1a4b6fff41cfdf8 WatchSource:0}: Error finding container 4ab9a5ab50dfb45d3357a240d58ccac3c682e315c97ce197c1a4b6fff41cfdf8: Status 404 returned error can't find the container with id 4ab9a5ab50dfb45d3357a240d58ccac3c682e315c97ce197c1a4b6fff41cfdf8 Jun 02 04:55:18.866744 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:18.866707 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" event={"ID":"ea2083ce-0fd1-42da-971a-ec1ba9b03f5b","Type":"ContainerStarted","Data":"4ab9a5ab50dfb45d3357a240d58ccac3c682e315c97ce197c1a4b6fff41cfdf8"} Jun 02 04:55:21.883306 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:21.883272 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" event={"ID":"ea2083ce-0fd1-42da-971a-ec1ba9b03f5b","Type":"ContainerStarted","Data":"c649ff8feb838ac812f001219fe79d450e2044d065c840cc4f3b8521a20f7147"} Jun 02 04:55:21.883306 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:21.883316 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" Jun 02 04:55:21.901500 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:21.901425 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" podStartSLOduration=1.682276246 podStartE2EDuration="3.901409672s" podCreationTimestamp="2026-06-02 04:55:18 +0000 UTC" firstStartedPulling="2026-06-02 04:55:18.820726155 +0000 UTC m=+770.368718968" lastFinishedPulling="2026-06-02 04:55:21.039859562 +0000 UTC m=+772.587852394" observedRunningTime="2026-06-02 04:55:21.900863081 +0000 UTC m=+773.448855908" watchObservedRunningTime="2026-06-02 04:55:21.901409672 +0000 UTC m=+773.449402538" Jun 02 04:55:29.038031 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:29.037997 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:55:29.038506 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:29.038256 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" containerID="cri-o://ad2a832fb7a11da7a6fa76b5a0503801bf824099dbe90edb0a944772338a39e6" gracePeriod=30 Jun 02 04:55:30.926591 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:30.926553 2582 generic.go:358] "Generic (PLEG): container finished" podID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerID="ad2a832fb7a11da7a6fa76b5a0503801bf824099dbe90edb0a944772338a39e6" exitCode=143 Jun 02 04:55:30.927051 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:30.926632 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"241e78e5-0e1a-4d91-a1fb-70dd3127757c","Type":"ContainerDied","Data":"ad2a832fb7a11da7a6fa76b5a0503801bf824099dbe90edb0a944772338a39e6"} Jun 02 04:55:31.081985 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.081960 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:31.211942 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.211817 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tkz4\" (UniqueName: \"kubernetes.io/projected/241e78e5-0e1a-4d91-a1fb-70dd3127757c-kube-api-access-2tkz4\") pod \"241e78e5-0e1a-4d91-a1fb-70dd3127757c\" (UID: \"241e78e5-0e1a-4d91-a1fb-70dd3127757c\") " Jun 02 04:55:31.214199 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.214168 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/241e78e5-0e1a-4d91-a1fb-70dd3127757c-kube-api-access-2tkz4" (OuterVolumeSpecName: "kube-api-access-2tkz4") pod "241e78e5-0e1a-4d91-a1fb-70dd3127757c" (UID: "241e78e5-0e1a-4d91-a1fb-70dd3127757c"). InnerVolumeSpecName "kube-api-access-2tkz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 04:55:31.313536 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.313500 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tkz4\" (UniqueName: \"kubernetes.io/projected/241e78e5-0e1a-4d91-a1fb-70dd3127757c-kube-api-access-2tkz4\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 04:55:31.931944 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.931908 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"241e78e5-0e1a-4d91-a1fb-70dd3127757c","Type":"ContainerDied","Data":"a4fe48ebf7af6cf2c189cbaf36ad647177c6d23b640b5fea158323cc58a79239"} Jun 02 04:55:31.932394 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.931957 2582 scope.go:117] "RemoveContainer" containerID="ad2a832fb7a11da7a6fa76b5a0503801bf824099dbe90edb0a944772338a39e6" Jun 02 04:55:31.932394 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.931920 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:31.955149 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.955111 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:55:31.959526 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.959498 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:55:31.984211 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.984139 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:55:31.984685 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.984664 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" Jun 02 04:55:31.984759 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.984688 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" Jun 02 04:55:31.984796 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.984768 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" containerName="keycloak" Jun 02 04:55:31.989113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.989096 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:31.991849 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.991770 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-ntgrp\"" Jun 02 04:55:31.991849 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.991772 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 04:55:31.992022 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.991871 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 04:55:31.992022 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.991892 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 04:55:31.992022 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:31.991930 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 02 04:55:32.002380 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.002351 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:55:32.119994 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.119941 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/18312536-b52c-4a2c-89a0-c12e82036122-test-realms\") pod \"maas-keycloak-0\" (UID: \"18312536-b52c-4a2c-89a0-c12e82036122\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:32.120182 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.120026 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzxcz\" (UniqueName: \"kubernetes.io/projected/18312536-b52c-4a2c-89a0-c12e82036122-kube-api-access-wzxcz\") pod \"maas-keycloak-0\" (UID: \"18312536-b52c-4a2c-89a0-c12e82036122\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:32.221287 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.221178 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/18312536-b52c-4a2c-89a0-c12e82036122-test-realms\") pod \"maas-keycloak-0\" (UID: \"18312536-b52c-4a2c-89a0-c12e82036122\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:32.221287 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.221251 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzxcz\" (UniqueName: \"kubernetes.io/projected/18312536-b52c-4a2c-89a0-c12e82036122-kube-api-access-wzxcz\") pod \"maas-keycloak-0\" (UID: \"18312536-b52c-4a2c-89a0-c12e82036122\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:32.221911 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.221890 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/18312536-b52c-4a2c-89a0-c12e82036122-test-realms\") pod \"maas-keycloak-0\" (UID: \"18312536-b52c-4a2c-89a0-c12e82036122\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:32.231062 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.231032 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzxcz\" (UniqueName: \"kubernetes.io/projected/18312536-b52c-4a2c-89a0-c12e82036122-kube-api-access-wzxcz\") pod \"maas-keycloak-0\" (UID: \"18312536-b52c-4a2c-89a0-c12e82036122\") " pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:32.299219 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.299173 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:32.435487 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.435462 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 04:55:32.437048 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:55:32.437022 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18312536_b52c_4a2c_89a0_c12e82036122.slice/crio-1c8b0d380387538ae2a34e4edfc0ad99cd705be412e11e82814adbfa9e796fea WatchSource:0}: Error finding container 1c8b0d380387538ae2a34e4edfc0ad99cd705be412e11e82814adbfa9e796fea: Status 404 returned error can't find the container with id 1c8b0d380387538ae2a34e4edfc0ad99cd705be412e11e82814adbfa9e796fea Jun 02 04:55:32.888983 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.888953 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-9jqfw" Jun 02 04:55:32.940008 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.939966 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"18312536-b52c-4a2c-89a0-c12e82036122","Type":"ContainerStarted","Data":"4f9d7a3b0f2cac6841851a4f0af02bd5c2d024ece369b2ccb57f42d3165db1e2"} Jun 02 04:55:32.940681 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.940015 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"18312536-b52c-4a2c-89a0-c12e82036122","Type":"ContainerStarted","Data":"1c8b0d380387538ae2a34e4edfc0ad99cd705be412e11e82814adbfa9e796fea"} Jun 02 04:55:32.980575 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:32.980518 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.6728017309999998 podStartE2EDuration="1.980502296s" podCreationTimestamp="2026-06-02 04:55:31 +0000 UTC" firstStartedPulling="2026-06-02 04:55:32.438423218 +0000 UTC m=+783.986416031" lastFinishedPulling="2026-06-02 04:55:32.746123783 +0000 UTC m=+784.294116596" observedRunningTime="2026-06-02 04:55:32.978682734 +0000 UTC m=+784.526675593" watchObservedRunningTime="2026-06-02 04:55:32.980502296 +0000 UTC m=+784.528495131" Jun 02 04:55:33.013811 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:33.013722 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="241e78e5-0e1a-4d91-a1fb-70dd3127757c" path="/var/lib/kubelet/pods/241e78e5-0e1a-4d91-a1fb-70dd3127757c/volumes" Jun 02 04:55:33.300202 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:33.300096 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:33.301947 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:33.301900 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:34.300699 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:34.300646 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:35.300113 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:35.300065 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:36.300332 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:36.300249 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:37.299811 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:37.299763 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:38.300096 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:38.300046 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:39.300190 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:39.300142 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:40.300390 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:40.300340 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:41.300237 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:41.300190 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:42.300362 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:42.300319 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:42.300868 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:42.300637 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:43.300241 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:43.300182 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:44.300080 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:44.300019 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:45.299930 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:45.299887 2582 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.48:9000/health/started\": dial tcp 10.132.0.48:9000: connect: connection refused" Jun 02 04:55:46.423136 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:46.423031 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 04:55:46.443516 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:46.443222 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="18312536-b52c-4a2c-89a0-c12e82036122" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 04:55:56.428968 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:55:56.428927 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 04:56:14.168771 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.168737 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt"] Jun 02 04:56:14.172752 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.172730 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.175252 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.175226 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 04:56:14.175886 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.175864 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2hdf7\"" Jun 02 04:56:14.175994 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.175888 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 04:56:14.175994 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.175888 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 04:56:14.183127 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.183104 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt"] Jun 02 04:56:14.322472 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.322430 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66aca300-a810-4a7e-9235-d2ea07adc31c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.322472 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.322482 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt9nj\" (UniqueName: \"kubernetes.io/projected/66aca300-a810-4a7e-9235-d2ea07adc31c-kube-api-access-jt9nj\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.322737 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.322507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.322737 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.322618 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.322737 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.322656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.322737 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.322711 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423207 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423114 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jt9nj\" (UniqueName: \"kubernetes.io/projected/66aca300-a810-4a7e-9235-d2ea07adc31c-kube-api-access-jt9nj\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423207 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423155 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423442 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423219 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423442 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423245 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423442 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423281 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423442 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423326 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66aca300-a810-4a7e-9235-d2ea07adc31c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423689 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423666 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423744 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423704 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.423785 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.423750 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.425776 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.425749 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66aca300-a810-4a7e-9235-d2ea07adc31c-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.426056 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.426038 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66aca300-a810-4a7e-9235-d2ea07adc31c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.431499 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.431475 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt9nj\" (UniqueName: \"kubernetes.io/projected/66aca300-a810-4a7e-9235-d2ea07adc31c-kube-api-access-jt9nj\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt\" (UID: \"66aca300-a810-4a7e-9235-d2ea07adc31c\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.483505 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.483468 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:14.626714 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:14.626678 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt"] Jun 02 04:56:14.628655 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:56:14.628619 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66aca300_a810_4a7e_9235_d2ea07adc31c.slice/crio-69c3dae0b288d956e4ca11a4d7d9e9d85344aee63d18b68e58387e9f894084fc WatchSource:0}: Error finding container 69c3dae0b288d956e4ca11a4d7d9e9d85344aee63d18b68e58387e9f894084fc: Status 404 returned error can't find the container with id 69c3dae0b288d956e4ca11a4d7d9e9d85344aee63d18b68e58387e9f894084fc Jun 02 04:56:15.139273 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:15.139225 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" event={"ID":"66aca300-a810-4a7e-9235-d2ea07adc31c","Type":"ContainerStarted","Data":"69c3dae0b288d956e4ca11a4d7d9e9d85344aee63d18b68e58387e9f894084fc"} Jun 02 04:56:18.155640 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:18.155587 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" event={"ID":"66aca300-a810-4a7e-9235-d2ea07adc31c","Type":"ContainerStarted","Data":"5b28af44fe1bb40383d83df33ee3d8da680e39255267e22b36a39d65521c80c9"} Jun 02 04:56:20.164812 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:20.164780 2582 generic.go:358] "Generic (PLEG): container finished" podID="66aca300-a810-4a7e-9235-d2ea07adc31c" containerID="5b28af44fe1bb40383d83df33ee3d8da680e39255267e22b36a39d65521c80c9" exitCode=0 Jun 02 04:56:20.165208 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:20.164861 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" event={"ID":"66aca300-a810-4a7e-9235-d2ea07adc31c","Type":"ContainerDied","Data":"5b28af44fe1bb40383d83df33ee3d8da680e39255267e22b36a39d65521c80c9"} Jun 02 04:56:22.174892 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:22.174859 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" event={"ID":"66aca300-a810-4a7e-9235-d2ea07adc31c","Type":"ContainerStarted","Data":"9a980b3ad484b224e10b297c2463dca64f61c421511a7ad9002ff4dc0bf5b54f"} Jun 02 04:56:22.195182 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:22.195132 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" podStartSLOduration=1.53241301 podStartE2EDuration="8.195118147s" podCreationTimestamp="2026-06-02 04:56:14 +0000 UTC" firstStartedPulling="2026-06-02 04:56:14.630536137 +0000 UTC m=+826.178528950" lastFinishedPulling="2026-06-02 04:56:21.293241259 +0000 UTC m=+832.841234087" observedRunningTime="2026-06-02 04:56:22.19464652 +0000 UTC m=+833.742639357" watchObservedRunningTime="2026-06-02 04:56:22.195118147 +0000 UTC m=+833.743110982" Jun 02 04:56:24.484584 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:24.484524 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:24.485090 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:24.484617 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:24.496900 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:24.496874 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:25.200152 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:25.200123 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt" Jun 02 04:56:32.464399 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.464362 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp"] Jun 02 04:56:32.482257 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.482214 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp"] Jun 02 04:56:32.482425 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.482379 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.485988 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.485962 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 04:56:32.598432 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.598381 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.598432 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.598424 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmrc6\" (UniqueName: \"kubernetes.io/projected/302d1a82-e8e8-42ec-8313-f979b9fee97c-kube-api-access-bmrc6\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.598700 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.598445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.598700 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.598513 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.598700 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.598557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.598700 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.598643 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/302d1a82-e8e8-42ec-8313-f979b9fee97c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.699889 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.699844 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/302d1a82-e8e8-42ec-8313-f979b9fee97c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.700088 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.699932 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.700088 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.699957 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmrc6\" (UniqueName: \"kubernetes.io/projected/302d1a82-e8e8-42ec-8313-f979b9fee97c-kube-api-access-bmrc6\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.700088 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.699983 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.700088 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.700008 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.700088 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.700035 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.700447 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.700424 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.700487 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.700468 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.700523 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.700493 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.702384 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.702361 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/302d1a82-e8e8-42ec-8313-f979b9fee97c-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.702902 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.702884 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/302d1a82-e8e8-42ec-8313-f979b9fee97c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.709700 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.709672 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmrc6\" (UniqueName: \"kubernetes.io/projected/302d1a82-e8e8-42ec-8313-f979b9fee97c-kube-api-access-bmrc6\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp\" (UID: \"302d1a82-e8e8-42ec-8313-f979b9fee97c\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.797759 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.797676 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:32.949599 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:32.944574 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp"] Jun 02 04:56:33.224804 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:33.224766 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" event={"ID":"302d1a82-e8e8-42ec-8313-f979b9fee97c","Type":"ContainerStarted","Data":"d21e4172ec02ac4fc25b13ebabf530b960b04f61840beaec7a65538732d35765"} Jun 02 04:56:33.224804 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:33.224807 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" event={"ID":"302d1a82-e8e8-42ec-8313-f979b9fee97c","Type":"ContainerStarted","Data":"ec4f62d5820c7d9da3a5655c8ea06e4104125d61c7867f55ad7440b9e361c961"} Jun 02 04:56:35.234865 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:35.234812 2582 generic.go:358] "Generic (PLEG): container finished" podID="302d1a82-e8e8-42ec-8313-f979b9fee97c" containerID="d21e4172ec02ac4fc25b13ebabf530b960b04f61840beaec7a65538732d35765" exitCode=0 Jun 02 04:56:35.235268 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:35.234886 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" event={"ID":"302d1a82-e8e8-42ec-8313-f979b9fee97c","Type":"ContainerDied","Data":"d21e4172ec02ac4fc25b13ebabf530b960b04f61840beaec7a65538732d35765"} Jun 02 04:56:36.240785 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:36.240753 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" event={"ID":"302d1a82-e8e8-42ec-8313-f979b9fee97c","Type":"ContainerStarted","Data":"4220044187befcf6690cb93f142a5b2f71aefaf9e33d64a531ce9c68526ca6f8"} Jun 02 04:56:36.263430 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:36.263370 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" podStartSLOduration=4.087375108 podStartE2EDuration="4.263356541s" podCreationTimestamp="2026-06-02 04:56:32 +0000 UTC" firstStartedPulling="2026-06-02 04:56:35.235522548 +0000 UTC m=+846.783515361" lastFinishedPulling="2026-06-02 04:56:35.411503976 +0000 UTC m=+846.959496794" observedRunningTime="2026-06-02 04:56:36.261032452 +0000 UTC m=+847.809025287" watchObservedRunningTime="2026-06-02 04:56:36.263356541 +0000 UTC m=+847.811349375" Jun 02 04:56:37.846247 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.846212 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v"] Jun 02 04:56:37.849344 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.849321 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:37.851939 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.851918 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 04:56:37.863361 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.863331 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v"] Jun 02 04:56:37.951076 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.951030 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:37.951254 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.951088 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:37.951254 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.951119 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:37.951254 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.951156 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgz8p\" (UniqueName: \"kubernetes.io/projected/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-kube-api-access-vgz8p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:37.951254 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.951231 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:37.951398 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:37.951306 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.052292 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052252 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.052292 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052292 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.052509 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052419 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.052509 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052481 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vgz8p\" (UniqueName: \"kubernetes.io/projected/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-kube-api-access-vgz8p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.052573 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052534 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.052633 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052615 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.052686 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052647 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.052993 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052966 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.053310 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.052996 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.054754 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.054734 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.055156 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.055138 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.061332 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.061312 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgz8p\" (UniqueName: \"kubernetes.io/projected/64ad14ca-b4cb-4adc-b2eb-c93d15e6655d-kube-api-access-vgz8p\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v\" (UID: \"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.159539 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.159455 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:38.314898 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:38.313287 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v"] Jun 02 04:56:39.255517 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:39.255480 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" event={"ID":"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d","Type":"ContainerStarted","Data":"8e5ea79054770990eacf1144fb3b6f8856e963ed3261968bd319b2afa7589303"} Jun 02 04:56:39.255954 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:39.255524 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" event={"ID":"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d","Type":"ContainerStarted","Data":"5d5dfb5684a68143744a9f356e6d374f2cac9cdf3b1aa9eabc725833289856f2"} Jun 02 04:56:40.260768 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:40.260731 2582 generic.go:358] "Generic (PLEG): container finished" podID="64ad14ca-b4cb-4adc-b2eb-c93d15e6655d" containerID="8e5ea79054770990eacf1144fb3b6f8856e963ed3261968bd319b2afa7589303" exitCode=0 Jun 02 04:56:40.261226 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:40.260781 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" event={"ID":"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d","Type":"ContainerDied","Data":"8e5ea79054770990eacf1144fb3b6f8856e963ed3261968bd319b2afa7589303"} Jun 02 04:56:41.266475 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:41.266430 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" event={"ID":"64ad14ca-b4cb-4adc-b2eb-c93d15e6655d","Type":"ContainerStarted","Data":"cc3a138627413bdc16de15564a4b2387478b91f8be435a1560d46000cf6a0352"} Jun 02 04:56:41.287657 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:41.287598 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" podStartSLOduration=4.061456953 podStartE2EDuration="4.287579499s" podCreationTimestamp="2026-06-02 04:56:37 +0000 UTC" firstStartedPulling="2026-06-02 04:56:40.261313758 +0000 UTC m=+851.809306571" lastFinishedPulling="2026-06-02 04:56:40.487436301 +0000 UTC m=+852.035429117" observedRunningTime="2026-06-02 04:56:41.285605118 +0000 UTC m=+852.833597950" watchObservedRunningTime="2026-06-02 04:56:41.287579499 +0000 UTC m=+852.835572336" Jun 02 04:56:42.798255 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:42.798208 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:42.798621 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:42.798268 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:42.810655 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:42.810625 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:43.293854 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:43.293789 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp" Jun 02 04:56:48.160335 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.160293 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:48.160713 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.160352 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:48.172630 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.172608 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:48.314137 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.314105 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v" Jun 02 04:56:48.559938 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.559852 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm"] Jun 02 04:56:48.564716 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.564689 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.567047 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.567012 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 04:56:48.572473 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.572447 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm"] Jun 02 04:56:48.653877 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.653807 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.654084 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.654033 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.654159 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.654090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.654159 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.654122 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.654159 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.654153 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.654308 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.654193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l79g\" (UniqueName: \"kubernetes.io/projected/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-kube-api-access-7l79g\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.755629 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.755588 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.755808 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.755638 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.755808 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.755659 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.755808 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.755680 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.755808 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.755701 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7l79g\" (UniqueName: \"kubernetes.io/projected/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-kube-api-access-7l79g\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.755808 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.755736 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.756105 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.756078 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.756154 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.756100 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.756193 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.756152 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.758320 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.758288 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.758453 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.758427 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.764040 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.764012 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l79g\" (UniqueName: \"kubernetes.io/projected/66b4fc76-522a-416e-ba82-f3ccd7e8f5e9-kube-api-access-7l79g\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm\" (UID: \"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:48.876579 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:48.876540 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:56:49.012188 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:49.012158 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm"] Jun 02 04:56:49.013915 ip-10-0-129-50 kubenswrapper[2582]: W0602 04:56:49.013889 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b4fc76_522a_416e_ba82_f3ccd7e8f5e9.slice/crio-343e1d9b7deb4f5d6aeed7c1b9a6b9c45a7ac5bc52df5c8378d4f3f112c7da6f WatchSource:0}: Error finding container 343e1d9b7deb4f5d6aeed7c1b9a6b9c45a7ac5bc52df5c8378d4f3f112c7da6f: Status 404 returned error can't find the container with id 343e1d9b7deb4f5d6aeed7c1b9a6b9c45a7ac5bc52df5c8378d4f3f112c7da6f Jun 02 04:56:49.308849 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:49.308730 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" event={"ID":"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9","Type":"ContainerStarted","Data":"dbf10f99dbb2ecf0b01b69f82422e9819ff45e17920c2ecfc39ba7189c8ccc4d"} Jun 02 04:56:49.308849 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:56:49.308775 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" event={"ID":"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9","Type":"ContainerStarted","Data":"343e1d9b7deb4f5d6aeed7c1b9a6b9c45a7ac5bc52df5c8378d4f3f112c7da6f"} Jun 02 04:57:01.365691 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:01.365652 2582 generic.go:358] "Generic (PLEG): container finished" podID="66b4fc76-522a-416e-ba82-f3ccd7e8f5e9" containerID="dbf10f99dbb2ecf0b01b69f82422e9819ff45e17920c2ecfc39ba7189c8ccc4d" exitCode=0 Jun 02 04:57:01.366189 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:01.365700 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" event={"ID":"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9","Type":"ContainerDied","Data":"dbf10f99dbb2ecf0b01b69f82422e9819ff45e17920c2ecfc39ba7189c8ccc4d"} Jun 02 04:57:02.371502 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:02.371467 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" event={"ID":"66b4fc76-522a-416e-ba82-f3ccd7e8f5e9","Type":"ContainerStarted","Data":"2a575078b8e8703dafe1b1af9fcf0183a64c18434861a78cafee48dbba79ff8d"} Jun 02 04:57:02.390410 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:02.390358 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" podStartSLOduration=14.050611666 podStartE2EDuration="14.39034225s" podCreationTimestamp="2026-06-02 04:56:48 +0000 UTC" firstStartedPulling="2026-06-02 04:57:01.366330267 +0000 UTC m=+872.914323081" lastFinishedPulling="2026-06-02 04:57:01.706060848 +0000 UTC m=+873.254053665" observedRunningTime="2026-06-02 04:57:02.390211918 +0000 UTC m=+873.938204755" watchObservedRunningTime="2026-06-02 04:57:02.39034225 +0000 UTC m=+873.938335085" Jun 02 04:57:08.876936 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:08.876896 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:57:08.876936 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:08.876942 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:57:08.889634 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:08.889601 2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:57:09.411191 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:09.411152 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm" Jun 02 04:57:29.000662 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:29.000571 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:57:29.003882 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:29.003822 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 04:57:29.006528 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:29.006501 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 04:57:29.009339 ip-10-0-129-50 kubenswrapper[2582]: I0602 04:57:29.009319 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:02:29.038319 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:02:29.038289 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:02:29.042529 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:02:29.042502 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:02:29.044332 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:02:29.044309 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:02:29.048251 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:02:29.048230 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:07:29.074412 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:07:29.074382 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:07:29.078558 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:07:29.078534 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:07:29.081012 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:07:29.080993 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:07:29.084784 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:07:29.084767 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:09:31.060984 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.060946 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4"] Jun 02 05:09:31.061480 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.061187 2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" podUID="5ae25c6b-e674-4b7c-99e2-3da1f3694687" containerName="manager" containerID="cri-o://a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67" gracePeriod=10 Jun 02 05:09:31.415898 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.415873 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 05:09:31.526673 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.526637 2582 generic.go:358] "Generic (PLEG): container finished" podID="5ae25c6b-e674-4b7c-99e2-3da1f3694687" containerID="a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67" exitCode=0 Jun 02 05:09:31.526870 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.526727 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" event={"ID":"5ae25c6b-e674-4b7c-99e2-3da1f3694687","Type":"ContainerDied","Data":"a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67"} Jun 02 05:09:31.526870 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.526755 2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" Jun 02 05:09:31.526870 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.526774 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4" event={"ID":"5ae25c6b-e674-4b7c-99e2-3da1f3694687","Type":"ContainerDied","Data":"872f64b41745e5e0958b428caabe95321ea27884b142eab5fb49cd4e8887a3eb"} Jun 02 05:09:31.526870 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.526790 2582 scope.go:117] "RemoveContainer" containerID="a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67" Jun 02 05:09:31.539054 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.539024 2582 scope.go:117] "RemoveContainer" containerID="a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67" Jun 02 05:09:31.539434 ip-10-0-129-50 kubenswrapper[2582]: E0602 05:09:31.539400 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67\": container with ID starting with a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67 not found: ID does not exist" containerID="a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67" Jun 02 05:09:31.539535 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.539437 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67"} err="failed to get container status \"a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67\": rpc error: code = NotFound desc = could not find container \"a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67\": container with ID starting with a85ee37709a92837eda78b954a44923f6e626ee88e198cb35f503e5ea1c7eb67 not found: ID does not exist" Jun 02 05:09:31.592621 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.592519 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvw6p\" (UniqueName: \"kubernetes.io/projected/5ae25c6b-e674-4b7c-99e2-3da1f3694687-kube-api-access-wvw6p\") pod \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\" (UID: \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\") " Jun 02 05:09:31.592621 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.592570 2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae25c6b-e674-4b7c-99e2-3da1f3694687-extensions-socket-volume\") pod \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\" (UID: \"5ae25c6b-e674-4b7c-99e2-3da1f3694687\") " Jun 02 05:09:31.593055 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.593022 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae25c6b-e674-4b7c-99e2-3da1f3694687-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5ae25c6b-e674-4b7c-99e2-3da1f3694687" (UID: "5ae25c6b-e674-4b7c-99e2-3da1f3694687"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:09:31.594786 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.594762 2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae25c6b-e674-4b7c-99e2-3da1f3694687-kube-api-access-wvw6p" (OuterVolumeSpecName: "kube-api-access-wvw6p") pod "5ae25c6b-e674-4b7c-99e2-3da1f3694687" (UID: "5ae25c6b-e674-4b7c-99e2-3da1f3694687"). InnerVolumeSpecName "kube-api-access-wvw6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:09:31.694182 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.694136 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvw6p\" (UniqueName: \"kubernetes.io/projected/5ae25c6b-e674-4b7c-99e2-3da1f3694687-kube-api-access-wvw6p\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 05:09:31.694182 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.694172 2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5ae25c6b-e674-4b7c-99e2-3da1f3694687-extensions-socket-volume\") on node \"ip-10-0-129-50.ec2.internal\" DevicePath \"\"" Jun 02 05:09:31.849299 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.849224 2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4"] Jun 02 05:09:31.853014 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:31.852985 2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l27n4"] Jun 02 05:09:33.009305 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:09:33.009272 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ae25c6b-e674-4b7c-99e2-3da1f3694687" path="/var/lib/kubelet/pods/5ae25c6b-e674-4b7c-99e2-3da1f3694687/volumes" Jun 02 05:10:37.185332 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.185294 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn"] Jun 02 05:10:37.185780 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.185684 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae25c6b-e674-4b7c-99e2-3da1f3694687" containerName="manager" Jun 02 05:10:37.185780 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.185697 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae25c6b-e674-4b7c-99e2-3da1f3694687" containerName="manager" Jun 02 05:10:37.185884 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.185789 2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ae25c6b-e674-4b7c-99e2-3da1f3694687" containerName="manager" Jun 02 05:10:37.189141 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.189122 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.191194 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.191165 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 05:10:37.191319 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.191218 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7jnt5\"" Jun 02 05:10:37.191319 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.191222 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 05:10:37.200283 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.200261 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn"] Jun 02 05:10:37.301104 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.301065 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eb64f0-0c09-47a0-8824-e42e58c108ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rmhxn\" (UID: \"25eb64f0-0c09-47a0-8824-e42e58c108ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.301283 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.301229 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpvx6\" (UniqueName: \"kubernetes.io/projected/25eb64f0-0c09-47a0-8824-e42e58c108ba-kube-api-access-gpvx6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rmhxn\" (UID: \"25eb64f0-0c09-47a0-8824-e42e58c108ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.401918 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.401876 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpvx6\" (UniqueName: \"kubernetes.io/projected/25eb64f0-0c09-47a0-8824-e42e58c108ba-kube-api-access-gpvx6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rmhxn\" (UID: \"25eb64f0-0c09-47a0-8824-e42e58c108ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.401918 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.401924 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eb64f0-0c09-47a0-8824-e42e58c108ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rmhxn\" (UID: \"25eb64f0-0c09-47a0-8824-e42e58c108ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.402381 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.402361 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eb64f0-0c09-47a0-8824-e42e58c108ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rmhxn\" (UID: \"25eb64f0-0c09-47a0-8824-e42e58c108ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.409924 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.409896 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpvx6\" (UniqueName: \"kubernetes.io/projected/25eb64f0-0c09-47a0-8824-e42e58c108ba-kube-api-access-gpvx6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-rmhxn\" (UID: \"25eb64f0-0c09-47a0-8824-e42e58c108ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.500735 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.500638 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.647806 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.647769 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn"] Jun 02 05:10:37.651245 ip-10-0-129-50 kubenswrapper[2582]: W0602 05:10:37.651217 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25eb64f0_0c09_47a0_8824_e42e58c108ba.slice/crio-f5ca959f25640993d08a0860aeb57df2b5acef30ddab99589f27fd5c2470c6a7 WatchSource:0}: Error finding container f5ca959f25640993d08a0860aeb57df2b5acef30ddab99589f27fd5c2470c6a7: Status 404 returned error can't find the container with id f5ca959f25640993d08a0860aeb57df2b5acef30ddab99589f27fd5c2470c6a7 Jun 02 05:10:37.654067 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.654048 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:10:37.802658 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.802563 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" event={"ID":"25eb64f0-0c09-47a0-8824-e42e58c108ba","Type":"ContainerStarted","Data":"fa6b4668248c972034ef04c72b662140cdc0797de9dbca7c190e6a4ad7c3dce9"} Jun 02 05:10:37.802658 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.802606 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" event={"ID":"25eb64f0-0c09-47a0-8824-e42e58c108ba","Type":"ContainerStarted","Data":"f5ca959f25640993d08a0860aeb57df2b5acef30ddab99589f27fd5c2470c6a7"} Jun 02 05:10:37.802861 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.802695 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:10:37.822545 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:37.822496 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" podStartSLOduration=0.822481751 podStartE2EDuration="822.481751ms" podCreationTimestamp="2026-06-02 05:10:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:10:37.819743533 +0000 UTC m=+1689.367736368" watchObservedRunningTime="2026-06-02 05:10:37.822481751 +0000 UTC m=+1689.370474586" Jun 02 05:10:48.809056 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:10:48.809024 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-rmhxn" Jun 02 05:12:29.112683 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:12:29.112646 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:12:29.117196 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:12:29.117174 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:12:29.123809 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:12:29.123786 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:12:29.127427 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:12:29.127409 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:17:29.153132 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:17:29.153099 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:17:29.157473 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:17:29.157445 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:17:29.160566 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:17:29.160542 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:17:29.164762 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:17:29.164744 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:17:53.116930 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:17:53.116884 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-q7bnv" podUID="5466ed00-ce4a-4163-b9d0-3576450522a7" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 05:17:53.117417 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:17:53.117003 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q7bnv" Jun 02 05:17:53.117668 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:17:53.117640 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-q7bnv" podUID="5466ed00-ce4a-4163-b9d0-3576450522a7" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 05:18:23.118439 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:18:23.118360 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q7bnv" Jun 02 05:20:46.447246 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:46.447211 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5bb69db85-fjt9v_f8530439-4ef0-41b2-bf6a-bdb8f102ddd1/nginx/0.log" Jun 02 05:20:47.630873 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:47.630820 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55fcdd494f-8fn9f_cce4886e-75af-49d8-8292-1f336be42bdd/manager/0.log" Jun 02 05:20:47.636606 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:47.636589 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55fcdd494f-8fn9f_cce4886e-75af-49d8-8292-1f336be42bdd/copy-manifests/0.log" Jun 02 05:20:48.761005 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:48.760966 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn_59006bc7-c1d5-4c67-9afb-d8761031a607/util/0.log" Jun 02 05:20:48.767101 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:48.767055 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn_59006bc7-c1d5-4c67-9afb-d8761031a607/pull/0.log" Jun 02 05:20:48.773150 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:48.773127 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn_59006bc7-c1d5-4c67-9afb-d8761031a607/extract/0.log" Jun 02 05:20:48.903376 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:48.903342 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97_11422f6b-c079-482c-bfdd-cca48486fa18/util/0.log" Jun 02 05:20:48.910120 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:48.910098 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97_11422f6b-c079-482c-bfdd-cca48486fa18/pull/0.log" Jun 02 05:20:48.916256 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:48.916231 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97_11422f6b-c079-482c-bfdd-cca48486fa18/extract/0.log" Jun 02 05:20:49.026311 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:49.026210 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw_f8f54af0-5da5-4592-a8d5-54e8294ba1f8/util/0.log" Jun 02 05:20:49.032506 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:49.032482 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw_f8f54af0-5da5-4592-a8d5-54e8294ba1f8/pull/0.log" Jun 02 05:20:49.038706 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:49.038684 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw_f8f54af0-5da5-4592-a8d5-54e8294ba1f8/extract/0.log" Jun 02 05:20:49.151885 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:49.151853 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h_0afc2544-97a9-4afd-b465-d3194209d801/util/0.log" Jun 02 05:20:49.158560 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:49.158536 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h_0afc2544-97a9-4afd-b465-d3194209d801/pull/0.log" Jun 02 05:20:49.164480 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:49.164461 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h_0afc2544-97a9-4afd-b465-d3194209d801/extract/0.log" Jun 02 05:20:49.874961 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:49.874929 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-rmhxn_25eb64f0-0c09-47a0-8824-e42e58c108ba/manager/0.log" Jun 02 05:20:50.592256 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:50.592223 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-4gccd_d9290a13-842b-4838-a616-2ca7394e4717/discovery/0.log" Jun 02 05:20:51.050765 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:51.050682 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-9jqfw_ea2083ce-0fd1-42da-971a-ec1ba9b03f5b/payload-processing/0.log" Jun 02 05:20:51.512019 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:51.511987 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt_66aca300-a810-4a7e-9235-d2ea07adc31c/storage-initializer/0.log" Jun 02 05:20:51.519967 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:51.519932 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-nbsnt_66aca300-a810-4a7e-9235-d2ea07adc31c/main/0.log" Jun 02 05:20:51.753562 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:51.753501 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp_302d1a82-e8e8-42ec-8313-f979b9fee97c/storage-initializer/0.log" Jun 02 05:20:51.761319 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:51.761279 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-lx5kp_302d1a82-e8e8-42ec-8313-f979b9fee97c/main/0.log" Jun 02 05:20:51.873250 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:51.873219 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v_64ad14ca-b4cb-4adc-b2eb-c93d15e6655d/storage-initializer/0.log" Jun 02 05:20:51.879983 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:51.879958 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9rrf9v_64ad14ca-b4cb-4adc-b2eb-c93d15e6655d/main/0.log" Jun 02 05:20:52.113660 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:52.113627 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm_66b4fc76-522a-416e-ba82-f3ccd7e8f5e9/storage-initializer/0.log" Jun 02 05:20:52.120862 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:52.120820 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-cjxzm_66b4fc76-522a-416e-ba82-f3ccd7e8f5e9/main/0.log" Jun 02 05:20:59.720515 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:59.720480 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2t6x7_14408def-e3d2-4108-b7c6-492f054ad6ea/global-pull-secret-syncer/0.log" Jun 02 05:20:59.889516 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:59.889481 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q7bnv_5466ed00-ce4a-4163-b9d0-3576450522a7/konnectivity-agent/0.log" Jun 02 05:20:59.939552 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:20:59.939521 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-50.ec2.internal_7cc66db09ee39134ad20f355fe1d0b01/haproxy/0.log" Jun 02 05:21:03.743638 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.743611 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn_59006bc7-c1d5-4c67-9afb-d8761031a607/extract/0.log" Jun 02 05:21:03.770358 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.770335 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn_59006bc7-c1d5-4c67-9afb-d8761031a607/util/0.log" Jun 02 05:21:03.793048 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.793022 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595fdtn_59006bc7-c1d5-4c67-9afb-d8761031a607/pull/0.log" Jun 02 05:21:03.826928 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.826897 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97_11422f6b-c079-482c-bfdd-cca48486fa18/extract/0.log" Jun 02 05:21:03.849092 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.849064 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97_11422f6b-c079-482c-bfdd-cca48486fa18/util/0.log" Jun 02 05:21:03.869555 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.869530 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pjn97_11422f6b-c079-482c-bfdd-cca48486fa18/pull/0.log" Jun 02 05:21:03.895736 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.895710 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw_f8f54af0-5da5-4592-a8d5-54e8294ba1f8/extract/0.log" Jun 02 05:21:03.920584 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.920560 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw_f8f54af0-5da5-4592-a8d5-54e8294ba1f8/util/0.log" Jun 02 05:21:03.940694 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.940667 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hqrtw_f8f54af0-5da5-4592-a8d5-54e8294ba1f8/pull/0.log" Jun 02 05:21:03.973948 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.973926 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h_0afc2544-97a9-4afd-b465-d3194209d801/extract/0.log" Jun 02 05:21:03.995240 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:03.995180 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h_0afc2544-97a9-4afd-b465-d3194209d801/util/0.log" Jun 02 05:21:04.015442 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:04.015420 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v966h_0afc2544-97a9-4afd-b465-d3194209d801/pull/0.log" Jun 02 05:21:04.422776 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:04.422741 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-rmhxn_25eb64f0-0c09-47a0-8824-e42e58c108ba/manager/0.log" Jun 02 05:21:05.726498 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:05.726469 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d49406e-265f-4759-966c-0928c916e1a0/alertmanager/0.log" Jun 02 05:21:05.757312 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:05.757284 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d49406e-265f-4759-966c-0928c916e1a0/config-reloader/0.log" Jun 02 05:21:05.786046 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:05.786019 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d49406e-265f-4759-966c-0928c916e1a0/kube-rbac-proxy-web/0.log" Jun 02 05:21:05.809893 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:05.809866 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d49406e-265f-4759-966c-0928c916e1a0/kube-rbac-proxy/0.log" Jun 02 05:21:05.834516 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:05.834489 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d49406e-265f-4759-966c-0928c916e1a0/kube-rbac-proxy-metric/0.log" Jun 02 05:21:05.876357 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:05.876329 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d49406e-265f-4759-966c-0928c916e1a0/prom-label-proxy/0.log" Jun 02 05:21:05.907105 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:05.907078 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0d49406e-265f-4759-966c-0928c916e1a0/init-config-reloader/0.log" Jun 02 05:21:05.944682 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:05.944648 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-kn98v_c9180170-1e56-4a59-a093-3e766feb6289/cluster-monitoring-operator/0.log" Jun 02 05:21:06.066246 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.066174 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-wm4qx_e3fb7970-46a2-47e5-963a-050cf7753abf/monitoring-plugin/0.log" Jun 02 05:21:06.172877 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.172818 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgmv6_6d1e75ba-69f1-4b32-9baa-3205c412328b/node-exporter/0.log" Jun 02 05:21:06.194806 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.194781 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgmv6_6d1e75ba-69f1-4b32-9baa-3205c412328b/kube-rbac-proxy/0.log" Jun 02 05:21:06.217707 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.217682 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rgmv6_6d1e75ba-69f1-4b32-9baa-3205c412328b/init-textfile/0.log" Jun 02 05:21:06.731848 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.731805 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-qp4tr_093c7b05-c8a1-4add-b32b-0a46adcc2188/prometheus-operator-admission-webhook/0.log" Jun 02 05:21:06.773793 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.773760 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7457df66-bmz79_c033e0d0-77e2-4727-9cb8-d01f786fdfa2/telemeter-client/0.log" Jun 02 05:21:06.795274 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.795242 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7457df66-bmz79_c033e0d0-77e2-4727-9cb8-d01f786fdfa2/reload/0.log" Jun 02 05:21:06.818932 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.818785 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7457df66-bmz79_c033e0d0-77e2-4727-9cb8-d01f786fdfa2/kube-rbac-proxy/0.log" Jun 02 05:21:06.855400 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.855368 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784c68ddc5-nl6gf_029e16e4-dcf9-4309-a4bd-bae1bd4d3e80/thanos-query/0.log" Jun 02 05:21:06.881784 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.881754 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784c68ddc5-nl6gf_029e16e4-dcf9-4309-a4bd-bae1bd4d3e80/kube-rbac-proxy-web/0.log" Jun 02 05:21:06.905147 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.905117 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784c68ddc5-nl6gf_029e16e4-dcf9-4309-a4bd-bae1bd4d3e80/kube-rbac-proxy/0.log" Jun 02 05:21:06.929328 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.929296 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784c68ddc5-nl6gf_029e16e4-dcf9-4309-a4bd-bae1bd4d3e80/prom-label-proxy/0.log" Jun 02 05:21:06.953441 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.953365 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784c68ddc5-nl6gf_029e16e4-dcf9-4309-a4bd-bae1bd4d3e80/kube-rbac-proxy-rules/0.log" Jun 02 05:21:06.975114 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:06.975087 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-784c68ddc5-nl6gf_029e16e4-dcf9-4309-a4bd-bae1bd4d3e80/kube-rbac-proxy-metrics/0.log" Jun 02 05:21:08.102540 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:08.102507 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-cs4nm_0e126c07-8905-4d3d-b2f5-00616074853a/networking-console-plugin/0.log" Jun 02 05:21:08.660181 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:08.660154 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/2.log" Jun 02 05:21:08.664240 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:08.664216 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-drtb2_ef9b0d9b-8e87-402f-b1d0-4b9df9cc870d/console-operator/3.log" Jun 02 05:21:09.732077 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.732043 2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98"] Jun 02 05:21:09.735789 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.735765 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.738339 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.738287 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf6h5\"/\"kube-root-ca.crt\"" Jun 02 05:21:09.738459 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.738366 2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mf6h5\"/\"openshift-service-ca.crt\"" Jun 02 05:21:09.738978 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.738778 2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mf6h5\"/\"default-dockercfg-s222j\"" Jun 02 05:21:09.745272 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.745248 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98"] Jun 02 05:21:09.793278 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.793230 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-lpgdz_271c680b-a894-4ed2-98ac-8d1d5c876790/volume-data-source-validator/0.log" Jun 02 05:21:09.853962 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.853930 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-podres\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.853962 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.853978 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-lib-modules\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.854230 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.854006 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-proc\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.854230 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.854073 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-sys\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.854230 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.854135 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2gg9\" (UniqueName: \"kubernetes.io/projected/2b1f1703-048d-484c-94c0-da92135bffff-kube-api-access-l2gg9\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955404 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955364 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-sys\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955576 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955419 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l2gg9\" (UniqueName: \"kubernetes.io/projected/2b1f1703-048d-484c-94c0-da92135bffff-kube-api-access-l2gg9\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955576 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955471 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-podres\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955576 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955500 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-lib-modules\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955576 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955529 2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-proc\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955576 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955524 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-sys\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955793 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955608 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-proc\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955793 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955632 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-podres\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.955793 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.955632 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b1f1703-048d-484c-94c0-da92135bffff-lib-modules\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:09.963580 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:09.963559 2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2gg9\" (UniqueName: \"kubernetes.io/projected/2b1f1703-048d-484c-94c0-da92135bffff-kube-api-access-l2gg9\") pod \"perf-node-gather-daemonset-xxn98\" (UID: \"2b1f1703-048d-484c-94c0-da92135bffff\") " pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:10.047370 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.047284 2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:10.186802 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.186778 2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98"] Jun 02 05:21:10.188037 ip-10-0-129-50 kubenswrapper[2582]: W0602 05:21:10.188005 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b1f1703_048d_484c_94c0_da92135bffff.slice/crio-bbf586716f13476ce3e670dc9214d3960541b49e2f92a646d13023051b8ca80f WatchSource:0}: Error finding container bbf586716f13476ce3e670dc9214d3960541b49e2f92a646d13023051b8ca80f: Status 404 returned error can't find the container with id bbf586716f13476ce3e670dc9214d3960541b49e2f92a646d13023051b8ca80f Jun 02 05:21:10.190053 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.190033 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:21:10.447030 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.446987 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" event={"ID":"2b1f1703-048d-484c-94c0-da92135bffff","Type":"ContainerStarted","Data":"952ccf0eea9df48559f820bbe842c1330ede33ad6164a56e0b6562d9f198695d"} Jun 02 05:21:10.447030 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.447034 2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" event={"ID":"2b1f1703-048d-484c-94c0-da92135bffff","Type":"ContainerStarted","Data":"bbf586716f13476ce3e670dc9214d3960541b49e2f92a646d13023051b8ca80f"} Jun 02 05:21:10.447243 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.447088 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:10.465426 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.465372 2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" podStartSLOduration=1.465356811 podStartE2EDuration="1.465356811s" podCreationTimestamp="2026-06-02 05:21:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:21:10.463490774 +0000 UTC m=+2322.011483610" watchObservedRunningTime="2026-06-02 05:21:10.465356811 +0000 UTC m=+2322.013349645" Jun 02 05:21:10.651203 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.651173 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fg8d6_1b4f34f7-87d4-4e3d-8b16-c6b4565b2525/dns/0.log" Jun 02 05:21:10.673429 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.673401 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fg8d6_1b4f34f7-87d4-4e3d-8b16-c6b4565b2525/kube-rbac-proxy/0.log" Jun 02 05:21:10.807160 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:10.807134 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2jvdg_e13e1144-840d-4398-8d98-5be590db9c25/dns-node-resolver/0.log" Jun 02 05:21:11.352767 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:11.352736 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zm68m_f9b14777-6686-408f-94f8-9db173624233/node-ca/0.log" Jun 02 05:21:12.272779 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:12.272732 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-4gccd_d9290a13-842b-4838-a616-2ca7394e4717/discovery/0.log" Jun 02 05:21:12.428250 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:12.428217 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-9jqfw_ea2083ce-0fd1-42da-971a-ec1ba9b03f5b/payload-processing/0.log" Jun 02 05:21:12.994124 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:12.994091 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n9q5d_fa57166d-8b60-43e2-a03c-69ed60cc8e73/serve-healthcheck-canary/0.log" Jun 02 05:21:13.480305 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:13.480268 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-8sb54_7726b5ba-197e-4879-baee-9bbaf52ec489/insights-operator/0.log" Jun 02 05:21:13.480696 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:13.480476 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-8sb54_7726b5ba-197e-4879-baee-9bbaf52ec489/insights-operator/1.log" Jun 02 05:21:13.641869 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:13.641817 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znbl9_558eb416-dd7b-4772-90ce-33ab1ca45b27/kube-rbac-proxy/0.log" Jun 02 05:21:13.661850 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:13.661788 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znbl9_558eb416-dd7b-4772-90ce-33ab1ca45b27/exporter/0.log" Jun 02 05:21:13.684762 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:13.684738 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znbl9_558eb416-dd7b-4772-90ce-33ab1ca45b27/extractor/0.log" Jun 02 05:21:15.746951 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:15.746926 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5bb69db85-fjt9v_f8530439-4ef0-41b2-bf6a-bdb8f102ddd1/nginx/0.log" Jun 02 05:21:16.103645 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:16.103618 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55fcdd494f-8fn9f_cce4886e-75af-49d8-8292-1f336be42bdd/manager/0.log" Jun 02 05:21:16.122956 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:16.122928 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55fcdd494f-8fn9f_cce4886e-75af-49d8-8292-1f336be42bdd/copy-manifests/0.log" Jun 02 05:21:16.468522 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:16.468425 2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mf6h5/perf-node-gather-daemonset-xxn98" Jun 02 05:21:17.675687 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:17.675657 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f46596686-hr5sb_712d0f76-132a-4af8-980e-4f6dd0cbaf31/manager/0.log" Jun 02 05:21:22.633158 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:22.633122 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-c7k9s_a57e33ff-f38a-43cf-bfd5-44c662851c0d/migrator/0.log" Jun 02 05:21:22.660536 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:22.660506 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-c7k9s_a57e33ff-f38a-43cf-bfd5-44c662851c0d/graceful-termination/0.log" Jun 02 05:21:24.411942 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.411913 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xr6nk_d77b1c01-cd50-4802-a942-c501a8880df0/kube-multus-additional-cni-plugins/0.log" Jun 02 05:21:24.432094 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.432067 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xr6nk_d77b1c01-cd50-4802-a942-c501a8880df0/egress-router-binary-copy/0.log" Jun 02 05:21:24.451448 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.451424 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xr6nk_d77b1c01-cd50-4802-a942-c501a8880df0/cni-plugins/0.log" Jun 02 05:21:24.477467 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.477444 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xr6nk_d77b1c01-cd50-4802-a942-c501a8880df0/bond-cni-plugin/0.log" Jun 02 05:21:24.529009 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.528977 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xr6nk_d77b1c01-cd50-4802-a942-c501a8880df0/routeoverride-cni/0.log" Jun 02 05:21:24.587180 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.587151 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xr6nk_d77b1c01-cd50-4802-a942-c501a8880df0/whereabouts-cni-bincopy/0.log" Jun 02 05:21:24.639740 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.639712 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xr6nk_d77b1c01-cd50-4802-a942-c501a8880df0/whereabouts-cni/0.log" Jun 02 05:21:24.718703 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.718622 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qkgrz_cbd9129e-b2bf-41fb-9df4-9df29bbd16c7/kube-multus/0.log" Jun 02 05:21:24.813190 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.813162 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pq546_401fe11a-e1ab-48a1-9211-60714444024a/network-metrics-daemon/0.log" Jun 02 05:21:24.834171 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:24.834145 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pq546_401fe11a-e1ab-48a1-9211-60714444024a/kube-rbac-proxy/0.log" Jun 02 05:21:25.677239 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.677203 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-controller/0.log" Jun 02 05:21:25.693601 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.693565 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/0.log" Jun 02 05:21:25.704606 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.704583 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovn-acl-logging/1.log" Jun 02 05:21:25.723803 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.723784 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/kube-rbac-proxy-node/0.log" Jun 02 05:21:25.743415 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.743393 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 05:21:25.761529 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.761502 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/northd/0.log" Jun 02 05:21:25.781022 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.780999 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/nbdb/0.log" Jun 02 05:21:25.801233 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.801209 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/sbdb/0.log" Jun 02 05:21:25.899179 ip-10-0-129-50 kubenswrapper[2582]: I0602 05:21:25.899149 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dgf7w_5076649b-86c8-4e4a-b653-181e816bccef/ovnkube-controller/0.log"