Jun 02 20:02:08.135801 ip-10-0-137-123 systemd[1]: Starting Kubernetes Kubelet... Jun 02 20:02:08.574292 ip-10-0-137-123 kubenswrapper[2544]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 20:02:08.574292 ip-10-0-137-123 kubenswrapper[2544]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 20:02:08.574292 ip-10-0-137-123 kubenswrapper[2544]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 20:02:08.574292 ip-10-0-137-123 kubenswrapper[2544]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 20:02:08.574292 ip-10-0-137-123 kubenswrapper[2544]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 20:02:08.576133 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.576044 2544 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 20:02:08.579658 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579643 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:02:08.579658 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579658 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579662 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579665 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579668 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579671 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579674 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579676 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579679 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579683 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579686 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579689 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579691 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579694 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579696 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579699 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579701 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579704 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579706 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579709 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:02:08.579721 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579711 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579714 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579717 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579720 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579722 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579725 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579728 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579731 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579734 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579736 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579739 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579742 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579744 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579747 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579750 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579752 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579755 2544 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579757 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579760 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579762 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:02:08.580173 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579765 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579768 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579770 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579773 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579775 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579778 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579780 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579782 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579785 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579789 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579791 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579795 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579799 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579802 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579805 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579808 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579811 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579813 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579816 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:02:08.580719 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579819 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579822 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579824 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579826 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579829 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579832 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579834 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579837 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579839 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579841 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579844 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579847 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579849 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579853 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579856 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579859 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579862 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579865 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579869 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579871 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:02:08.581180 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579874 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579876 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579879 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579881 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579884 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579886 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.579889 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580293 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580299 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580302 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580305 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580308 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580312 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580314 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580317 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580320 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580322 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580325 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580328 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580331 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:02:08.581669 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580333 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580336 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580338 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580341 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580343 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580346 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580348 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580351 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580353 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580356 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580359 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580361 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580363 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580366 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580369 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580371 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580373 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580376 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580380 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580398 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:02:08.582183 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580401 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580403 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580406 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580408 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580411 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580414 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580416 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580420 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580423 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580426 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580429 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580432 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580434 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580437 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580440 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580443 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580445 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580447 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580450 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580452 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:02:08.582742 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580455 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580457 2544 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580460 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580462 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580465 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580467 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580469 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580472 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580475 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580478 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580481 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580484 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580487 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580489 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580492 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580494 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580496 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580500 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580504 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580507 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:02:08.583246 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580510 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580513 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580517 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580520 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580523 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580525 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580528 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580530 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580533 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580536 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580539 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580541 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.580543 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581164 2544 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581174 2544 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581180 2544 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581185 2544 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581190 2544 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581193 2544 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581198 2544 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581202 2544 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 20:02:08.583758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581205 2544 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581208 2544 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581211 2544 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581215 2544 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581218 2544 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581221 2544 flags.go:64] FLAG: --cgroup-root="" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581224 2544 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581226 2544 flags.go:64] FLAG: --client-ca-file="" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581229 2544 flags.go:64] FLAG: --cloud-config="" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581232 2544 flags.go:64] FLAG: --cloud-provider="external" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581235 2544 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581239 2544 flags.go:64] FLAG: --cluster-domain="" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581242 2544 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581245 2544 flags.go:64] FLAG: --config-dir="" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581248 2544 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581251 2544 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581256 2544 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581259 2544 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581262 2544 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581265 2544 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581268 2544 flags.go:64] FLAG: --contention-profiling="false" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581272 2544 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581275 2544 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581278 2544 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581281 2544 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 20:02:08.584292 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581285 2544 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581288 2544 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581291 2544 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581294 2544 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581297 2544 flags.go:64] FLAG: --enable-server="true" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581300 2544 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581305 2544 flags.go:64] FLAG: --event-burst="100" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581308 2544 flags.go:64] FLAG: --event-qps="50" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581311 2544 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581314 2544 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581317 2544 flags.go:64] FLAG: --eviction-hard="" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581320 2544 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581323 2544 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581327 2544 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581330 2544 flags.go:64] FLAG: --eviction-soft="" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581332 2544 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581336 2544 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581339 2544 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581342 2544 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581344 2544 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581347 2544 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581350 2544 flags.go:64] FLAG: --feature-gates="" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581354 2544 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581357 2544 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581361 2544 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 20:02:08.585032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581364 2544 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581367 2544 flags.go:64] FLAG: --healthz-port="10248" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581370 2544 flags.go:64] FLAG: --help="false" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581373 2544 flags.go:64] FLAG: --hostname-override="ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581376 2544 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581379 2544 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581397 2544 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581403 2544 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581409 2544 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581412 2544 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581415 2544 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581418 2544 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581421 2544 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581424 2544 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581427 2544 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581430 2544 flags.go:64] FLAG: --kube-reserved="" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581433 2544 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581436 2544 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581439 2544 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581441 2544 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581444 2544 flags.go:64] FLAG: --lock-file="" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581447 2544 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581450 2544 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581453 2544 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 20:02:08.585688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581459 2544 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581461 2544 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581464 2544 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581467 2544 flags.go:64] FLAG: --logging-format="text" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581470 2544 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581473 2544 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581476 2544 flags.go:64] FLAG: --manifest-url="" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581479 2544 flags.go:64] FLAG: --manifest-url-header="" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581483 2544 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581486 2544 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581491 2544 flags.go:64] FLAG: --max-pods="110" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581493 2544 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581497 2544 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581499 2544 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581502 2544 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581505 2544 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581508 2544 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581512 2544 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581519 2544 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581522 2544 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581525 2544 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581528 2544 flags.go:64] FLAG: --pod-cidr="" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581530 2544 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 20:02:08.586265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581536 2544 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581539 2544 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581542 2544 flags.go:64] FLAG: --pods-per-core="0" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581545 2544 flags.go:64] FLAG: --port="10250" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581548 2544 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581551 2544 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e9124f32584d43c0" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581554 2544 flags.go:64] FLAG: --qos-reserved="" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581557 2544 flags.go:64] FLAG: --read-only-port="10255" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581562 2544 flags.go:64] FLAG: --register-node="true" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581565 2544 flags.go:64] FLAG: --register-schedulable="true" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581568 2544 flags.go:64] FLAG: --register-with-taints="" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581572 2544 flags.go:64] FLAG: --registry-burst="10" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581575 2544 flags.go:64] FLAG: --registry-qps="5" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581577 2544 flags.go:64] FLAG: --reserved-cpus="" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581580 2544 flags.go:64] FLAG: --reserved-memory="" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581584 2544 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581587 2544 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581591 2544 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581593 2544 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581596 2544 flags.go:64] FLAG: --runonce="false" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581599 2544 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581602 2544 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581605 2544 flags.go:64] FLAG: --seccomp-default="false" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581611 2544 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581614 2544 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581617 2544 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 20:02:08.586834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581620 2544 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581623 2544 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581626 2544 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581629 2544 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581631 2544 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581634 2544 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581637 2544 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581640 2544 flags.go:64] FLAG: --system-cgroups="" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581643 2544 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581648 2544 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581651 2544 flags.go:64] FLAG: --tls-cert-file="" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581654 2544 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581658 2544 flags.go:64] FLAG: --tls-min-version="" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581660 2544 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581667 2544 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581670 2544 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581673 2544 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581676 2544 flags.go:64] FLAG: --v="2" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581681 2544 flags.go:64] FLAG: --version="false" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581685 2544 flags.go:64] FLAG: --vmodule="" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581689 2544 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.581693 2544 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581778 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581781 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:02:08.587493 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581784 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581787 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581790 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581792 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581795 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581800 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581802 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581805 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581808 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581811 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581813 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581816 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581818 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581821 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581823 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581826 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581829 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581833 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581837 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581840 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:02:08.588066 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581842 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581845 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581849 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581852 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581854 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581857 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581859 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581862 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581865 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581867 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581870 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581872 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581875 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581878 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581881 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581884 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581888 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581892 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581894 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:02:08.588699 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581897 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581900 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581902 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581905 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581907 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581910 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581913 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581915 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581918 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581920 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581923 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581926 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581928 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581930 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581933 2544 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581936 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581939 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581941 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581944 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:02:08.589179 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581946 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581949 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581951 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581954 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581956 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581959 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581961 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581963 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581966 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581969 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581971 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581975 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581978 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581980 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581983 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581985 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581988 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581990 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581993 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581995 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:02:08.589911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.581998 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:02:08.590410 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.582000 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:02:08.590410 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.582003 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:02:08.590410 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.582005 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:02:08.590410 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.582008 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:02:08.590410 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.582010 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:02:08.590410 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.582572 2544 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 20:02:08.590410 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.590285 2544 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.590416 2544 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590465 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590470 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590473 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590476 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590479 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590483 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590486 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590488 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590491 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590494 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590498 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590503 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590506 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590509 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590512 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590514 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590517 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:02:08.590594 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590520 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590522 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590525 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590528 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590530 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590533 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590537 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590543 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590546 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590550 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590553 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590555 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590558 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590560 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590563 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590566 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590569 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590572 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590575 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:02:08.591053 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590578 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590580 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590583 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590586 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590588 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590591 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590593 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590596 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590599 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590601 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590604 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590607 2544 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590610 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590612 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590615 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590618 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590620 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590623 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590626 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590628 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:02:08.591523 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590631 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590633 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590636 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590638 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590641 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590643 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590646 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590648 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590652 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590654 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590657 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590660 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590662 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590665 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590667 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590669 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590672 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590674 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590677 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590679 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:02:08.592006 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590683 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590685 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590688 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590690 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590693 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590695 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590698 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590700 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590703 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590705 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.590710 2544 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590804 2544 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590809 2544 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590812 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590816 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590819 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 20:02:08.592574 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590822 2544 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590825 2544 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590828 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590830 2544 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590834 2544 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590839 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590842 2544 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590844 2544 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590847 2544 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590849 2544 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590852 2544 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590854 2544 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590857 2544 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590860 2544 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590862 2544 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590865 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590867 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590870 2544 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590873 2544 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590876 2544 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 20:02:08.592971 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590878 2544 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590880 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590883 2544 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590885 2544 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590888 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590890 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590893 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590895 2544 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590898 2544 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590900 2544 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590903 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590905 2544 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590907 2544 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590910 2544 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590912 2544 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590915 2544 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590917 2544 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590921 2544 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590923 2544 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590926 2544 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 20:02:08.593559 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590928 2544 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590931 2544 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590933 2544 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590936 2544 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590938 2544 feature_gate.go:328] unrecognized feature gate: Example Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590941 2544 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590944 2544 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590946 2544 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590949 2544 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590951 2544 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590954 2544 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590957 2544 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590960 2544 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590962 2544 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590965 2544 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590967 2544 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590969 2544 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590972 2544 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590976 2544 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590979 2544 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 20:02:08.594040 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590982 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590984 2544 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590987 2544 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590989 2544 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590992 2544 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590994 2544 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590997 2544 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.590999 2544 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591002 2544 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591005 2544 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591008 2544 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591010 2544 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591013 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591015 2544 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591017 2544 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591020 2544 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591022 2544 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591024 2544 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591027 2544 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 20:02:08.594544 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591029 2544 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 20:02:08.595923 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:08.591032 2544 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 20:02:08.595923 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.591036 2544 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 20:02:08.595923 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.591629 2544 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 20:02:08.595923 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.595713 2544 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 20:02:08.596772 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.596761 2544 server.go:1019] "Starting client certificate rotation" Jun 02 20:02:08.596884 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.596865 2544 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 20:02:08.596933 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.596903 2544 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 20:02:08.623049 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.623022 2544 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 20:02:08.625536 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.625514 2544 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 20:02:08.637643 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.637620 2544 log.go:25] "Validated CRI v1 runtime API" Jun 02 20:02:08.645113 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.645094 2544 log.go:25] "Validated CRI v1 image API" Jun 02 20:02:08.648642 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.648623 2544 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 20:02:08.651728 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.651706 2544 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8da1bfd5-2148-47fb-9e91-261397b7eae8:/dev/nvme0n1p4 d6e03c53-c42d-496f-a81d-60d2f097a748:/dev/nvme0n1p3] Jun 02 20:02:08.651800 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.651728 2544 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 20:02:08.656002 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.655901 2544 manager.go:217] Machine: {Timestamp:2026-06-02 20:02:08.655401444 +0000 UTC m=+0.402184091 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114774 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23249bed70f23c94647663c20b7101 SystemUUID:ec23249b-ed70-f23c-9464-7663c20b7101 BootID:14b0e20d-fdc8-4c6c-bdde-7655b6d5298f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:15:2b:6e:75 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:15:2b:6e:75 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:1c:85:bd:2e:48 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 20:02:08.656002 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.656001 2544 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 20:02:08.656125 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.656113 2544 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 20:02:08.659504 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.659473 2544 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 20:02:08.659639 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.659507 2544 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 20:02:08.659688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.659652 2544 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 20:02:08.659688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.659661 2544 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 20:02:08.659688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.659668 2544 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 20:02:08.659688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.659684 2544 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 20:02:08.660546 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.660535 2544 state_mem.go:36] "Initialized new in-memory state store" Jun 02 20:02:08.660652 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.660643 2544 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 20:02:08.664249 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.664237 2544 kubelet.go:491] "Attempting to sync node with API server" Jun 02 20:02:08.664302 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.664253 2544 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 20:02:08.665006 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.664995 2544 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 20:02:08.665061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.665009 2544 kubelet.go:397] "Adding apiserver pod source" Jun 02 20:02:08.665061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.665018 2544 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 20:02:08.666014 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.666003 2544 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 20:02:08.666053 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.666021 2544 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 20:02:08.667096 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.667079 2544 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 20:02:08.669073 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.669058 2544 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 20:02:08.671139 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.671125 2544 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 20:02:08.673768 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673755 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 20:02:08.673822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673773 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 20:02:08.673822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673782 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 20:02:08.673822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673791 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 20:02:08.673822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673803 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 20:02:08.673822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673809 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 20:02:08.673822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673814 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 20:02:08.673822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673820 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 20:02:08.674009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673828 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 20:02:08.674009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673834 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 20:02:08.674009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673842 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 20:02:08.674009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.673848 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 20:02:08.674559 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.674548 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 20:02:08.674593 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.674560 2544 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 20:02:08.677538 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.677526 2544 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 20:02:08.677614 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.677562 2544 server.go:1295] "Started kubelet" Jun 02 20:02:08.678109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.678065 2544 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 20:02:08.678269 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.678212 2544 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 20:02:08.678361 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.678309 2544 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 20:02:08.678622 ip-10-0-137-123 systemd[1]: Started Kubernetes Kubelet. Jun 02 20:02:08.679161 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.679149 2544 server.go:317] "Adding debug handlers to kubelet server" Jun 02 20:02:08.679691 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.679669 2544 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 20:02:08.684531 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.684506 2544 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 20:02:08.684531 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.684506 2544 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 20:02:08.684679 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.684651 2544 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 20:02:08.684679 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.684668 2544 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 20:02:08.684763 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.684737 2544 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 20:02:08.684763 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.684749 2544 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 20:02:08.684881 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.684865 2544 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 20:02:08.684970 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.684939 2544 reconstruct.go:97] "Volume reconstruction finished" Jun 02 20:02:08.684970 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.684947 2544 reconciler.go:26] "Reconciler: start to sync state" Jun 02 20:02:08.685423 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.685398 2544 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 20:02:08.685558 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.685529 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:08.685984 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.685965 2544 factory.go:55] Registering systemd factory Jun 02 20:02:08.686060 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.685988 2544 factory.go:223] Registration of the systemd container factory successfully Jun 02 20:02:08.686955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.686931 2544 factory.go:153] Registering CRI-O factory Jun 02 20:02:08.686955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.686953 2544 factory.go:223] Registration of the crio container factory successfully Jun 02 20:02:08.687090 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.687005 2544 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 20:02:08.687090 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.687027 2544 factory.go:103] Registering Raw factory Jun 02 20:02:08.687090 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.687041 2544 manager.go:1196] Started watching for new ooms in manager Jun 02 20:02:08.687454 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.687439 2544 manager.go:319] Starting recovery of all containers Jun 02 20:02:08.696112 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.696089 2544 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 20:02:08.696220 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.696108 2544 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 20:02:08.696220 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.696150 2544 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 20:02:08.697657 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.696598 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-123.ec2.internal.18b55c21f915eb05 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-123.ec2.internal,UID:ip-10-0-137-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-123.ec2.internal,},FirstTimestamp:2026-06-02 20:02:08.677538565 +0000 UTC m=+0.424321213,LastTimestamp:2026-06-02 20:02:08.677538565 +0000 UTC m=+0.424321213,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-123.ec2.internal,}" Jun 02 20:02:08.698335 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.698319 2544 manager.go:324] Recovery completed Jun 02 20:02:08.703023 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.703009 2544 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:02:08.705042 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.705016 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:02:08.705124 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.705055 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:02:08.705124 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.705066 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:02:08.705560 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.705547 2544 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 20:02:08.705605 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.705560 2544 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 20:02:08.705605 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.705589 2544 state_mem.go:36] "Initialized new in-memory state store" Jun 02 20:02:08.708839 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.708823 2544 policy_none.go:49] "None policy: Start" Jun 02 20:02:08.708917 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.708844 2544 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 20:02:08.708917 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.708857 2544 state_mem.go:35] "Initializing new in-memory state store" Jun 02 20:02:08.710042 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.709944 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-123.ec2.internal.18b55c21fab98f8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-123.ec2.internal,UID:ip-10-0-137-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-123.ec2.internal,},FirstTimestamp:2026-06-02 20:02:08.705040269 +0000 UTC m=+0.451822916,LastTimestamp:2026-06-02 20:02:08.705040269 +0000 UTC m=+0.451822916,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-123.ec2.internal,}" Jun 02 20:02:08.722599 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.722526 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-123.ec2.internal.18b55c21fab9dce8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-123.ec2.internal,UID:ip-10-0-137-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-123.ec2.internal,},FirstTimestamp:2026-06-02 20:02:08.705060072 +0000 UTC m=+0.451842719,LastTimestamp:2026-06-02 20:02:08.705060072 +0000 UTC m=+0.451842719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-123.ec2.internal,}" Jun 02 20:02:08.722693 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.722583 2544 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fl2wv" Jun 02 20:02:08.731802 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.731633 2544 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-123.ec2.internal.18b55c21faba02fc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-123.ec2.internal,UID:ip-10-0-137-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-123.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-123.ec2.internal,},FirstTimestamp:2026-06-02 20:02:08.70506982 +0000 UTC m=+0.451852468,LastTimestamp:2026-06-02 20:02:08.70506982 +0000 UTC m=+0.451852468,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-123.ec2.internal,}" Jun 02 20:02:08.733689 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.733673 2544 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fl2wv" Jun 02 20:02:08.747008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.746993 2544 manager.go:341] "Starting Device Plugin manager" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.747024 2544 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.747038 2544 server.go:85] "Starting device plugin registration server" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.747309 2544 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.747321 2544 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.747423 2544 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.747499 2544 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.747507 2544 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.748238 2544 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 20:02:08.764039 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.748271 2544 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:08.817092 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.817053 2544 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 20:02:08.818295 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.818278 2544 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 20:02:08.818295 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.818297 2544 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 20:02:08.818477 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.818318 2544 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 20:02:08.818477 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.818328 2544 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 20:02:08.818477 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.818447 2544 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 20:02:08.821598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.821572 2544 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:02:08.848434 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.848371 2544 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:02:08.849198 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.849180 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:02:08.849273 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.849215 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:02:08.849273 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.849228 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:02:08.849273 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.849249 2544 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.857894 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.857872 2544 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.857894 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.857895 2544 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-123.ec2.internal\": node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:08.893181 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.893157 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:08.919126 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.919091 2544 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal"] Jun 02 20:02:08.919196 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.919186 2544 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:02:08.920893 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.920878 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:02:08.920963 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.920906 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:02:08.920963 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.920916 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:02:08.925211 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925197 2544 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:02:08.925413 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925379 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.925488 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925434 2544 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:02:08.925910 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925894 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:02:08.925970 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925915 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:02:08.925970 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925920 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:02:08.925970 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925932 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:02:08.925970 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925934 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:02:08.925970 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.925945 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:02:08.927745 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.927730 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.927816 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.927753 2544 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 20:02:08.928336 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.928322 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientMemory" Jun 02 20:02:08.928405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.928348 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 20:02:08.928405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.928358 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeHasSufficientPID" Jun 02 20:02:08.947970 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.947951 2544 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-123.ec2.internal\" not found" node="ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.952110 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.952094 2544 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-123.ec2.internal\" not found" node="ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.987647 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.987629 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f9d59f10a7bdca9131fcb10bee3d57b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal\" (UID: \"7f9d59f10a7bdca9131fcb10bee3d57b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.987729 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.987661 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/791f919f437f144cbf47c92868e52a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-123.ec2.internal\" (UID: \"791f919f437f144cbf47c92868e52a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.987729 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:08.987679 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f9d59f10a7bdca9131fcb10bee3d57b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal\" (UID: \"7f9d59f10a7bdca9131fcb10bee3d57b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:08.993735 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:08.993713 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.088526 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.088500 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f9d59f10a7bdca9131fcb10bee3d57b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal\" (UID: \"7f9d59f10a7bdca9131fcb10bee3d57b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:09.088526 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.088527 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/791f919f437f144cbf47c92868e52a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-123.ec2.internal\" (UID: \"791f919f437f144cbf47c92868e52a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" Jun 02 20:02:09.088678 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.088544 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f9d59f10a7bdca9131fcb10bee3d57b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal\" (UID: \"7f9d59f10a7bdca9131fcb10bee3d57b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:09.088678 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.088581 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f9d59f10a7bdca9131fcb10bee3d57b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal\" (UID: \"7f9d59f10a7bdca9131fcb10bee3d57b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:09.088678 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.088601 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f9d59f10a7bdca9131fcb10bee3d57b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal\" (UID: \"7f9d59f10a7bdca9131fcb10bee3d57b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:09.088678 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.088605 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/791f919f437f144cbf47c92868e52a9c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-123.ec2.internal\" (UID: \"791f919f437f144cbf47c92868e52a9c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" Jun 02 20:02:09.094588 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.094568 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.195185 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.195139 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.250305 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.250281 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:09.255902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.255887 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" Jun 02 20:02:09.296207 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.296179 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.396700 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.396676 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.497236 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.497164 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.597791 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.597760 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.597791 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.597771 2544 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 20:02:09.598468 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.597905 2544 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 20:02:09.685107 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.685075 2544 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 20:02:09.685648 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.685626 2544 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:02:09.698470 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.698440 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.699628 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.699600 2544 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 20:02:09.726929 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.726754 2544 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbgtm" Jun 02 20:02:09.735507 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.735478 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 19:57:08 +0000 UTC" deadline="2027-11-09 19:27:01.850601063 +0000 UTC" Jun 02 20:02:09.735593 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.735511 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12599h24m52.115096543s" Jun 02 20:02:09.735593 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.735547 2544 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cbgtm" Jun 02 20:02:09.783449 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:09.783404 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791f919f437f144cbf47c92868e52a9c.slice/crio-5e33e1d89c94e0076be49733721c205372c1b6c793a4c073fc0a30e78407402e WatchSource:0}: Error finding container 5e33e1d89c94e0076be49733721c205372c1b6c793a4c073fc0a30e78407402e: Status 404 returned error can't find the container with id 5e33e1d89c94e0076be49733721c205372c1b6c793a4c073fc0a30e78407402e Jun 02 20:02:09.783718 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:09.783700 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9d59f10a7bdca9131fcb10bee3d57b.slice/crio-019d22e8325c6880e4412fb3da4ba69dea53072bc111460337799800a7b4cc03 WatchSource:0}: Error finding container 019d22e8325c6880e4412fb3da4ba69dea53072bc111460337799800a7b4cc03: Status 404 returned error can't find the container with id 019d22e8325c6880e4412fb3da4ba69dea53072bc111460337799800a7b4cc03 Jun 02 20:02:09.787619 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.787600 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:02:09.799301 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.799281 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:09.821768 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.821718 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" event={"ID":"7f9d59f10a7bdca9131fcb10bee3d57b","Type":"ContainerStarted","Data":"019d22e8325c6880e4412fb3da4ba69dea53072bc111460337799800a7b4cc03"} Jun 02 20:02:09.822590 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:09.822572 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" event={"ID":"791f919f437f144cbf47c92868e52a9c","Type":"ContainerStarted","Data":"5e33e1d89c94e0076be49733721c205372c1b6c793a4c073fc0a30e78407402e"} Jun 02 20:02:09.900101 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:09.900070 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:10.000596 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.000563 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:10.101158 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.101081 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:10.165532 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.165497 2544 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:02:10.201256 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.201216 2544 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-123.ec2.internal\" not found" Jun 02 20:02:10.208261 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.208233 2544 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:02:10.285834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.285800 2544 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" Jun 02 20:02:10.299759 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.299732 2544 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 20:02:10.300822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.300800 2544 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" Jun 02 20:02:10.314175 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.314153 2544 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 20:02:10.666876 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.666841 2544 apiserver.go:52] "Watching apiserver" Jun 02 20:02:10.677344 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.677247 2544 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 20:02:10.677653 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.677624 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-ps9mm","openshift-network-operator/iptables-alerter-szm6f","openshift-ovn-kubernetes/ovnkube-node-vq2bj","kube-system/konnectivity-agent-5wx8b","kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67","openshift-cluster-node-tuning-operator/tuned-sltmh","openshift-image-registry/node-ca-xqbfc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal","openshift-multus/multus-additional-cni-plugins-5t9zk","openshift-multus/multus-j2j2l","openshift-dns/node-resolver-9fcpd","openshift-multus/network-metrics-daemon-jscwj"] Jun 02 20:02:10.679540 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.679517 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.680739 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.680719 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.683661 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.683589 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 20:02:10.683769 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.683708 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sqkhk\"" Jun 02 20:02:10.683769 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.683708 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 20:02:10.683883 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.683768 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 20:02:10.684585 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.684379 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 20:02:10.684585 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.684458 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 20:02:10.684733 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.684722 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:10.686613 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.686582 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.686887 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.686858 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.687820 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.687801 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 20:02:10.687916 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.687830 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 20:02:10.687973 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.687917 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 20:02:10.688142 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.688075 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 20:02:10.688142 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.688075 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 20:02:10.688800 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.688632 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:10.688800 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.688694 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:10.689744 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.689228 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 20:02:10.689744 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.689246 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6rq4d\"" Jun 02 20:02:10.689744 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.689332 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 20:02:10.689744 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.689471 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 20:02:10.689744 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.689473 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 20:02:10.689744 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.689548 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gpc8z\"" Jun 02 20:02:10.690454 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.690433 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.692278 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.692258 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.693845 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.693828 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:10.693942 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.693897 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:10.694829 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.694806 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 20:02:10.694916 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.694813 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 20:02:10.694979 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.694917 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 20:02:10.695032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.694836 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6vvck\"" Jun 02 20:02:10.695082 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695065 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 20:02:10.695134 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695115 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zvp99\"" Jun 02 20:02:10.695182 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695142 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 20:02:10.695403 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695370 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 20:02:10.695489 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695372 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 20:02:10.695489 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695449 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r6d6l\"" Jun 02 20:02:10.695593 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695486 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mnh5x\"" Jun 02 20:02:10.695646 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695619 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.695694 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695648 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-kubelet\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.695694 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695674 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 20:02:10.695694 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695680 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-slash\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.695825 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695707 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-run-netns\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.695825 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695733 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-ovn\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.695825 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695761 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.695825 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695792 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gj2s\" (UniqueName: \"kubernetes.io/projected/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-kube-api-access-5gj2s\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695837 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695864 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-systemd-units\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695887 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-node-log\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695911 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-registration-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695938 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj6j8\" (UniqueName: \"kubernetes.io/projected/c9e0e36a-1b49-485a-a355-f83a1d2811af-kube-api-access-dj6j8\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695963 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48dx\" (UniqueName: \"kubernetes.io/projected/ba40bfef-d03e-40f1-8c51-58c0a44374f7-kube-api-access-m48dx\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.695998 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696028 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696050 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696067 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-env-overrides\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696081 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-socket-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696096 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovn-node-metrics-cert\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696112 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-sys-fs\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696137 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovnkube-config\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696159 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-system-cni-dir\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696178 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-etc-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696206 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5-agent-certs\") pod \"konnectivity-agent-5wx8b\" (UID: \"3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5\") " pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696233 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba40bfef-d03e-40f1-8c51-58c0a44374f7-host\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696279 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba40bfef-d03e-40f1-8c51-58c0a44374f7-serviceca\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696338 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cnibin\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696363 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696418 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz7lz\" (UniqueName: \"kubernetes.io/projected/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-kube-api-access-gz7lz\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696443 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-systemd\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696464 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovnkube-script-lib\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696518 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-var-lib-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696553 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696543 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-run-ovn-kubernetes\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696632 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-cni-bin\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696705 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-cni-netd\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.696746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696728 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5-konnectivity-ca\") pod \"konnectivity-agent-5wx8b\" (UID: \"3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5\") " pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:10.697509 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696609 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.697509 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696780 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-os-release\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.697509 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696805 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-log-socket\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.697509 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696834 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-device-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.697509 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.696856 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.700511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.700464 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 20:02:10.700511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.700487 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 20:02:10.700760 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.700542 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 20:02:10.701059 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.700998 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nwnj8\"" Jun 02 20:02:10.701774 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.701697 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kvrlp\"" Jun 02 20:02:10.701893 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.701809 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 20:02:10.702772 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.702753 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 20:02:10.736602 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.736568 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 19:57:09 +0000 UTC" deadline="2028-02-26 21:38:23.678504134 +0000 UTC" Jun 02 20:02:10.736719 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.736646 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15217h36m12.94186321s" Jun 02 20:02:10.786612 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.786582 2544 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 20:02:10.798010 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.797978 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-etc-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798176 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798018 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba40bfef-d03e-40f1-8c51-58c0a44374f7-host\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.798176 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798050 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba40bfef-d03e-40f1-8c51-58c0a44374f7-serviceca\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.798176 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798077 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-host-slash\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.798176 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798110 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-etc-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798176 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798129 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba40bfef-d03e-40f1-8c51-58c0a44374f7-host\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.798461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798230 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-sys\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.798461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798264 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-tuned\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.798461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798287 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-cni-multus\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.798461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798317 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovnkube-script-lib\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798345 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:10.798461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798371 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c29x7\" (UniqueName: \"kubernetes.io/projected/fe9034d3-2233-42a4-8b9a-774a3338f17e-kube-api-access-c29x7\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.798461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798413 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-os-release\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.798461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798439 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-log-socket\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798464 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798490 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-modprobe-d\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798516 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-kubelet\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798525 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-log-socket\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798536 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-os-release\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798568 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798591 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798599 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-kubelet\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798623 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-slash\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798648 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-run-netns\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798653 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba40bfef-d03e-40f1-8c51-58c0a44374f7-serviceca\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798670 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gj2s\" (UniqueName: \"kubernetes.io/projected/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-kube-api-access-5gj2s\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798655 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-kubelet\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798693 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-slash\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798694 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798730 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b123b60-d330-48ca-8f2c-1967abd41ce7-hosts-file\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.798797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798735 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-run-netns\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798732 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798767 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-systemd-units\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798793 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-node-log\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798819 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9746f93a-30c6-4cbc-bbfe-30df13a3226b-tmp\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798846 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-hostroot\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798872 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-env-overrides\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798899 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-socket-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798903 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-systemd-units\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798874 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-node-log\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798924 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-cni-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798951 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovnkube-script-lib\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798969 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-k8s-cni-cncf-io\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.798998 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-cni-bin\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799024 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-multus-certs\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799031 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-socket-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799049 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl8xf\" (UniqueName: \"kubernetes.io/projected/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-kube-api-access-tl8xf\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:10.799492 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799109 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovn-node-metrics-cert\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799134 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cni-binary-copy\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799162 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysconfig\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799266 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-env-overrides\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799303 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5snwd\" (UniqueName: \"kubernetes.io/projected/9746f93a-30c6-4cbc-bbfe-30df13a3226b-kube-api-access-5snwd\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799334 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-socket-dir-parent\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799362 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovnkube-config\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799416 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-system-cni-dir\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799444 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5-agent-certs\") pod \"konnectivity-agent-5wx8b\" (UID: \"3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5\") " pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799469 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-run\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799495 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-conf-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799518 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cnibin\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799535 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799561 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gz7lz\" (UniqueName: \"kubernetes.io/projected/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-kube-api-access-gz7lz\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799585 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-systemd\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799610 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-var-lib-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799634 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-run-ovn-kubernetes\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.800323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799660 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-cni-bin\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799686 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-cni-netd\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799729 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-system-cni-dir\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799739 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-cni-netd\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799770 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5-konnectivity-ca\") pod \"konnectivity-agent-5wx8b\" (UID: \"3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5\") " pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799804 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-iptables-alerter-script\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799810 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-var-lib-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799833 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-kubernetes\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799843 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovnkube-config\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799857 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-systemd\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799861 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-systemd\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799770 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cnibin\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799498 2544 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799896 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-device-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799897 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-run-ovn-kubernetes\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799956 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-cni-bin\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799964 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-device-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.801008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.799995 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5z8f\" (UniqueName: \"kubernetes.io/projected/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-kube-api-access-n5z8f\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800016 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysctl-d\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800034 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-host\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800054 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe9034d3-2233-42a4-8b9a-774a3338f17e-cni-binary-copy\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800076 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-daemon-config\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800106 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-ovn\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800145 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800151 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800174 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-ovn\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800209 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-registration-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800216 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800265 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dj6j8\" (UniqueName: \"kubernetes.io/projected/c9e0e36a-1b49-485a-a355-f83a1d2811af-kube-api-access-dj6j8\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800307 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-registration-dir\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800356 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m48dx\" (UniqueName: \"kubernetes.io/projected/ba40bfef-d03e-40f1-8c51-58c0a44374f7-kube-api-access-m48dx\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800401 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5-konnectivity-ca\") pod \"konnectivity-agent-5wx8b\" (UID: \"3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5\") " pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800451 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-lib-modules\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.801715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800498 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-var-lib-kubelet\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800548 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800582 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800641 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800695 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-run-openvswitch\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800712 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800731 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b123b60-d330-48ca-8f2c-1967abd41ce7-tmp-dir\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800780 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysctl-conf\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800805 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-netns\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800852 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-sys-fs\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800922 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9e0e36a-1b49-485a-a355-f83a1d2811af-sys-fs\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800955 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c6zc\" (UniqueName: \"kubernetes.io/projected/6b123b60-d330-48ca-8f2c-1967abd41ce7-kube-api-access-9c6zc\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.800981 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-system-cni-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.801002 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-cnibin\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.801022 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-os-release\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.801023 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.801041 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-etc-kubernetes\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.802306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.801070 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:10.803229 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.803198 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-ovn-node-metrics-cert\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.803354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.803322 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5-agent-certs\") pod \"konnectivity-agent-5wx8b\" (UID: \"3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5\") " pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:10.814331 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.814297 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gj2s\" (UniqueName: \"kubernetes.io/projected/1e1e183e-9a8f-495f-88ad-0d1fcc510ce2-kube-api-access-5gj2s\") pod \"ovnkube-node-vq2bj\" (UID: \"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2\") " pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:10.822413 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.822373 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj6j8\" (UniqueName: \"kubernetes.io/projected/c9e0e36a-1b49-485a-a355-f83a1d2811af-kube-api-access-dj6j8\") pod \"aws-ebs-csi-driver-node-gkk67\" (UID: \"c9e0e36a-1b49-485a-a355-f83a1d2811af\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:10.822631 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.822614 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz7lz\" (UniqueName: \"kubernetes.io/projected/c0a783bc-ea3b-43c8-b1c8-ed182108d5e7-kube-api-access-gz7lz\") pod \"multus-additional-cni-plugins-5t9zk\" (UID: \"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7\") " pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:10.824899 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.824859 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48dx\" (UniqueName: \"kubernetes.io/projected/ba40bfef-d03e-40f1-8c51-58c0a44374f7-kube-api-access-m48dx\") pod \"node-ca-xqbfc\" (UID: \"ba40bfef-d03e-40f1-8c51-58c0a44374f7\") " pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:10.862635 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.862606 2544 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 20:02:10.901569 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901532 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-iptables-alerter-script\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.901569 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901567 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-kubernetes\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.901787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901584 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-systemd\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.901787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901611 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5z8f\" (UniqueName: \"kubernetes.io/projected/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-kube-api-access-n5z8f\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.901787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901634 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysctl-d\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.901787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901683 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-host\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.901787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901684 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-systemd\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.901787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901721 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe9034d3-2233-42a4-8b9a-774a3338f17e-cni-binary-copy\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.901787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901735 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-kubernetes\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.901787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901752 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-daemon-config\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901801 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-lib-modules\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901830 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-var-lib-kubelet\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901858 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b123b60-d330-48ca-8f2c-1967abd41ce7-tmp-dir\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901745 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-host\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901909 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysctl-d\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901887 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysctl-conf\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901952 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-netns\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901979 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9c6zc\" (UniqueName: \"kubernetes.io/projected/6b123b60-d330-48ca-8f2c-1967abd41ce7-kube-api-access-9c6zc\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901982 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-var-lib-kubelet\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.901987 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-lib-modules\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902001 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysctl-conf\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902004 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-system-cni-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902041 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-cnibin\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902045 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-system-cni-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902084 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-os-release\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902109 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-etc-kubernetes\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902119 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-cnibin\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.902144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902085 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-netns\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902135 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902171 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-etc-kubernetes\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902174 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-host-slash\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.902204 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902208 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-host-slash\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902141 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-os-release\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902240 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-sys\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902208 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-sys\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902267 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b123b60-d330-48ca-8f2c-1967abd41ce7-tmp-dir\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.902278 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:11.402248495 +0000 UTC m=+3.149031149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902310 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-iptables-alerter-script\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902314 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-tuned\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902355 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-cni-multus\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902381 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902426 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-cni-multus\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902430 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c29x7\" (UniqueName: \"kubernetes.io/projected/fe9034d3-2233-42a4-8b9a-774a3338f17e-kube-api-access-c29x7\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902471 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-modprobe-d\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902497 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-kubelet\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902526 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b123b60-d330-48ca-8f2c-1967abd41ce7-hosts-file\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902551 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9746f93a-30c6-4cbc-bbfe-30df13a3226b-tmp\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902574 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-hostroot\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902599 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-cni-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902610 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-modprobe-d\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902625 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-k8s-cni-cncf-io\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902627 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b123b60-d330-48ca-8f2c-1967abd41ce7-hosts-file\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902650 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-cni-bin\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902659 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-hostroot\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902674 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-multus-certs\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902668 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-kubelet\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902704 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl8xf\" (UniqueName: \"kubernetes.io/projected/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-kube-api-access-tl8xf\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902729 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-multus-certs\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902730 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysconfig\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902741 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-cni-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902765 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5snwd\" (UniqueName: \"kubernetes.io/projected/9746f93a-30c6-4cbc-bbfe-30df13a3226b-kube-api-access-5snwd\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.903598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902772 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-sysconfig\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902789 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-run-k8s-cni-cncf-io\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902800 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-socket-dir-parent\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902802 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-daemon-config\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902828 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-run\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902835 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-host-var-lib-cni-bin\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902852 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-conf-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902884 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-socket-dir-parent\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902921 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fe9034d3-2233-42a4-8b9a-774a3338f17e-multus-conf-dir\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.902932 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9746f93a-30c6-4cbc-bbfe-30df13a3226b-run\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.904215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.903028 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fe9034d3-2233-42a4-8b9a-774a3338f17e-cni-binary-copy\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.904961 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.904928 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9746f93a-30c6-4cbc-bbfe-30df13a3226b-etc-tuned\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.905213 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.905194 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9746f93a-30c6-4cbc-bbfe-30df13a3226b-tmp\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.919813 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.919725 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5z8f\" (UniqueName: \"kubernetes.io/projected/4b7baeb5-a2aa-4402-a452-ceeb4eba87cd-kube-api-access-n5z8f\") pod \"iptables-alerter-szm6f\" (UID: \"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd\") " pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:10.925006 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.924983 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:10.925006 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.925008 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:10.925205 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.925023 2544 projected.go:194] Error preparing data for projected volume kube-api-access-jdws9 for pod openshift-network-diagnostics/network-check-target-ps9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:10.925205 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:10.925080 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9 podName:54b09c12-5631-4883-b105-da91367c4882 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:11.425067017 +0000 UTC m=+3.171849652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jdws9" (UniqueName: "kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9") pod "network-check-target-ps9mm" (UID: "54b09c12-5631-4883-b105-da91367c4882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:10.927672 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.927645 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c29x7\" (UniqueName: \"kubernetes.io/projected/fe9034d3-2233-42a4-8b9a-774a3338f17e-kube-api-access-c29x7\") pod \"multus-j2j2l\" (UID: \"fe9034d3-2233-42a4-8b9a-774a3338f17e\") " pod="openshift-multus/multus-j2j2l" Jun 02 20:02:10.927765 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.927722 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5snwd\" (UniqueName: \"kubernetes.io/projected/9746f93a-30c6-4cbc-bbfe-30df13a3226b-kube-api-access-5snwd\") pod \"tuned-sltmh\" (UID: \"9746f93a-30c6-4cbc-bbfe-30df13a3226b\") " pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:10.927894 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.927874 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c6zc\" (UniqueName: \"kubernetes.io/projected/6b123b60-d330-48ca-8f2c-1967abd41ce7-kube-api-access-9c6zc\") pod \"node-resolver-9fcpd\" (UID: \"6b123b60-d330-48ca-8f2c-1967abd41ce7\") " pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:10.928776 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.928754 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl8xf\" (UniqueName: \"kubernetes.io/projected/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-kube-api-access-tl8xf\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:10.993242 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.993203 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" Jun 02 20:02:11.000003 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:10.999977 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:11.009215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.009195 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:11.013441 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.013417 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" Jun 02 20:02:11.019965 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.019949 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqbfc" Jun 02 20:02:11.026501 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.026479 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j2j2l" Jun 02 20:02:11.034239 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.034220 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9fcpd" Jun 02 20:02:11.041595 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.041571 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sltmh" Jun 02 20:02:11.047104 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.047084 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-szm6f" Jun 02 20:02:11.399566 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.399534 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7baeb5_a2aa_4402_a452_ceeb4eba87cd.slice/crio-11e1d6f8d507d77ad3a41969f829ac19ff6c14a65e40abfbff5eb561a7c51be8 WatchSource:0}: Error finding container 11e1d6f8d507d77ad3a41969f829ac19ff6c14a65e40abfbff5eb561a7c51be8: Status 404 returned error can't find the container with id 11e1d6f8d507d77ad3a41969f829ac19ff6c14a65e40abfbff5eb561a7c51be8 Jun 02 20:02:11.400588 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.400560 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e0e36a_1b49_485a_a355_f83a1d2811af.slice/crio-8e25eebe610fe20d4c691b4fa65a47d37ad345b4616a7ba477e0725e91416c22 WatchSource:0}: Error finding container 8e25eebe610fe20d4c691b4fa65a47d37ad345b4616a7ba477e0725e91416c22: Status 404 returned error can't find the container with id 8e25eebe610fe20d4c691b4fa65a47d37ad345b4616a7ba477e0725e91416c22 Jun 02 20:02:11.401154 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.401063 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a783bc_ea3b_43c8_b1c8_ed182108d5e7.slice/crio-8a4da0696f88cd1fde039cf40a788f216b3cf2a02d21a7c6881920249485daf3 WatchSource:0}: Error finding container 8a4da0696f88cd1fde039cf40a788f216b3cf2a02d21a7c6881920249485daf3: Status 404 returned error can't find the container with id 8a4da0696f88cd1fde039cf40a788f216b3cf2a02d21a7c6881920249485daf3 Jun 02 20:02:11.401979 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.401954 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb61da0_26a0_4da3_84d9_3bc8dc3edaf5.slice/crio-d50b44356ed8ad9b90075ac1fcb1db01e85b34a18e4e6196ed33e082a3ffbaf3 WatchSource:0}: Error finding container d50b44356ed8ad9b90075ac1fcb1db01e85b34a18e4e6196ed33e082a3ffbaf3: Status 404 returned error can't find the container with id d50b44356ed8ad9b90075ac1fcb1db01e85b34a18e4e6196ed33e082a3ffbaf3 Jun 02 20:02:11.405323 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.405226 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1e183e_9a8f_495f_88ad_0d1fcc510ce2.slice/crio-74d0fcca3ceecf9db16a1fc347f67ce3bb663037224ae72f1892839954e05539 WatchSource:0}: Error finding container 74d0fcca3ceecf9db16a1fc347f67ce3bb663037224ae72f1892839954e05539: Status 404 returned error can't find the container with id 74d0fcca3ceecf9db16a1fc347f67ce3bb663037224ae72f1892839954e05539 Jun 02 20:02:11.406325 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.405696 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:11.406325 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:11.405829 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:11.406325 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:11.405876 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:12.405859777 +0000 UTC m=+4.152642416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:11.407744 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.407371 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b123b60_d330_48ca_8f2c_1967abd41ce7.slice/crio-26b0b5ffbcf0954d5e5f3940514082ec0a5bc7bb9f3a9345687d552b1a614288 WatchSource:0}: Error finding container 26b0b5ffbcf0954d5e5f3940514082ec0a5bc7bb9f3a9345687d552b1a614288: Status 404 returned error can't find the container with id 26b0b5ffbcf0954d5e5f3940514082ec0a5bc7bb9f3a9345687d552b1a614288 Jun 02 20:02:11.408270 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.408250 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe9034d3_2233_42a4_8b9a_774a3338f17e.slice/crio-89380ac8aa79492baf3fdefeea9670671986c4a58f2df700f606000b270a1457 WatchSource:0}: Error finding container 89380ac8aa79492baf3fdefeea9670671986c4a58f2df700f606000b270a1457: Status 404 returned error can't find the container with id 89380ac8aa79492baf3fdefeea9670671986c4a58f2df700f606000b270a1457 Jun 02 20:02:11.409477 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.409456 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba40bfef_d03e_40f1_8c51_58c0a44374f7.slice/crio-aa89b90dda3e56bb7f114073f4b9c40417519139841efe79c48c15b0d3aa627d WatchSource:0}: Error finding container aa89b90dda3e56bb7f114073f4b9c40417519139841efe79c48c15b0d3aa627d: Status 404 returned error can't find the container with id aa89b90dda3e56bb7f114073f4b9c40417519139841efe79c48c15b0d3aa627d Jun 02 20:02:11.411015 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:02:11.410988 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9746f93a_30c6_4cbc_bbfe_30df13a3226b.slice/crio-2423b149d65974d60311cbbd0e443272d666d55973e5d0a0c0221493a3cdb2ad WatchSource:0}: Error finding container 2423b149d65974d60311cbbd0e443272d666d55973e5d0a0c0221493a3cdb2ad: Status 404 returned error can't find the container with id 2423b149d65974d60311cbbd0e443272d666d55973e5d0a0c0221493a3cdb2ad Jun 02 20:02:11.506528 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.506485 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:11.506652 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:11.506633 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:11.506685 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:11.506655 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:11.506685 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:11.506664 2544 projected.go:194] Error preparing data for projected volume kube-api-access-jdws9 for pod openshift-network-diagnostics/network-check-target-ps9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:11.506761 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:11.506713 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9 podName:54b09c12-5631-4883-b105-da91367c4882 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:12.506695678 +0000 UTC m=+4.253478313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdws9" (UniqueName: "kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9") pod "network-check-target-ps9mm" (UID: "54b09c12-5631-4883-b105-da91367c4882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:11.736926 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.736894 2544 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 19:57:09 +0000 UTC" deadline="2028-01-17 01:02:14.269231559 +0000 UTC" Jun 02 20:02:11.736926 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.736925 2544 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14237h0m2.532310147s" Jun 02 20:02:11.838005 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.837967 2544 generic.go:358] "Generic (PLEG): container finished" podID="7f9d59f10a7bdca9131fcb10bee3d57b" containerID="2e6f08d2e7f4480e7120509d1f556d2c87a3938d71b5ad9b47f05268d4296c29" exitCode=0 Jun 02 20:02:11.838181 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.838053 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" event={"ID":"7f9d59f10a7bdca9131fcb10bee3d57b","Type":"ContainerDied","Data":"2e6f08d2e7f4480e7120509d1f556d2c87a3938d71b5ad9b47f05268d4296c29"} Jun 02 20:02:11.843895 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.843429 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" event={"ID":"791f919f437f144cbf47c92868e52a9c","Type":"ContainerStarted","Data":"880dfb5625f1e08f4717668ab61607d6767e365e17016dad3bbfd27eeb0555e4"} Jun 02 20:02:11.846166 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.846138 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqbfc" event={"ID":"ba40bfef-d03e-40f1-8c51-58c0a44374f7","Type":"ContainerStarted","Data":"aa89b90dda3e56bb7f114073f4b9c40417519139841efe79c48c15b0d3aa627d"} Jun 02 20:02:11.849304 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.849266 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j2j2l" event={"ID":"fe9034d3-2233-42a4-8b9a-774a3338f17e","Type":"ContainerStarted","Data":"89380ac8aa79492baf3fdefeea9670671986c4a58f2df700f606000b270a1457"} Jun 02 20:02:11.852897 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.852844 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9fcpd" event={"ID":"6b123b60-d330-48ca-8f2c-1967abd41ce7","Type":"ContainerStarted","Data":"26b0b5ffbcf0954d5e5f3940514082ec0a5bc7bb9f3a9345687d552b1a614288"} Jun 02 20:02:11.857817 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.857783 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"74d0fcca3ceecf9db16a1fc347f67ce3bb663037224ae72f1892839954e05539"} Jun 02 20:02:11.864978 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.860494 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" event={"ID":"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7","Type":"ContainerStarted","Data":"8a4da0696f88cd1fde039cf40a788f216b3cf2a02d21a7c6881920249485daf3"} Jun 02 20:02:11.869170 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.869122 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" event={"ID":"c9e0e36a-1b49-485a-a355-f83a1d2811af","Type":"ContainerStarted","Data":"8e25eebe610fe20d4c691b4fa65a47d37ad345b4616a7ba477e0725e91416c22"} Jun 02 20:02:11.872336 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.871826 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-123.ec2.internal" podStartSLOduration=1.871810989 podStartE2EDuration="1.871810989s" podCreationTimestamp="2026-06-02 20:02:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:02:11.871128257 +0000 UTC m=+3.617910915" watchObservedRunningTime="2026-06-02 20:02:11.871810989 +0000 UTC m=+3.618593651" Jun 02 20:02:11.872960 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.872906 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sltmh" event={"ID":"9746f93a-30c6-4cbc-bbfe-30df13a3226b","Type":"ContainerStarted","Data":"2423b149d65974d60311cbbd0e443272d666d55973e5d0a0c0221493a3cdb2ad"} Jun 02 20:02:11.881203 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.881152 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5wx8b" event={"ID":"3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5","Type":"ContainerStarted","Data":"d50b44356ed8ad9b90075ac1fcb1db01e85b34a18e4e6196ed33e082a3ffbaf3"} Jun 02 20:02:11.884661 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:11.884633 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-szm6f" event={"ID":"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd","Type":"ContainerStarted","Data":"11e1d6f8d507d77ad3a41969f829ac19ff6c14a65e40abfbff5eb561a7c51be8"} Jun 02 20:02:12.414700 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:12.414657 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:12.415404 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:12.414869 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:12.415404 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:12.414938 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:14.414919101 +0000 UTC m=+6.161701746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:12.516637 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:12.516005 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:12.516637 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:12.516167 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:12.516637 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:12.516194 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:12.516637 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:12.516207 2544 projected.go:194] Error preparing data for projected volume kube-api-access-jdws9 for pod openshift-network-diagnostics/network-check-target-ps9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:12.516637 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:12.516267 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9 podName:54b09c12-5631-4883-b105-da91367c4882 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:14.516248914 +0000 UTC m=+6.263031554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdws9" (UniqueName: "kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9") pod "network-check-target-ps9mm" (UID: "54b09c12-5631-4883-b105-da91367c4882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:12.819343 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:12.818786 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:12.819343 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:12.818908 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:12.820220 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:12.820049 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:12.820220 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:12.820160 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:12.901819 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:12.901781 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" event={"ID":"7f9d59f10a7bdca9131fcb10bee3d57b","Type":"ContainerStarted","Data":"9ef4f94d8156983babf33d676615b22ce2677ebbcac8d4d93917af4b809aee0d"} Jun 02 20:02:14.433558 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:14.433486 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:14.434010 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:14.433749 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:14.434010 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:14.433821 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:18.433801317 +0000 UTC m=+10.180583964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:14.534564 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:14.534525 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:14.534745 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:14.534686 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:14.534745 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:14.534706 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:14.534745 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:14.534718 2544 projected.go:194] Error preparing data for projected volume kube-api-access-jdws9 for pod openshift-network-diagnostics/network-check-target-ps9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:14.534899 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:14.534779 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9 podName:54b09c12-5631-4883-b105-da91367c4882 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:18.534760307 +0000 UTC m=+10.281542962 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdws9" (UniqueName: "kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9") pod "network-check-target-ps9mm" (UID: "54b09c12-5631-4883-b105-da91367c4882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:14.820440 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:14.819934 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:14.820440 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:14.820070 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:14.820440 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:14.820119 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:14.820440 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:14.820252 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:16.819648 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:16.819605 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:16.819648 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:16.819632 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:16.820174 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:16.819755 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:16.820174 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:16.819905 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:18.472630 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:18.472263 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:18.473127 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:18.472731 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:18.473127 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:18.472808 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:26.472784385 +0000 UTC m=+18.219567031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:18.573330 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:18.573246 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:18.573560 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:18.573466 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:18.573560 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:18.573494 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:18.573560 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:18.573510 2544 projected.go:194] Error preparing data for projected volume kube-api-access-jdws9 for pod openshift-network-diagnostics/network-check-target-ps9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:18.573719 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:18.573593 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9 podName:54b09c12-5631-4883-b105-da91367c4882 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:26.573572026 +0000 UTC m=+18.320354667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdws9" (UniqueName: "kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9") pod "network-check-target-ps9mm" (UID: "54b09c12-5631-4883-b105-da91367c4882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:18.819979 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:18.819576 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:18.819979 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:18.819691 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:18.819979 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:18.819748 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:18.819979 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:18.819827 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:20.818858 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:20.818827 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:20.819305 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:20.818959 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:20.819305 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:20.818961 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:20.819305 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:20.819027 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:22.818922 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:22.818879 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:22.818922 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:22.818910 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:22.819442 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:22.819022 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:22.819442 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:22.819175 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:24.819160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:24.819114 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:24.819693 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:24.819241 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:24.819693 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:24.819299 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:24.819693 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:24.819447 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:26.527006 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:26.526960 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:26.527505 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:26.527175 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:26.527505 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:26.527267 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:42.527245096 +0000 UTC m=+34.274027737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:26.628325 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:26.628271 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:26.628553 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:26.628501 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:26.628553 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:26.628526 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:26.628553 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:26.628539 2544 projected.go:194] Error preparing data for projected volume kube-api-access-jdws9 for pod openshift-network-diagnostics/network-check-target-ps9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:26.628702 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:26.628607 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9 podName:54b09c12-5631-4883-b105-da91367c4882 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:42.62858741 +0000 UTC m=+34.375370054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdws9" (UniqueName: "kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9") pod "network-check-target-ps9mm" (UID: "54b09c12-5631-4883-b105-da91367c4882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:26.819217 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:26.819020 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:26.819217 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:26.819028 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:26.819217 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:26.819177 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:26.819574 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:26.819282 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:28.820012 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:28.819969 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:28.820527 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:28.820085 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:28.820527 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:28.820138 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:28.820527 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:28.820256 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:29.933498 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.933180 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqbfc" event={"ID":"ba40bfef-d03e-40f1-8c51-58c0a44374f7","Type":"ContainerStarted","Data":"1070eedd902964d5a214f3dc5dd48c415e101544d3349620dfdccc6dcbdf86ef"} Jun 02 20:02:29.934663 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.934634 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j2j2l" event={"ID":"fe9034d3-2233-42a4-8b9a-774a3338f17e","Type":"ContainerStarted","Data":"bdb9b184f0cd7b26cc9526c909245d0e2eba810cbe1a9f01ae8f3b041428114c"} Jun 02 20:02:29.936058 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.936025 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9fcpd" event={"ID":"6b123b60-d330-48ca-8f2c-1967abd41ce7","Type":"ContainerStarted","Data":"c9dc6209492a7c4b8803964a0ece0df032f1e5dab806f7803f17519fb118f108"} Jun 02 20:02:29.937907 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.937885 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:02:29.938256 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.938229 2544 generic.go:358] "Generic (PLEG): container finished" podID="1e1e183e-9a8f-495f-88ad-0d1fcc510ce2" containerID="0d82e693d098c4ca98e1cf95476bb44e341c1adc4abbc38794e0f4bd1a6033f8" exitCode=1 Jun 02 20:02:29.938350 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.938304 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerDied","Data":"0d82e693d098c4ca98e1cf95476bb44e341c1adc4abbc38794e0f4bd1a6033f8"} Jun 02 20:02:29.938445 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.938351 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"e294ce5c0c9ccdd8eb2abdb6199904f3ce38782813849c2035197f324201a107"} Jun 02 20:02:29.939727 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.939702 2544 generic.go:358] "Generic (PLEG): container finished" podID="c0a783bc-ea3b-43c8-b1c8-ed182108d5e7" containerID="3300c8473dcbf395bb0cf4ea1fc15a1a6cdaf1f7999514cd11f350d5f10f484f" exitCode=0 Jun 02 20:02:29.939818 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.939748 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" event={"ID":"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7","Type":"ContainerDied","Data":"3300c8473dcbf395bb0cf4ea1fc15a1a6cdaf1f7999514cd11f350d5f10f484f"} Jun 02 20:02:29.941093 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.941066 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" event={"ID":"c9e0e36a-1b49-485a-a355-f83a1d2811af","Type":"ContainerStarted","Data":"c637e205cfd18196400260a0510f295db5e4d3d028154a5442cdaa98410b7a9b"} Jun 02 20:02:29.942519 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.942491 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sltmh" event={"ID":"9746f93a-30c6-4cbc-bbfe-30df13a3226b","Type":"ContainerStarted","Data":"207a40b0618bca197dd99e0d7e8d4aa0baf4beb8cdd6091c0e155583ac089ef3"} Jun 02 20:02:29.943884 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.943864 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5wx8b" event={"ID":"3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5","Type":"ContainerStarted","Data":"c06ce1dcc3139035d58bb3f14f9cfb9a31d8c6e30d7fe75bbe76484407e23213"} Jun 02 20:02:29.954263 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.954208 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqbfc" podStartSLOduration=3.984437462 podStartE2EDuration="21.954191889s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.411479105 +0000 UTC m=+3.158261740" lastFinishedPulling="2026-06-02 20:02:29.381233522 +0000 UTC m=+21.128016167" observedRunningTime="2026-06-02 20:02:29.953725137 +0000 UTC m=+21.700507880" watchObservedRunningTime="2026-06-02 20:02:29.954191889 +0000 UTC m=+21.700974546" Jun 02 20:02:29.954439 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.954284 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-123.ec2.internal" podStartSLOduration=19.954280385 podStartE2EDuration="19.954280385s" podCreationTimestamp="2026-06-02 20:02:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:02:12.92040199 +0000 UTC m=+4.667184642" watchObservedRunningTime="2026-06-02 20:02:29.954280385 +0000 UTC m=+21.701063041" Jun 02 20:02:29.976826 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:29.976779 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-j2j2l" podStartSLOduration=3.941542043 podStartE2EDuration="21.97676477s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.410358486 +0000 UTC m=+3.157141123" lastFinishedPulling="2026-06-02 20:02:29.445581205 +0000 UTC m=+21.192363850" observedRunningTime="2026-06-02 20:02:29.976495176 +0000 UTC m=+21.723277833" watchObservedRunningTime="2026-06-02 20:02:29.97676477 +0000 UTC m=+21.723547426" Jun 02 20:02:30.025617 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.025562 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5wx8b" podStartSLOduration=12.083911724 podStartE2EDuration="22.025545208s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.406166425 +0000 UTC m=+3.152949061" lastFinishedPulling="2026-06-02 20:02:21.347799905 +0000 UTC m=+13.094582545" observedRunningTime="2026-06-02 20:02:30.024653738 +0000 UTC m=+21.771436412" watchObservedRunningTime="2026-06-02 20:02:30.025545208 +0000 UTC m=+21.772327865" Jun 02 20:02:30.056907 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.056837 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9fcpd" podStartSLOduration=4.08496114 podStartE2EDuration="22.056817643s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.409377864 +0000 UTC m=+3.156160499" lastFinishedPulling="2026-06-02 20:02:29.381234357 +0000 UTC m=+21.128017002" observedRunningTime="2026-06-02 20:02:30.056299568 +0000 UTC m=+21.803082228" watchObservedRunningTime="2026-06-02 20:02:30.056817643 +0000 UTC m=+21.803600302" Jun 02 20:02:30.079151 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.079093 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sltmh" podStartSLOduration=3.10751267 podStartE2EDuration="21.079077014s" podCreationTimestamp="2026-06-02 20:02:09 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.412429026 +0000 UTC m=+3.159211661" lastFinishedPulling="2026-06-02 20:02:29.383993354 +0000 UTC m=+21.130776005" observedRunningTime="2026-06-02 20:02:30.078867675 +0000 UTC m=+21.825650333" watchObservedRunningTime="2026-06-02 20:02:30.079077014 +0000 UTC m=+21.825859663" Jun 02 20:02:30.746408 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.746182 2544 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 20:02:30.758656 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.758536 2544 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T20:02:30.746406021Z","UUID":"33cf5b83-e4fe-407a-b1d6-f16b3d103613","Handler":null,"Name":"","Endpoint":""} Jun 02 20:02:30.760883 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.760861 2544 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 20:02:30.760883 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.760891 2544 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 20:02:30.818604 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.818566 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:30.818813 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.818563 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:30.818813 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:30.818723 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:30.818813 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:30.818795 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:30.949491 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.949466 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:02:30.950080 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.949914 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"135d79b695889e2dbcc1a635370aa07de8c43bc0e9b34e7b632069bcad510039"} Jun 02 20:02:30.950080 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.949951 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"92c54019861c2498fdebfe3d6d529b45fd2d07a585c6fd13c602238075204b2a"} Jun 02 20:02:30.950080 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.949965 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"f12230cf122439c91106636e8c3cb10874552e8541998d45635994d492fb32a3"} Jun 02 20:02:30.950080 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.949978 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"a92f2cb2f6b336cf8604a061b749d640d2163582f767aa8e6f9e6db9c874944c"} Jun 02 20:02:30.951796 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.951743 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" event={"ID":"c9e0e36a-1b49-485a-a355-f83a1d2811af","Type":"ContainerStarted","Data":"6f0c10640a17cf2c30174762bcedb280f7a969e9203f47a0a7528997ce150578"} Jun 02 20:02:30.996356 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.996319 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:30.997176 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:30.997154 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:31.955304 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:31.955247 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-szm6f" event={"ID":"4b7baeb5-a2aa-4402-a452-ceeb4eba87cd","Type":"ContainerStarted","Data":"0d5fa9a7da1b2a45651bbc7840473797acd3166a384a945f95b2b4948c64e604"} Jun 02 20:02:31.974108 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:31.974039 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-szm6f" podStartSLOduration=4.993945521 podStartE2EDuration="22.974024538s" podCreationTimestamp="2026-06-02 20:02:09 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.401153224 +0000 UTC m=+3.147935875" lastFinishedPulling="2026-06-02 20:02:29.381232242 +0000 UTC m=+21.128014892" observedRunningTime="2026-06-02 20:02:31.973710453 +0000 UTC m=+23.720493226" watchObservedRunningTime="2026-06-02 20:02:31.974024538 +0000 UTC m=+23.720807269" Jun 02 20:02:32.818665 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:32.818620 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:32.818665 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:32.818646 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:32.818927 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:32.818799 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:32.818927 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:32.818910 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:32.957491 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:32.957454 2544 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 20:02:34.819214 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:34.819174 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:34.819805 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:34.819181 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:34.819805 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:34.819304 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:34.819805 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:34.819422 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:34.963799 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:34.963773 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:02:34.964190 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:34.964147 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"1ece1dc69475700c9c800285611369609bcd3c54cc956cb943a58bcf1b5cfaa7"} Jun 02 20:02:34.967302 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:34.967261 2544 generic.go:358] "Generic (PLEG): container finished" podID="c0a783bc-ea3b-43c8-b1c8-ed182108d5e7" containerID="d7335528eab9ba9279407f4a319a0a553a86c99194f328120add68a4bc3ac7c6" exitCode=0 Jun 02 20:02:34.967510 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:34.967348 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" event={"ID":"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7","Type":"ContainerDied","Data":"d7335528eab9ba9279407f4a319a0a553a86c99194f328120add68a4bc3ac7c6"} Jun 02 20:02:34.969672 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:34.969645 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" event={"ID":"c9e0e36a-1b49-485a-a355-f83a1d2811af","Type":"ContainerStarted","Data":"db247e89e3372ddbd248f0861db9ee236be601d82a1bfce25bc13e4cb8171d7a"} Jun 02 20:02:35.020482 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:35.020427 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkk67" podStartSLOduration=4.3774338870000005 podStartE2EDuration="27.020412711s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.403174561 +0000 UTC m=+3.149957210" lastFinishedPulling="2026-06-02 20:02:34.0461534 +0000 UTC m=+25.792936034" observedRunningTime="2026-06-02 20:02:35.020378571 +0000 UTC m=+26.767161228" watchObservedRunningTime="2026-06-02 20:02:35.020412711 +0000 UTC m=+26.767195362" Jun 02 20:02:36.374222 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.373990 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:36.374647 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.374349 2544 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 20:02:36.374726 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.374704 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5wx8b" Jun 02 20:02:36.819009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.818977 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:36.819009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.818991 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:36.819317 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:36.819114 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:36.819317 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:36.819250 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:36.976380 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.976352 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:02:36.976740 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.976689 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"8519b2e54f01d780dc25ce01fddb8f1ca1f098b375ba1a14344dbedba54aaf19"} Jun 02 20:02:36.977062 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.977025 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:36.977287 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.977255 2544 scope.go:117] "RemoveContainer" containerID="0d82e693d098c4ca98e1cf95476bb44e341c1adc4abbc38794e0f4bd1a6033f8" Jun 02 20:02:36.978861 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.978833 2544 generic.go:358] "Generic (PLEG): container finished" podID="c0a783bc-ea3b-43c8-b1c8-ed182108d5e7" containerID="77949cb59941f7d39b4381adddf5035b3c7b057eb8da589c4be075ee8775664a" exitCode=0 Jun 02 20:02:36.978958 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.978920 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" event={"ID":"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7","Type":"ContainerDied","Data":"77949cb59941f7d39b4381adddf5035b3c7b057eb8da589c4be075ee8775664a"} Jun 02 20:02:36.995034 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:36.994977 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:37.983535 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:37.983506 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:02:37.983974 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:37.983800 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" event={"ID":"1e1e183e-9a8f-495f-88ad-0d1fcc510ce2","Type":"ContainerStarted","Data":"55b234ff88b69b55435f7ce0d26bff2daf6d9473138bc460d1afcc3bffaa668e"} Jun 02 20:02:37.984116 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:37.984097 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:37.984192 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:37.984129 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:38.002149 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:38.002117 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:02:38.022273 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:38.021865 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" podStartSLOduration=11.975976957 podStartE2EDuration="30.021841458s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.408172094 +0000 UTC m=+3.154954742" lastFinishedPulling="2026-06-02 20:02:29.454036608 +0000 UTC m=+21.200819243" observedRunningTime="2026-06-02 20:02:38.018627525 +0000 UTC m=+29.765410188" watchObservedRunningTime="2026-06-02 20:02:38.021841458 +0000 UTC m=+29.768624117" Jun 02 20:02:38.309756 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:38.309721 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ps9mm"] Jun 02 20:02:38.309950 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:38.309860 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:38.310005 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:38.309963 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:38.312427 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:38.312357 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jscwj"] Jun 02 20:02:38.312608 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:38.312528 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:38.312686 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:38.312651 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:38.988902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:38.988856 2544 generic.go:358] "Generic (PLEG): container finished" podID="c0a783bc-ea3b-43c8-b1c8-ed182108d5e7" containerID="49ccfe245b799d694f0f81ec30f3a4de8dcc06b18e8b324ccf2a4c2f4afe4bea" exitCode=0 Jun 02 20:02:38.989583 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:38.988939 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" event={"ID":"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7","Type":"ContainerDied","Data":"49ccfe245b799d694f0f81ec30f3a4de8dcc06b18e8b324ccf2a4c2f4afe4bea"} Jun 02 20:02:39.819637 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:39.819600 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:39.819829 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:39.819752 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:39.819829 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:39.819809 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:39.819962 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:39.819927 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:41.819229 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:41.819184 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:41.819873 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:41.819322 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ps9mm" podUID="54b09c12-5631-4883-b105-da91367c4882" Jun 02 20:02:41.819873 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:41.819377 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:41.819873 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:41.819532 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:02:42.545947 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.545903 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:42.546145 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.546060 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:42.546145 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.546131 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:03:14.546114512 +0000 UTC m=+66.292897147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 20:02:42.570041 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.570008 2544 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-123.ec2.internal" event="NodeReady" Jun 02 20:02:42.570188 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.570139 2544 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 20:02:42.625486 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.625438 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6mgpm"] Jun 02 20:02:42.643127 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.643058 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2qn84"] Jun 02 20:02:42.646801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.646761 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:42.646999 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.646931 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 20:02:42.646999 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.646957 2544 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 20:02:42.646999 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.646971 2544 projected.go:194] Error preparing data for projected volume kube-api-access-jdws9 for pod openshift-network-diagnostics/network-check-target-ps9mm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:42.647159 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.647039 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9 podName:54b09c12-5631-4883-b105-da91367c4882 nodeName:}" failed. No retries permitted until 2026-06-02 20:03:14.647017887 +0000 UTC m=+66.393800538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jdws9" (UniqueName: "kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9") pod "network-check-target-ps9mm" (UID: "54b09c12-5631-4883-b105-da91367c4882") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 20:02:42.660837 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.660785 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6mgpm"] Jun 02 20:02:42.660837 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.660827 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2qn84"] Jun 02 20:02:42.660837 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.660846 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.661131 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.660967 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:42.663775 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.663493 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 20:02:42.663775 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.663583 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 20:02:42.664014 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.663584 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 20:02:42.664014 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.663590 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gclhs\"" Jun 02 20:02:42.664014 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.663684 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 20:02:42.664014 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.663744 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hqb8x\"" Jun 02 20:02:42.664014 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.663749 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 20:02:42.747732 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.747694 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb902210-6e13-46bf-bc36-c3462adaffba-tmp-dir\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.747732 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.747738 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99tlx\" (UniqueName: \"kubernetes.io/projected/cb902210-6e13-46bf-bc36-c3462adaffba-kube-api-access-99tlx\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.747953 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.747821 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk8hn\" (UniqueName: \"kubernetes.io/projected/b8f74370-b367-4258-9da0-f00e35a438d9-kube-api-access-vk8hn\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:42.747953 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.747866 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb902210-6e13-46bf-bc36-c3462adaffba-config-volume\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.747953 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.747884 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:42.747953 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.747945 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.848722 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.848581 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb902210-6e13-46bf-bc36-c3462adaffba-tmp-dir\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.848722 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.848631 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99tlx\" (UniqueName: \"kubernetes.io/projected/cb902210-6e13-46bf-bc36-c3462adaffba-kube-api-access-99tlx\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.848722 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.848688 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vk8hn\" (UniqueName: \"kubernetes.io/projected/b8f74370-b367-4258-9da0-f00e35a438d9-kube-api-access-vk8hn\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.848724 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb902210-6e13-46bf-bc36-c3462adaffba-config-volume\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.848752 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.848788 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.848905 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.848914 2544 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.848958 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb902210-6e13-46bf-bc36-c3462adaffba-tmp-dir\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.848970 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls podName:cb902210-6e13-46bf-bc36-c3462adaffba nodeName:}" failed. No retries permitted until 2026-06-02 20:02:43.348947351 +0000 UTC m=+35.095729996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls") pod "dns-default-6mgpm" (UID: "cb902210-6e13-46bf-bc36-c3462adaffba") : secret "dns-default-metrics-tls" not found Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:42.849008 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert podName:b8f74370-b367-4258-9da0-f00e35a438d9 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:43.348994404 +0000 UTC m=+35.095777038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert") pod "ingress-canary-2qn84" (UID: "b8f74370-b367-4258-9da0-f00e35a438d9") : secret "canary-serving-cert" not found Jun 02 20:02:42.849265 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.849262 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cb902210-6e13-46bf-bc36-c3462adaffba-config-volume\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.860614 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.860577 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99tlx\" (UniqueName: \"kubernetes.io/projected/cb902210-6e13-46bf-bc36-c3462adaffba-kube-api-access-99tlx\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:42.860789 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:42.860681 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk8hn\" (UniqueName: \"kubernetes.io/projected/b8f74370-b367-4258-9da0-f00e35a438d9-kube-api-access-vk8hn\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:43.351899 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.351857 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:43.352195 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.351915 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:43.352195 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:43.352038 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:43.352195 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:43.352058 2544 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:43.352195 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:43.352114 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls podName:cb902210-6e13-46bf-bc36-c3462adaffba nodeName:}" failed. No retries permitted until 2026-06-02 20:02:44.352093671 +0000 UTC m=+36.098876326 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls") pod "dns-default-6mgpm" (UID: "cb902210-6e13-46bf-bc36-c3462adaffba") : secret "dns-default-metrics-tls" not found Jun 02 20:02:43.352195 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:43.352131 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert podName:b8f74370-b367-4258-9da0-f00e35a438d9 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:44.352124647 +0000 UTC m=+36.098907282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert") pod "ingress-canary-2qn84" (UID: "b8f74370-b367-4258-9da0-f00e35a438d9") : secret "canary-serving-cert" not found Jun 02 20:02:43.819105 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.819062 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:02:43.819437 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.819253 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:02:43.822657 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.822629 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzgsf\"" Jun 02 20:02:43.823812 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.823776 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 20:02:43.823933 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.823776 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 20:02:43.823933 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.823827 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8fv6\"" Jun 02 20:02:43.823933 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:43.823848 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 20:02:44.359583 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:44.359521 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:44.360117 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:44.359724 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:44.360117 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:44.359762 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:44.360117 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:44.359809 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls podName:cb902210-6e13-46bf-bc36-c3462adaffba nodeName:}" failed. No retries permitted until 2026-06-02 20:02:46.359786098 +0000 UTC m=+38.106568748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls") pod "dns-default-6mgpm" (UID: "cb902210-6e13-46bf-bc36-c3462adaffba") : secret "dns-default-metrics-tls" not found Jun 02 20:02:44.360117 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:44.359876 2544 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:44.360117 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:44.359925 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert podName:b8f74370-b367-4258-9da0-f00e35a438d9 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:46.359908918 +0000 UTC m=+38.106691555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert") pod "ingress-canary-2qn84" (UID: "b8f74370-b367-4258-9da0-f00e35a438d9") : secret "canary-serving-cert" not found Jun 02 20:02:46.375774 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:46.375670 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:46.375774 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:46.375734 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:46.376225 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:46.375837 2544 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:46.376225 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:46.375881 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:46.376225 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:46.375907 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert podName:b8f74370-b367-4258-9da0-f00e35a438d9 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:50.375891568 +0000 UTC m=+42.122674203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert") pod "ingress-canary-2qn84" (UID: "b8f74370-b367-4258-9da0-f00e35a438d9") : secret "canary-serving-cert" not found Jun 02 20:02:46.376225 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:46.375930 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls podName:cb902210-6e13-46bf-bc36-c3462adaffba nodeName:}" failed. No retries permitted until 2026-06-02 20:02:50.375917302 +0000 UTC m=+42.122699940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls") pod "dns-default-6mgpm" (UID: "cb902210-6e13-46bf-bc36-c3462adaffba") : secret "dns-default-metrics-tls" not found Jun 02 20:02:47.009155 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:47.009119 2544 generic.go:358] "Generic (PLEG): container finished" podID="c0a783bc-ea3b-43c8-b1c8-ed182108d5e7" containerID="34a19091e88ad0f2cb051b429923a9c0373d94fea9f180753e627768a9e29b43" exitCode=0 Jun 02 20:02:47.009340 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:47.009167 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" event={"ID":"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7","Type":"ContainerDied","Data":"34a19091e88ad0f2cb051b429923a9c0373d94fea9f180753e627768a9e29b43"} Jun 02 20:02:48.014089 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:48.014054 2544 generic.go:358] "Generic (PLEG): container finished" podID="c0a783bc-ea3b-43c8-b1c8-ed182108d5e7" containerID="68e9714bb9228c82a1c42e706f971841361fe9ff9d1fc67b9c24234e14e14cfd" exitCode=0 Jun 02 20:02:48.014501 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:48.014111 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" event={"ID":"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7","Type":"ContainerDied","Data":"68e9714bb9228c82a1c42e706f971841361fe9ff9d1fc67b9c24234e14e14cfd"} Jun 02 20:02:49.018364 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:49.018326 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" event={"ID":"c0a783bc-ea3b-43c8-b1c8-ed182108d5e7","Type":"ContainerStarted","Data":"9e20782c880e3fe7a07b05626e50aa7eb26fb09b64aa88cadec0b174eba1c882"} Jun 02 20:02:49.051752 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:49.051698 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5t9zk" podStartSLOduration=6.344523312 podStartE2EDuration="41.051681752s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:02:11.40318685 +0000 UTC m=+3.149969487" lastFinishedPulling="2026-06-02 20:02:46.11034528 +0000 UTC m=+37.857127927" observedRunningTime="2026-06-02 20:02:49.04995498 +0000 UTC m=+40.796737638" watchObservedRunningTime="2026-06-02 20:02:49.051681752 +0000 UTC m=+40.798464408" Jun 02 20:02:50.408362 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:50.408323 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:50.408362 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:50.408370 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:50.408853 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:50.408490 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:50.408853 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:50.408541 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls podName:cb902210-6e13-46bf-bc36-c3462adaffba nodeName:}" failed. No retries permitted until 2026-06-02 20:02:58.408526387 +0000 UTC m=+50.155309021 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls") pod "dns-default-6mgpm" (UID: "cb902210-6e13-46bf-bc36-c3462adaffba") : secret "dns-default-metrics-tls" not found Jun 02 20:02:50.408853 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:50.408490 2544 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:50.408853 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:50.408620 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert podName:b8f74370-b367-4258-9da0-f00e35a438d9 nodeName:}" failed. No retries permitted until 2026-06-02 20:02:58.408606439 +0000 UTC m=+50.155389074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert") pod "ingress-canary-2qn84" (UID: "b8f74370-b367-4258-9da0-f00e35a438d9") : secret "canary-serving-cert" not found Jun 02 20:02:58.466335 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:58.466280 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:02:58.466335 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:02:58.466343 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:02:58.466945 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:58.466467 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:02:58.466945 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:58.466541 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls podName:cb902210-6e13-46bf-bc36-c3462adaffba nodeName:}" failed. No retries permitted until 2026-06-02 20:03:14.466526589 +0000 UTC m=+66.213309224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls") pod "dns-default-6mgpm" (UID: "cb902210-6e13-46bf-bc36-c3462adaffba") : secret "dns-default-metrics-tls" not found Jun 02 20:02:58.466945 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:58.466467 2544 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:02:58.466945 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:02:58.466611 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert podName:b8f74370-b367-4258-9da0-f00e35a438d9 nodeName:}" failed. No retries permitted until 2026-06-02 20:03:14.466599715 +0000 UTC m=+66.213382356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert") pod "ingress-canary-2qn84" (UID: "b8f74370-b367-4258-9da0-f00e35a438d9") : secret "canary-serving-cert" not found Jun 02 20:03:10.002566 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:10.002535 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vq2bj" Jun 02 20:03:14.481854 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.481823 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:03:14.482216 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.481863 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:03:14.482216 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:14.481952 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:03:14.482216 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:14.481998 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls podName:cb902210-6e13-46bf-bc36-c3462adaffba nodeName:}" failed. No retries permitted until 2026-06-02 20:03:46.481984533 +0000 UTC m=+98.228767167 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls") pod "dns-default-6mgpm" (UID: "cb902210-6e13-46bf-bc36-c3462adaffba") : secret "dns-default-metrics-tls" not found Jun 02 20:03:14.482216 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:14.481950 2544 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:03:14.482216 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:14.482076 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert podName:b8f74370-b367-4258-9da0-f00e35a438d9 nodeName:}" failed. No retries permitted until 2026-06-02 20:03:46.482065092 +0000 UTC m=+98.228847726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert") pod "ingress-canary-2qn84" (UID: "b8f74370-b367-4258-9da0-f00e35a438d9") : secret "canary-serving-cert" not found Jun 02 20:03:14.582150 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.582127 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:03:14.584840 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.584823 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 20:03:14.592444 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:14.592429 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 20:03:14.592493 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:14.592488 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:18.592476546 +0000 UTC m=+130.339259181 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : secret "metrics-daemon-secret" not found Jun 02 20:03:14.682425 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.682404 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:03:14.685278 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.685263 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 20:03:14.696045 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.696029 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 20:03:14.706905 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.706885 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdws9\" (UniqueName: \"kubernetes.io/projected/54b09c12-5631-4883-b105-da91367c4882-kube-api-access-jdws9\") pod \"network-check-target-ps9mm\" (UID: \"54b09c12-5631-4883-b105-da91367c4882\") " pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:03:14.746562 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.746507 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzgsf\"" Jun 02 20:03:14.753914 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.753894 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:03:14.884746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:14.884720 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ps9mm"] Jun 02 20:03:14.887847 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:03:14.887816 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b09c12_5631_4883_b105_da91367c4882.slice/crio-8d577c32c60988a44aac5e892f67821fa86c77a1cc54427e4657c21930a71a8b WatchSource:0}: Error finding container 8d577c32c60988a44aac5e892f67821fa86c77a1cc54427e4657c21930a71a8b: Status 404 returned error can't find the container with id 8d577c32c60988a44aac5e892f67821fa86c77a1cc54427e4657c21930a71a8b Jun 02 20:03:15.068751 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:15.068687 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ps9mm" event={"ID":"54b09c12-5631-4883-b105-da91367c4882","Type":"ContainerStarted","Data":"8d577c32c60988a44aac5e892f67821fa86c77a1cc54427e4657c21930a71a8b"} Jun 02 20:03:18.077346 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:18.077321 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ps9mm" event={"ID":"54b09c12-5631-4883-b105-da91367c4882","Type":"ContainerStarted","Data":"6e9badde78887448037b502b01250c6557ba0eead95c555028da3b4b9d5cc5e6"} Jun 02 20:03:18.077664 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:18.077494 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:03:46.497817 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:46.497679 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:03:46.497817 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:46.497733 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:03:46.498345 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:46.497845 2544 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 20:03:46.498345 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:46.497850 2544 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 20:03:46.498345 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:46.497898 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls podName:cb902210-6e13-46bf-bc36-c3462adaffba nodeName:}" failed. No retries permitted until 2026-06-02 20:04:50.497884807 +0000 UTC m=+162.244667441 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls") pod "dns-default-6mgpm" (UID: "cb902210-6e13-46bf-bc36-c3462adaffba") : secret "dns-default-metrics-tls" not found Jun 02 20:03:46.498345 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:03:46.497911 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert podName:b8f74370-b367-4258-9da0-f00e35a438d9 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:50.497904923 +0000 UTC m=+162.244687558 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert") pod "ingress-canary-2qn84" (UID: "b8f74370-b367-4258-9da0-f00e35a438d9") : secret "canary-serving-cert" not found Jun 02 20:03:49.081748 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:49.081716 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ps9mm" Jun 02 20:03:49.100724 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:03:49.100677 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ps9mm" podStartSLOduration=98.017932621 podStartE2EDuration="1m41.100665343s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:03:14.891446183 +0000 UTC m=+66.638228836" lastFinishedPulling="2026-06-02 20:03:17.974178919 +0000 UTC m=+69.720961558" observedRunningTime="2026-06-02 20:03:18.095097215 +0000 UTC m=+69.841879871" watchObservedRunningTime="2026-06-02 20:03:49.100665343 +0000 UTC m=+100.847447994" Jun 02 20:04:15.527075 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.527045 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn"] Jun 02 20:04:15.528925 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.528905 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn" Jun 02 20:04:15.531519 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.531498 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 20:04:15.531623 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.531548 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-298nj\"" Jun 02 20:04:15.532743 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.532719 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 20:04:15.538100 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.538078 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn"] Jun 02 20:04:15.541547 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.541528 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd"] Jun 02 20:04:15.545744 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.545704 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-77c68fbff5-vzz4q"] Jun 02 20:04:15.545899 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.545884 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.548083 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.548066 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.548713 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.548686 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 20:04:15.548805 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.548746 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qj898\"" Jun 02 20:04:15.548805 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.548781 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 20:04:15.548911 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.548815 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 20:04:15.550364 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.550347 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 20:04:15.551196 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.551179 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 20:04:15.551295 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.551220 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 20:04:15.551295 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.551289 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 20:04:15.551430 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.551355 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 20:04:15.551430 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.551237 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 20:04:15.551430 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.551253 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5hqp8\"" Jun 02 20:04:15.551430 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.551428 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 20:04:15.555215 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.555164 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd"] Jun 02 20:04:15.561621 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.561577 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-77c68fbff5-vzz4q"] Jun 02 20:04:15.587312 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.587293 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldj24\" (UniqueName: \"kubernetes.io/projected/896caa5c-6065-4494-974c-76f28db23a6a-kube-api-access-ldj24\") pod \"volume-data-source-validator-7598fd5bd-2tqpn\" (UID: \"896caa5c-6065-4494-974c-76f28db23a6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn" Jun 02 20:04:15.636976 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.636954 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2dsqx"] Jun 02 20:04:15.638616 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.638601 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.640750 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.640730 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-stwds"] Jun 02 20:04:15.641494 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.641472 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 20:04:15.641580 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.641532 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 20:04:15.641580 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.641535 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-hk2s2\"" Jun 02 20:04:15.641687 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.641633 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 20:04:15.641846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.641831 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 20:04:15.642556 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.642541 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.647047 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.647011 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-d7nnr\"" Jun 02 20:04:15.647221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.647208 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 20:04:15.647307 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.647263 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 20:04:15.647677 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.647659 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 20:04:15.648030 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.648008 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 20:04:15.649759 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.649745 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 20:04:15.656797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.656779 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2dsqx"] Jun 02 20:04:15.660154 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.660134 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-stwds"] Jun 02 20:04:15.688394 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688373 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.688503 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688413 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adfe181-c23f-4d0b-bb13-d20112279078-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.688503 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688443 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldj24\" (UniqueName: \"kubernetes.io/projected/896caa5c-6065-4494-974c-76f28db23a6a-kube-api-access-ldj24\") pod \"volume-data-source-validator-7598fd5bd-2tqpn\" (UID: \"896caa5c-6065-4494-974c-76f28db23a6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn" Jun 02 20:04:15.688503 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688471 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nbpw\" (UniqueName: \"kubernetes.io/projected/60fcb7c0-c38a-492f-96c6-590a843de920-kube-api-access-7nbpw\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.688655 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688563 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-stats-auth\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.688655 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688585 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.688655 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688604 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw68d\" (UniqueName: \"kubernetes.io/projected/7adfe181-c23f-4d0b-bb13-d20112279078-kube-api-access-sw68d\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.688802 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688651 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7adfe181-c23f-4d0b-bb13-d20112279078-tmp\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.688802 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688678 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7adfe181-c23f-4d0b-bb13-d20112279078-snapshots\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.688802 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688693 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7adfe181-c23f-4d0b-bb13-d20112279078-serving-cert\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.688802 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688709 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.688802 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688761 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-default-certificate\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.688802 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688795 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.689001 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688821 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb6mf\" (UniqueName: \"kubernetes.io/projected/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-kube-api-access-kb6mf\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.689001 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.688840 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adfe181-c23f-4d0b-bb13-d20112279078-service-ca-bundle\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.701451 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.701433 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldj24\" (UniqueName: \"kubernetes.io/projected/896caa5c-6065-4494-974c-76f28db23a6a-kube-api-access-ldj24\") pod \"volume-data-source-validator-7598fd5bd-2tqpn\" (UID: \"896caa5c-6065-4494-974c-76f28db23a6a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn" Jun 02 20:04:15.789957 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.789908 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adfe181-c23f-4d0b-bb13-d20112279078-service-ca-bundle\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.789957 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.789942 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.790068 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.789959 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adfe181-c23f-4d0b-bb13-d20112279078-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.790107 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790081 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nbpw\" (UniqueName: \"kubernetes.io/projected/60fcb7c0-c38a-492f-96c6-590a843de920-kube-api-access-7nbpw\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.790107 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:15.790088 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:16.290068991 +0000 UTC m=+128.036851627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : configmap references non-existent config key: service-ca.crt Jun 02 20:04:15.790174 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790119 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb7th\" (UniqueName: \"kubernetes.io/projected/3f17c3fb-b66a-41e7-91ec-51331d17a999-kube-api-access-xb7th\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.790244 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790228 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-stats-auth\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.790286 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790260 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.790329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790287 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw68d\" (UniqueName: \"kubernetes.io/projected/7adfe181-c23f-4d0b-bb13-d20112279078-kube-api-access-sw68d\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.790329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790320 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f17c3fb-b66a-41e7-91ec-51331d17a999-serving-cert\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.790443 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790366 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7adfe181-c23f-4d0b-bb13-d20112279078-tmp\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.790501 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790433 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7adfe181-c23f-4d0b-bb13-d20112279078-snapshots\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.790501 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790473 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7adfe181-c23f-4d0b-bb13-d20112279078-serving-cert\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.790603 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790501 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.790603 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790534 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-default-certificate\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.790603 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790551 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adfe181-c23f-4d0b-bb13-d20112279078-service-ca-bundle\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.790603 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790565 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.790603 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790598 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f17c3fb-b66a-41e7-91ec-51331d17a999-config\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.790844 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790643 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kb6mf\" (UniqueName: \"kubernetes.io/projected/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-kube-api-access-kb6mf\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.790844 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790668 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7adfe181-c23f-4d0b-bb13-d20112279078-tmp\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.790844 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:15.790754 2544 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 20:04:15.790844 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:15.790803 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:16.290787783 +0000 UTC m=+128.037570432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : secret "router-metrics-certs-default" not found Jun 02 20:04:15.791035 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.790852 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7adfe181-c23f-4d0b-bb13-d20112279078-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.791035 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:15.790950 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:15.791035 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:15.791014 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls podName:ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b nodeName:}" failed. No retries permitted until 2026-06-02 20:04:16.290997907 +0000 UTC m=+128.037780543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mbfqd" (UID: "ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b") : secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:15.791035 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.791018 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.791162 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.791116 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7adfe181-c23f-4d0b-bb13-d20112279078-snapshots\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.792722 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.792702 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-stats-auth\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.792794 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.792720 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-default-certificate\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.792794 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.792764 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7adfe181-c23f-4d0b-bb13-d20112279078-serving-cert\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.801023 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.800999 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb6mf\" (UniqueName: \"kubernetes.io/projected/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-kube-api-access-kb6mf\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:15.801732 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.801712 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nbpw\" (UniqueName: \"kubernetes.io/projected/60fcb7c0-c38a-492f-96c6-590a843de920-kube-api-access-7nbpw\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:15.801896 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.801876 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw68d\" (UniqueName: \"kubernetes.io/projected/7adfe181-c23f-4d0b-bb13-d20112279078-kube-api-access-sw68d\") pod \"insights-operator-788bf58df5-2dsqx\" (UID: \"7adfe181-c23f-4d0b-bb13-d20112279078\") " pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.838091 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.838069 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn" Jun 02 20:04:15.896938 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.896896 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f17c3fb-b66a-41e7-91ec-51331d17a999-config\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.897795 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.897657 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f17c3fb-b66a-41e7-91ec-51331d17a999-config\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.898055 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.898038 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xb7th\" (UniqueName: \"kubernetes.io/projected/3f17c3fb-b66a-41e7-91ec-51331d17a999-kube-api-access-xb7th\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.898621 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.898601 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f17c3fb-b66a-41e7-91ec-51331d17a999-serving-cert\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.901496 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.901449 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f17c3fb-b66a-41e7-91ec-51331d17a999-serving-cert\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.913681 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.913661 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb7th\" (UniqueName: \"kubernetes.io/projected/3f17c3fb-b66a-41e7-91ec-51331d17a999-kube-api-access-xb7th\") pod \"service-ca-operator-69877444c-stwds\" (UID: \"3f17c3fb-b66a-41e7-91ec-51331d17a999\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.947993 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.947969 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-2dsqx" Jun 02 20:04:15.953696 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.953654 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" Jun 02 20:04:15.969092 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:15.969070 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn"] Jun 02 20:04:15.971981 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:15.971938 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896caa5c_6065_4494_974c_76f28db23a6a.slice/crio-c8ae9908a3dd15e3a5afe995307dd68b302cb6d7abad8a6011502af6bc42de48 WatchSource:0}: Error finding container c8ae9908a3dd15e3a5afe995307dd68b302cb6d7abad8a6011502af6bc42de48: Status 404 returned error can't find the container with id c8ae9908a3dd15e3a5afe995307dd68b302cb6d7abad8a6011502af6bc42de48 Jun 02 20:04:16.073192 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:16.073167 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2dsqx"] Jun 02 20:04:16.075752 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:16.075721 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7adfe181_c23f_4d0b_bb13_d20112279078.slice/crio-2d82a0da7cbd4c63cef63ca295f955ad8f8e0ea293b4c842efa6b58dbf1a4695 WatchSource:0}: Error finding container 2d82a0da7cbd4c63cef63ca295f955ad8f8e0ea293b4c842efa6b58dbf1a4695: Status 404 returned error can't find the container with id 2d82a0da7cbd4c63cef63ca295f955ad8f8e0ea293b4c842efa6b58dbf1a4695 Jun 02 20:04:16.086823 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:16.086799 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-stwds"] Jun 02 20:04:16.089691 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:16.089670 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f17c3fb_b66a_41e7_91ec_51331d17a999.slice/crio-02173683b820ec94d85521c6d953e11a89a9625c23483f1c183a470df5fea6b8 WatchSource:0}: Error finding container 02173683b820ec94d85521c6d953e11a89a9625c23483f1c183a470df5fea6b8: Status 404 returned error can't find the container with id 02173683b820ec94d85521c6d953e11a89a9625c23483f1c183a470df5fea6b8 Jun 02 20:04:16.182693 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:16.182668 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" event={"ID":"3f17c3fb-b66a-41e7-91ec-51331d17a999","Type":"ContainerStarted","Data":"02173683b820ec94d85521c6d953e11a89a9625c23483f1c183a470df5fea6b8"} Jun 02 20:04:16.183612 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:16.183592 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2dsqx" event={"ID":"7adfe181-c23f-4d0b-bb13-d20112279078","Type":"ContainerStarted","Data":"2d82a0da7cbd4c63cef63ca295f955ad8f8e0ea293b4c842efa6b58dbf1a4695"} Jun 02 20:04:16.184342 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:16.184315 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn" event={"ID":"896caa5c-6065-4494-974c-76f28db23a6a","Type":"ContainerStarted","Data":"c8ae9908a3dd15e3a5afe995307dd68b302cb6d7abad8a6011502af6bc42de48"} Jun 02 20:04:16.304358 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:16.304294 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:16.304480 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:16.304362 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:16.304480 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:16.304401 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:16.304593 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:16.304481 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:16.304593 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:16.304483 2544 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 20:04:16.304593 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:16.304533 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:17.304509663 +0000 UTC m=+129.051292318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : configmap references non-existent config key: service-ca.crt Jun 02 20:04:16.304593 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:16.304557 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls podName:ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b nodeName:}" failed. No retries permitted until 2026-06-02 20:04:17.304547827 +0000 UTC m=+129.051330471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mbfqd" (UID: "ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b") : secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:16.304593 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:16.304574 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:17.304564209 +0000 UTC m=+129.051346849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : secret "router-metrics-certs-default" not found Jun 02 20:04:17.312852 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:17.312682 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:17.312852 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:17.312742 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:17.312852 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:17.312802 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:17.313496 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:17.312878 2544 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 20:04:17.313496 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:17.312953 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:19.312932189 +0000 UTC m=+131.059714840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : secret "router-metrics-certs-default" not found Jun 02 20:04:17.313496 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:17.312976 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:19.312964163 +0000 UTC m=+131.059746801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : configmap references non-existent config key: service-ca.crt Jun 02 20:04:17.313496 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:17.312987 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:17.313496 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:17.313051 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls podName:ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b nodeName:}" failed. No retries permitted until 2026-06-02 20:04:19.31303991 +0000 UTC m=+131.059822557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mbfqd" (UID: "ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b") : secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:18.189565 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:18.189522 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn" event={"ID":"896caa5c-6065-4494-974c-76f28db23a6a","Type":"ContainerStarted","Data":"01b200faf7bad07ee45a8b600bdbfa1b9df6048cf780d03d3061858af6005c37"} Jun 02 20:04:18.206908 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:18.206867 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-2tqpn" podStartSLOduration=1.68623755 podStartE2EDuration="3.20685432s" podCreationTimestamp="2026-06-02 20:04:15 +0000 UTC" firstStartedPulling="2026-06-02 20:04:15.973885074 +0000 UTC m=+127.720667709" lastFinishedPulling="2026-06-02 20:04:17.494501831 +0000 UTC m=+129.241284479" observedRunningTime="2026-06-02 20:04:18.205933802 +0000 UTC m=+129.952716461" watchObservedRunningTime="2026-06-02 20:04:18.20685432 +0000 UTC m=+129.953636977" Jun 02 20:04:18.624877 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:18.624785 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:04:18.625297 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:18.624972 2544 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 20:04:18.625297 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:18.625043 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs podName:c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0 nodeName:}" failed. No retries permitted until 2026-06-02 20:06:20.625026327 +0000 UTC m=+252.371808974 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs") pod "network-metrics-daemon-jscwj" (UID: "c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0") : secret "metrics-daemon-secret" not found Jun 02 20:04:19.192866 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:19.192830 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" event={"ID":"3f17c3fb-b66a-41e7-91ec-51331d17a999","Type":"ContainerStarted","Data":"56757b1eceb0339942449d3467e2fb3f2176d9ce3844f41c3fe22a27853a4012"} Jun 02 20:04:19.194110 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:19.194075 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2dsqx" event={"ID":"7adfe181-c23f-4d0b-bb13-d20112279078","Type":"ContainerStarted","Data":"e0344cbb81baf64f4218f0ea179893863659ea8a1060c1b4fee07d52a9d88b81"} Jun 02 20:04:19.210520 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:19.210478 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" podStartSLOduration=1.525900707 podStartE2EDuration="4.210466089s" podCreationTimestamp="2026-06-02 20:04:15 +0000 UTC" firstStartedPulling="2026-06-02 20:04:16.091276879 +0000 UTC m=+127.838059515" lastFinishedPulling="2026-06-02 20:04:18.775842248 +0000 UTC m=+130.522624897" observedRunningTime="2026-06-02 20:04:19.210051899 +0000 UTC m=+130.956834548" watchObservedRunningTime="2026-06-02 20:04:19.210466089 +0000 UTC m=+130.957248747" Jun 02 20:04:19.232815 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:19.232767 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-2dsqx" podStartSLOduration=1.536417327 podStartE2EDuration="4.232756017s" podCreationTimestamp="2026-06-02 20:04:15 +0000 UTC" firstStartedPulling="2026-06-02 20:04:16.077577825 +0000 UTC m=+127.824360460" lastFinishedPulling="2026-06-02 20:04:18.773916509 +0000 UTC m=+130.520699150" observedRunningTime="2026-06-02 20:04:19.231613356 +0000 UTC m=+130.978396013" watchObservedRunningTime="2026-06-02 20:04:19.232756017 +0000 UTC m=+130.979538671" Jun 02 20:04:19.330621 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:19.330586 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:19.330798 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:19.330734 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:19.330798 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:19.330749 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:19.330904 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:19.330800 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls podName:ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b nodeName:}" failed. No retries permitted until 2026-06-02 20:04:23.330781074 +0000 UTC m=+135.077563726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mbfqd" (UID: "ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b") : secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:19.330967 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:19.330907 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:23.33088675 +0000 UTC m=+135.077669391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : configmap references non-existent config key: service-ca.crt Jun 02 20:04:19.331118 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:19.331060 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:19.331335 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:19.331243 2544 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 20:04:19.331335 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:19.331308 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:23.331291293 +0000 UTC m=+135.078073927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : secret "router-metrics-certs-default" not found Jun 02 20:04:22.352861 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:22.352833 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fcpd_6b123b60-d330-48ca-8f2c-1967abd41ce7/dns-node-resolver/0.log" Jun 02 20:04:23.246043 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.246009 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-m5h69"] Jun 02 20:04:23.248828 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.248814 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.251549 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.251526 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 20:04:23.251663 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.251530 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 20:04:23.251663 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.251532 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 20:04:23.252761 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.252745 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 20:04:23.252836 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.252765 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tc89t\"" Jun 02 20:04:23.259306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.259287 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-m5h69"] Jun 02 20:04:23.361456 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.361420 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.361486 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p8dn\" (UniqueName: \"kubernetes.io/projected/9088b922-1aee-4338-a2af-56a4f2fbe591-kube-api-access-8p8dn\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.361506 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9088b922-1aee-4338-a2af-56a4f2fbe591-signing-cabundle\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.361537 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:23.361558 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:31.361540887 +0000 UTC m=+143.108323526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : configmap references non-existent config key: service-ca.crt Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:23.361611 2544 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:23.361652 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs podName:60fcb7c0-c38a-492f-96c6-590a843de920 nodeName:}" failed. No retries permitted until 2026-06-02 20:04:31.361637321 +0000 UTC m=+143.108419956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs") pod "router-default-77c68fbff5-vzz4q" (UID: "60fcb7c0-c38a-492f-96c6-590a843de920") : secret "router-metrics-certs-default" not found Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.361650 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.361707 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9088b922-1aee-4338-a2af-56a4f2fbe591-signing-key\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:23.361727 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:23.361894 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:23.361785 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls podName:ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b nodeName:}" failed. No retries permitted until 2026-06-02 20:04:31.361771681 +0000 UTC m=+143.108554326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mbfqd" (UID: "ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b") : secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:23.462731 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.462697 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9088b922-1aee-4338-a2af-56a4f2fbe591-signing-key\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.462903 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.462788 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8p8dn\" (UniqueName: \"kubernetes.io/projected/9088b922-1aee-4338-a2af-56a4f2fbe591-kube-api-access-8p8dn\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.462903 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.462817 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9088b922-1aee-4338-a2af-56a4f2fbe591-signing-cabundle\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.463565 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.463544 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9088b922-1aee-4338-a2af-56a4f2fbe591-signing-cabundle\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.465299 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.465271 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9088b922-1aee-4338-a2af-56a4f2fbe591-signing-key\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.471887 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.471864 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p8dn\" (UniqueName: \"kubernetes.io/projected/9088b922-1aee-4338-a2af-56a4f2fbe591-kube-api-access-8p8dn\") pod \"service-ca-685df94d57-m5h69\" (UID: \"9088b922-1aee-4338-a2af-56a4f2fbe591\") " pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.554563 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.554485 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqbfc_ba40bfef-d03e-40f1-8c51-58c0a44374f7/node-ca/0.log" Jun 02 20:04:23.557625 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.557602 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-m5h69" Jun 02 20:04:23.681825 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:23.681793 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-m5h69"] Jun 02 20:04:23.684580 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:23.684553 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9088b922_1aee_4338_a2af_56a4f2fbe591.slice/crio-fbb16476c099ed9dc8148dad2823ba73750dc98329e70c12757a36b567252274 WatchSource:0}: Error finding container fbb16476c099ed9dc8148dad2823ba73750dc98329e70c12757a36b567252274: Status 404 returned error can't find the container with id fbb16476c099ed9dc8148dad2823ba73750dc98329e70c12757a36b567252274 Jun 02 20:04:24.206850 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:24.206809 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-m5h69" event={"ID":"9088b922-1aee-4338-a2af-56a4f2fbe591","Type":"ContainerStarted","Data":"091c76df4fc166e1174f4716b6839d498ec6bc3904237bde7d9810f3197107d9"} Jun 02 20:04:24.206850 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:24.206853 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-m5h69" event={"ID":"9088b922-1aee-4338-a2af-56a4f2fbe591","Type":"ContainerStarted","Data":"fbb16476c099ed9dc8148dad2823ba73750dc98329e70c12757a36b567252274"} Jun 02 20:04:24.226538 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:24.226484 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-m5h69" podStartSLOduration=1.226470647 podStartE2EDuration="1.226470647s" podCreationTimestamp="2026-06-02 20:04:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:04:24.225091726 +0000 UTC m=+135.971874383" watchObservedRunningTime="2026-06-02 20:04:24.226470647 +0000 UTC m=+135.973253300" Jun 02 20:04:31.425696 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:31.425657 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:31.426112 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:31.425705 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:31.426112 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:31.425740 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:31.426112 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:31.425865 2544 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:31.426112 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:31.425932 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls podName:ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b nodeName:}" failed. No retries permitted until 2026-06-02 20:04:47.425916578 +0000 UTC m=+159.172699219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mbfqd" (UID: "ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b") : secret "cluster-monitoring-operator-tls" not found Jun 02 20:04:31.426261 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:31.426247 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60fcb7c0-c38a-492f-96c6-590a843de920-service-ca-bundle\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:31.428015 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:31.427987 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60fcb7c0-c38a-492f-96c6-590a843de920-metrics-certs\") pod \"router-default-77c68fbff5-vzz4q\" (UID: \"60fcb7c0-c38a-492f-96c6-590a843de920\") " pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:31.462312 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:31.462274 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:31.585814 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:31.585784 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-77c68fbff5-vzz4q"] Jun 02 20:04:31.588889 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:31.588859 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60fcb7c0_c38a_492f_96c6_590a843de920.slice/crio-b17aff0b77d5c2c09069d4b7eef23226fd94dd398af557a3d08e3ff12f9c9289 WatchSource:0}: Error finding container b17aff0b77d5c2c09069d4b7eef23226fd94dd398af557a3d08e3ff12f9c9289: Status 404 returned error can't find the container with id b17aff0b77d5c2c09069d4b7eef23226fd94dd398af557a3d08e3ff12f9c9289 Jun 02 20:04:32.229109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:32.229072 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" event={"ID":"60fcb7c0-c38a-492f-96c6-590a843de920","Type":"ContainerStarted","Data":"ca11d9260a82aedbf08079d0fc596b1c886ae19a7fcefa68e43777cf6cfec55e"} Jun 02 20:04:32.229109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:32.229112 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" event={"ID":"60fcb7c0-c38a-492f-96c6-590a843de920","Type":"ContainerStarted","Data":"b17aff0b77d5c2c09069d4b7eef23226fd94dd398af557a3d08e3ff12f9c9289"} Jun 02 20:04:32.251418 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:32.251336 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" podStartSLOduration=17.251321642 podStartE2EDuration="17.251321642s" podCreationTimestamp="2026-06-02 20:04:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:04:32.250513474 +0000 UTC m=+143.997296134" watchObservedRunningTime="2026-06-02 20:04:32.251321642 +0000 UTC m=+143.998104299" Jun 02 20:04:32.462783 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:32.462748 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:32.465308 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:32.465283 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:33.232124 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:33.232089 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:33.233333 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:33.233314 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-77c68fbff5-vzz4q" Jun 02 20:04:42.595464 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.595439 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-4cw5q"] Jun 02 20:04:42.598023 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.598005 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-4cw5q" Jun 02 20:04:42.600797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.600779 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 20:04:42.600911 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.600786 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xrsxz\"" Jun 02 20:04:42.600911 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.600866 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 20:04:42.604739 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.604720 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfr9\" (UniqueName: \"kubernetes.io/projected/f30db05c-08a5-4abd-b2b5-2a8d4725737f-kube-api-access-dtfr9\") pod \"downloads-c65b8dc4b-4cw5q\" (UID: \"f30db05c-08a5-4abd-b2b5-2a8d4725737f\") " pod="openshift-console/downloads-c65b8dc4b-4cw5q" Jun 02 20:04:42.610440 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.610421 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k4gvw"] Jun 02 20:04:42.612262 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.612240 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.614403 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.614366 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-4cw5q"] Jun 02 20:04:42.615274 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.615256 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 20:04:42.615366 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.615286 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 20:04:42.615514 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.615500 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9rtd6\"" Jun 02 20:04:42.629962 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.629938 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k4gvw"] Jun 02 20:04:42.662164 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.662141 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f4987f89d-hsksw"] Jun 02 20:04:42.664305 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.664291 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.666967 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.666946 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj8r6\"" Jun 02 20:04:42.667381 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.667354 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 20:04:42.667685 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.667490 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 20:04:42.668779 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.668753 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 20:04:42.677429 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.677410 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 20:04:42.681998 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.681978 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f4987f89d-hsksw"] Jun 02 20:04:42.705626 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705604 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmk4n\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-kube-api-access-cmk4n\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.705704 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705634 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/713333d3-6a0d-48a3-942f-2ccebc555589-registry-certificates\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.705704 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705653 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/713333d3-6a0d-48a3-942f-2ccebc555589-trusted-ca\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.705803 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705715 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf750d6b-c435-4198-851f-743a9f664a30-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.705803 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705741 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/713333d3-6a0d-48a3-942f-2ccebc555589-installation-pull-secrets\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.705803 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705785 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-registry-tls\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.705924 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705819 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf750d6b-c435-4198-851f-743a9f664a30-data-volume\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.705924 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705835 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw8hm\" (UniqueName: \"kubernetes.io/projected/bf750d6b-c435-4198-851f-743a9f664a30-kube-api-access-kw8hm\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.705924 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705849 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/713333d3-6a0d-48a3-942f-2ccebc555589-ca-trust-extracted\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.705924 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705866 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf750d6b-c435-4198-851f-743a9f664a30-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.705924 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705887 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713333d3-6a0d-48a3-942f-2ccebc555589-image-registry-private-configuration\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.706095 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.705937 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfr9\" (UniqueName: \"kubernetes.io/projected/f30db05c-08a5-4abd-b2b5-2a8d4725737f-kube-api-access-dtfr9\") pod \"downloads-c65b8dc4b-4cw5q\" (UID: \"f30db05c-08a5-4abd-b2b5-2a8d4725737f\") " pod="openshift-console/downloads-c65b8dc4b-4cw5q" Jun 02 20:04:42.706095 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.706016 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-bound-sa-token\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.706095 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.706046 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf750d6b-c435-4198-851f-743a9f664a30-crio-socket\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.720013 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.719990 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfr9\" (UniqueName: \"kubernetes.io/projected/f30db05c-08a5-4abd-b2b5-2a8d4725737f-kube-api-access-dtfr9\") pod \"downloads-c65b8dc4b-4cw5q\" (UID: \"f30db05c-08a5-4abd-b2b5-2a8d4725737f\") " pod="openshift-console/downloads-c65b8dc4b-4cw5q" Jun 02 20:04:42.807115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807089 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-bound-sa-token\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.807228 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807123 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf750d6b-c435-4198-851f-743a9f664a30-crio-socket\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.807228 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807142 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmk4n\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-kube-api-access-cmk4n\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.807228 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807168 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/713333d3-6a0d-48a3-942f-2ccebc555589-registry-certificates\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.807228 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807191 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/713333d3-6a0d-48a3-942f-2ccebc555589-trusted-ca\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.807228 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807220 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf750d6b-c435-4198-851f-743a9f664a30-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.807522 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807226 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bf750d6b-c435-4198-851f-743a9f664a30-crio-socket\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.807522 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807245 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/713333d3-6a0d-48a3-942f-2ccebc555589-installation-pull-secrets\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.807522 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807287 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-registry-tls\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.807522 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807338 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf750d6b-c435-4198-851f-743a9f664a30-data-volume\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.807522 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807361 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kw8hm\" (UniqueName: \"kubernetes.io/projected/bf750d6b-c435-4198-851f-743a9f664a30-kube-api-access-kw8hm\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.807522 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807436 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/713333d3-6a0d-48a3-942f-2ccebc555589-ca-trust-extracted\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.807522 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807469 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf750d6b-c435-4198-851f-743a9f664a30-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.807522 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807506 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713333d3-6a0d-48a3-942f-2ccebc555589-image-registry-private-configuration\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.807891 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807770 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf750d6b-c435-4198-851f-743a9f664a30-data-volume\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.808154 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.807963 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/713333d3-6a0d-48a3-942f-2ccebc555589-ca-trust-extracted\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.808267 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.808224 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bf750d6b-c435-4198-851f-743a9f664a30-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.808373 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.808291 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/713333d3-6a0d-48a3-942f-2ccebc555589-registry-certificates\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.808820 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.808800 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/713333d3-6a0d-48a3-942f-2ccebc555589-trusted-ca\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.810058 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.810008 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/713333d3-6a0d-48a3-942f-2ccebc555589-installation-pull-secrets\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.810135 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.810055 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-registry-tls\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.810277 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.810257 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bf750d6b-c435-4198-851f-743a9f664a30-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.810329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.810312 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/713333d3-6a0d-48a3-942f-2ccebc555589-image-registry-private-configuration\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.821737 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.821708 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-bound-sa-token\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.822273 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.822231 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw8hm\" (UniqueName: \"kubernetes.io/projected/bf750d6b-c435-4198-851f-743a9f664a30-kube-api-access-kw8hm\") pod \"insights-runtime-extractor-k4gvw\" (UID: \"bf750d6b-c435-4198-851f-743a9f664a30\") " pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.822273 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.822243 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmk4n\" (UniqueName: \"kubernetes.io/projected/713333d3-6a0d-48a3-942f-2ccebc555589-kube-api-access-cmk4n\") pod \"image-registry-7f4987f89d-hsksw\" (UID: \"713333d3-6a0d-48a3-942f-2ccebc555589\") " pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:42.906921 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.906904 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-4cw5q" Jun 02 20:04:42.921623 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.921604 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k4gvw" Jun 02 20:04:42.977039 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:42.976565 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:43.050624 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.050596 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-4cw5q"] Jun 02 20:04:43.052709 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:43.052679 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30db05c_08a5_4abd_b2b5_2a8d4725737f.slice/crio-a2395f108b048a236664737302a90f9fb0f27f859ef2a722414b5f900a5974d8 WatchSource:0}: Error finding container a2395f108b048a236664737302a90f9fb0f27f859ef2a722414b5f900a5974d8: Status 404 returned error can't find the container with id a2395f108b048a236664737302a90f9fb0f27f859ef2a722414b5f900a5974d8 Jun 02 20:04:43.068779 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.068590 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k4gvw"] Jun 02 20:04:43.072288 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:43.072258 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf750d6b_c435_4198_851f_743a9f664a30.slice/crio-0f99540f879d731a598e1241cb84742203f696c010f982962e2aa34b08f9d7a8 WatchSource:0}: Error finding container 0f99540f879d731a598e1241cb84742203f696c010f982962e2aa34b08f9d7a8: Status 404 returned error can't find the container with id 0f99540f879d731a598e1241cb84742203f696c010f982962e2aa34b08f9d7a8 Jun 02 20:04:43.119979 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.119956 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f4987f89d-hsksw"] Jun 02 20:04:43.122331 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:43.122304 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713333d3_6a0d_48a3_942f_2ccebc555589.slice/crio-5e7b0cbb110ca17fb8e26f9ea2eab5852c7fe3953c838e5ec5b6823523ddddf8 WatchSource:0}: Error finding container 5e7b0cbb110ca17fb8e26f9ea2eab5852c7fe3953c838e5ec5b6823523ddddf8: Status 404 returned error can't find the container with id 5e7b0cbb110ca17fb8e26f9ea2eab5852c7fe3953c838e5ec5b6823523ddddf8 Jun 02 20:04:43.258291 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.258251 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" event={"ID":"713333d3-6a0d-48a3-942f-2ccebc555589","Type":"ContainerStarted","Data":"3336c9e87a66553d8b746ffbd814661d962f608d69ab9da16f82eb3d30f536ea"} Jun 02 20:04:43.258291 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.258291 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" event={"ID":"713333d3-6a0d-48a3-942f-2ccebc555589","Type":"ContainerStarted","Data":"5e7b0cbb110ca17fb8e26f9ea2eab5852c7fe3953c838e5ec5b6823523ddddf8"} Jun 02 20:04:43.258537 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.258380 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:04:43.259638 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.259610 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4gvw" event={"ID":"bf750d6b-c435-4198-851f-743a9f664a30","Type":"ContainerStarted","Data":"0dd9e6a88758e9a3d88d76b57715ce78044a9863eced2c08f8b2c5fb6aaf0541"} Jun 02 20:04:43.259638 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.259639 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4gvw" event={"ID":"bf750d6b-c435-4198-851f-743a9f664a30","Type":"ContainerStarted","Data":"0f99540f879d731a598e1241cb84742203f696c010f982962e2aa34b08f9d7a8"} Jun 02 20:04:43.260597 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.260578 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-4cw5q" event={"ID":"f30db05c-08a5-4abd-b2b5-2a8d4725737f","Type":"ContainerStarted","Data":"a2395f108b048a236664737302a90f9fb0f27f859ef2a722414b5f900a5974d8"} Jun 02 20:04:43.279892 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:43.279834 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" podStartSLOduration=1.279822577 podStartE2EDuration="1.279822577s" podCreationTimestamp="2026-06-02 20:04:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:04:43.278741508 +0000 UTC m=+155.025524165" watchObservedRunningTime="2026-06-02 20:04:43.279822577 +0000 UTC m=+155.026605233" Jun 02 20:04:44.264917 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:44.264870 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4gvw" event={"ID":"bf750d6b-c435-4198-851f-743a9f664a30","Type":"ContainerStarted","Data":"123bf3254a883a8f858959ee28802f7e68a02ad41f5df831ca879c3038bbd834"} Jun 02 20:04:45.676008 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:45.675973 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6mgpm" podUID="cb902210-6e13-46bf-bc36-c3462adaffba" Jun 02 20:04:45.682129 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:45.682095 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2qn84" podUID="b8f74370-b367-4258-9da0-f00e35a438d9" Jun 02 20:04:46.273206 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:46.273174 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6mgpm" Jun 02 20:04:46.273206 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:46.273187 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4gvw" event={"ID":"bf750d6b-c435-4198-851f-743a9f664a30","Type":"ContainerStarted","Data":"7a6311f7216ae0823b0e73807d349c52e254b9d993f0c0b6731460689e43244b"} Jun 02 20:04:46.293517 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:46.293478 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k4gvw" podStartSLOduration=1.950789129 podStartE2EDuration="4.293466537s" podCreationTimestamp="2026-06-02 20:04:42 +0000 UTC" firstStartedPulling="2026-06-02 20:04:43.127837228 +0000 UTC m=+154.874619863" lastFinishedPulling="2026-06-02 20:04:45.470514632 +0000 UTC m=+157.217297271" observedRunningTime="2026-06-02 20:04:46.293028336 +0000 UTC m=+158.039810995" watchObservedRunningTime="2026-06-02 20:04:46.293466537 +0000 UTC m=+158.040249190" Jun 02 20:04:46.833540 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:04:46.833502 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jscwj" podUID="c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0" Jun 02 20:04:47.446218 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:47.446176 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:47.448548 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:47.448529 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mbfqd\" (UID: \"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:47.656994 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:47.656962 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" Jun 02 20:04:47.793502 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:47.793471 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd"] Jun 02 20:04:47.797015 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:47.796985 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0ebcd4_9a62_4f3c_904d_e8127b8bb97b.slice/crio-5a8496853d06154508c33e64744e780e3341bd2857745e8b637e115a5407ddad WatchSource:0}: Error finding container 5a8496853d06154508c33e64744e780e3341bd2857745e8b637e115a5407ddad: Status 404 returned error can't find the container with id 5a8496853d06154508c33e64744e780e3341bd2857745e8b637e115a5407ddad Jun 02 20:04:48.281453 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:48.281412 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" event={"ID":"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b","Type":"ContainerStarted","Data":"5a8496853d06154508c33e64744e780e3341bd2857745e8b637e115a5407ddad"} Jun 02 20:04:50.288408 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.288343 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" event={"ID":"ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b","Type":"ContainerStarted","Data":"666919deb04862691df439bb04c5d8d74650d31c30de12921873e735f15e40c5"} Jun 02 20:04:50.311314 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.311257 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mbfqd" podStartSLOduration=33.319771452 podStartE2EDuration="35.31123959s" podCreationTimestamp="2026-06-02 20:04:15 +0000 UTC" firstStartedPulling="2026-06-02 20:04:47.799239444 +0000 UTC m=+159.546022094" lastFinishedPulling="2026-06-02 20:04:49.790707588 +0000 UTC m=+161.537490232" observedRunningTime="2026-06-02 20:04:50.310030306 +0000 UTC m=+162.056812966" watchObservedRunningTime="2026-06-02 20:04:50.31123959 +0000 UTC m=+162.058022251" Jun 02 20:04:50.571871 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.571780 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:04:50.572059 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.571934 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:04:50.574449 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.574422 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cb902210-6e13-46bf-bc36-c3462adaffba-metrics-tls\") pod \"dns-default-6mgpm\" (UID: \"cb902210-6e13-46bf-bc36-c3462adaffba\") " pod="openshift-dns/dns-default-6mgpm" Jun 02 20:04:50.574825 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.574807 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8f74370-b367-4258-9da0-f00e35a438d9-cert\") pod \"ingress-canary-2qn84\" (UID: \"b8f74370-b367-4258-9da0-f00e35a438d9\") " pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:04:50.776927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.776897 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gclhs\"" Jun 02 20:04:50.784427 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.784378 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6mgpm" Jun 02 20:04:50.922856 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:50.922826 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6mgpm"] Jun 02 20:04:50.927429 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:04:50.927398 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb902210_6e13_46bf_bc36_c3462adaffba.slice/crio-acb95f06aa3235e11d50e074346fad7bb0c10463ea6cff576938bfdc5cfa4e91 WatchSource:0}: Error finding container acb95f06aa3235e11d50e074346fad7bb0c10463ea6cff576938bfdc5cfa4e91: Status 404 returned error can't find the container with id acb95f06aa3235e11d50e074346fad7bb0c10463ea6cff576938bfdc5cfa4e91 Jun 02 20:04:51.292180 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:51.292139 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6mgpm" event={"ID":"cb902210-6e13-46bf-bc36-c3462adaffba","Type":"ContainerStarted","Data":"acb95f06aa3235e11d50e074346fad7bb0c10463ea6cff576938bfdc5cfa4e91"} Jun 02 20:04:53.298858 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:53.298821 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6mgpm" event={"ID":"cb902210-6e13-46bf-bc36-c3462adaffba","Type":"ContainerStarted","Data":"b1cb806966fcaef112947776eb4970645123e4ed4f06f9841ec6ba225fb4d8de"} Jun 02 20:04:53.298858 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:53.298862 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6mgpm" event={"ID":"cb902210-6e13-46bf-bc36-c3462adaffba","Type":"ContainerStarted","Data":"013b6b1a500578b9df1f2578e39a50d409fcad1d45af1a2c0b517e4c3108aca0"} Jun 02 20:04:53.299239 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:53.298987 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6mgpm" Jun 02 20:04:53.324262 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:53.324220 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6mgpm" podStartSLOduration=129.939800291 podStartE2EDuration="2m11.324210309s" podCreationTimestamp="2026-06-02 20:02:42 +0000 UTC" firstStartedPulling="2026-06-02 20:04:50.929198826 +0000 UTC m=+162.675981461" lastFinishedPulling="2026-06-02 20:04:52.313608844 +0000 UTC m=+164.060391479" observedRunningTime="2026-06-02 20:04:53.322839809 +0000 UTC m=+165.069622466" watchObservedRunningTime="2026-06-02 20:04:53.324210309 +0000 UTC m=+165.070992965" Jun 02 20:04:56.818724 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:56.818625 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:04:56.821938 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:56.821902 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hqb8x\"" Jun 02 20:04:56.829466 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:56.829437 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2qn84" Jun 02 20:04:59.785435 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.785376 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt"] Jun 02 20:04:59.789750 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.789726 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.794414 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.793782 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 20:04:59.794414 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.794054 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 20:04:59.794414 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.794245 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 20:04:59.795184 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.795167 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 20:04:59.795410 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.795369 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt"] Jun 02 20:04:59.795630 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.795616 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6856p\"" Jun 02 20:04:59.815822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.814608 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4qq9h"] Jun 02 20:04:59.816888 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.816872 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.819701 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.819684 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 20:04:59.819860 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.819779 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 20:04:59.822212 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.822193 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gmdj2\"" Jun 02 20:04:59.822432 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.822417 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 20:04:59.843200 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.843148 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a510d05b-ad3e-4b3a-a78e-546fbb860d92-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.843307 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.843207 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dt26\" (UniqueName: \"kubernetes.io/projected/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-api-access-4dt26\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.843307 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.843245 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.843454 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.843329 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a510d05b-ad3e-4b3a-a78e-546fbb860d92-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.843454 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.843405 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.843565 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.843462 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.944798 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944595 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-sys\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.944798 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944649 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dt26\" (UniqueName: \"kubernetes.io/projected/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-api-access-4dt26\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.944798 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944689 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.944798 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944718 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-root\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.944798 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944773 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a510d05b-ad3e-4b3a-a78e-546fbb860d92-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.944798 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944801 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94316b4f-d751-464c-b1c1-522c396961ea-metrics-client-ca\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944831 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944881 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-tls\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944909 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.944970 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gldtb\" (UniqueName: \"kubernetes.io/projected/94316b4f-d751-464c-b1c1-522c396961ea-kube-api-access-gldtb\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.945011 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.945055 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a510d05b-ad3e-4b3a-a78e-546fbb860d92-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.945081 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-textfile\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.945113 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.945221 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.945142 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-wtmp\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:04:59.945715 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.945682 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a510d05b-ad3e-4b3a-a78e-546fbb860d92-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.946230 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.946211 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a510d05b-ad3e-4b3a-a78e-546fbb860d92-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.946466 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.946417 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.948177 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.948156 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.948274 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.948180 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:04:59.957926 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:04:59.957898 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dt26\" (UniqueName: \"kubernetes.io/projected/a510d05b-ad3e-4b3a-a78e-546fbb860d92-kube-api-access-4dt26\") pod \"kube-state-metrics-8469c486bb-2n8rt\" (UID: \"a510d05b-ad3e-4b3a-a78e-546fbb860d92\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:05:00.045822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.045669 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.045822 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.045718 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-wtmp\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.045843 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-sys\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.045865 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-wtmp\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.045908 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-root\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.045929 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-sys\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046009 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.045973 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94316b4f-d751-464c-b1c1-522c396961ea-root\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046260 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.045976 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94316b4f-d751-464c-b1c1-522c396961ea-metrics-client-ca\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046260 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.046070 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-tls\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046260 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.046099 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046260 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.046135 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gldtb\" (UniqueName: \"kubernetes.io/projected/94316b4f-d751-464c-b1c1-522c396961ea-kube-api-access-gldtb\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046260 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.046174 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-textfile\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046260 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:05:00.046208 2544 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 20:05:00.046594 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:05:00.046276 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-tls podName:94316b4f-d751-464c-b1c1-522c396961ea nodeName:}" failed. No retries permitted until 2026-06-02 20:05:00.546256144 +0000 UTC m=+172.293038794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-tls") pod "node-exporter-4qq9h" (UID: "94316b4f-d751-464c-b1c1-522c396961ea") : secret "node-exporter-tls" not found Jun 02 20:05:00.046594 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.046468 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-textfile\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046594 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.046521 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94316b4f-d751-464c-b1c1-522c396961ea-metrics-client-ca\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.046752 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.046650 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.048618 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.048582 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.063050 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.063026 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gldtb\" (UniqueName: \"kubernetes.io/projected/94316b4f-d751-464c-b1c1-522c396961ea-kube-api-access-gldtb\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.103839 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.103814 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" Jun 02 20:05:00.551670 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.551629 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-tls\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.553954 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.553930 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94316b4f-d751-464c-b1c1-522c396961ea-node-exporter-tls\") pod \"node-exporter-4qq9h\" (UID: \"94316b4f-d751-464c-b1c1-522c396961ea\") " pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.728256 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.728215 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4qq9h" Jun 02 20:05:00.854219 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.854143 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cf6ddb64b-2dtfj"] Jun 02 20:05:00.857447 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.857427 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:00.861767 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.861743 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 20:05:00.862474 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.862314 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 20:05:00.862474 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.862325 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zxf22\"" Jun 02 20:05:00.862474 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.862314 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 20:05:00.863032 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.863011 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 20:05:00.863436 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.863394 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 20:05:00.867764 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.867742 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 20:05:00.872761 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.872742 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf6ddb64b-2dtfj"] Jun 02 20:05:00.954786 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.954760 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-service-ca\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:00.954995 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.954811 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-serving-cert\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:00.954995 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.954951 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-trusted-ca-bundle\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:00.955126 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.955002 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-oauth-serving-cert\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:00.955126 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.955033 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps6vf\" (UniqueName: \"kubernetes.io/projected/6821e6ab-0864-4a22-83ef-5333e190ee0b-kube-api-access-ps6vf\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:00.955126 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.955060 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-config\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:00.955126 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:00.955090 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-oauth-config\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.012061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.012016 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:05:01.014764 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.014742 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.018645 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.018602 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 20:05:01.018782 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.018601 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 20:05:01.018782 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.018690 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 20:05:01.018782 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.018741 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mtfn5\"" Jun 02 20:05:01.019203 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.019049 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 20:05:01.019203 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.019069 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 20:05:01.019414 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.019335 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 20:05:01.019784 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.019547 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 20:05:01.019784 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.019570 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 20:05:01.019939 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.019926 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 20:05:01.038946 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.038921 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:05:01.056438 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056407 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.056550 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056463 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.056550 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056494 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-web-config\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.056550 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056521 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-service-ca\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.056550 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056539 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.056754 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056594 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.056754 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056634 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-serving-cert\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.056754 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056667 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sv4m\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-kube-api-access-4sv4m\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.056902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056764 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.056902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056841 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-trusted-ca-bundle\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.056902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056887 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.057041 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056926 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.057041 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056959 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.057041 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.056991 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-config-out\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.057041 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057029 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-oauth-serving-cert\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.057237 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057075 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ps6vf\" (UniqueName: \"kubernetes.io/projected/6821e6ab-0864-4a22-83ef-5333e190ee0b-kube-api-access-ps6vf\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.057237 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057102 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.057237 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057130 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.057237 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057156 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-config\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.057237 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057186 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-oauth-config\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.057237 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057231 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-service-ca\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.057872 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057653 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-oauth-serving-cert\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.058307 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.057965 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-trusted-ca-bundle\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.058367 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.058303 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-config\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.059605 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.059579 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-serving-cert\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.060462 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.060431 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-oauth-config\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.069181 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.069157 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps6vf\" (UniqueName: \"kubernetes.io/projected/6821e6ab-0864-4a22-83ef-5333e190ee0b-kube-api-access-ps6vf\") pod \"console-6cf6ddb64b-2dtfj\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.157858 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.157826 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158353 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158306 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sv4m\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-kube-api-access-4sv4m\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158496 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158437 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158557 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158499 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158557 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158537 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158659 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158577 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158659 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158614 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-config-out\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158760 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158657 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158760 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158688 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158760 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158729 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158903 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158769 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158903 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158800 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-web-config\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.158903 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.158835 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.161407 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.161352 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.161619 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.161598 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.162632 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.162608 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-config-out\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.168312 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.167367 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.168312 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.167699 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.168312 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.168093 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-config-volume\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.169010 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.168976 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.169180 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.169116 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-web-config\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.169180 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.169171 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.169418 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.169397 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:01.169575 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.169504 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.170503 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.170479 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.171590 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.171104 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.174673 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.174631 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sv4m\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-kube-api-access-4sv4m\") pod \"alertmanager-main-0\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.325599 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.325567 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:05:01.818635 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:01.818600 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:05:02.812451 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.812417 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68955fcbdf-c9zgd"] Jun 02 20:05:02.817315 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.817291 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.820274 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.820251 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xgc9m\"" Jun 02 20:05:02.821109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.820537 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 20:05:02.821109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.820723 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 20:05:02.821109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.820947 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 20:05:02.821109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.820956 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 20:05:02.821367 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.821148 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 20:05:02.821454 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.821412 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3b8sl5kqttbnh\"" Jun 02 20:05:02.828546 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.828524 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68955fcbdf-c9zgd"] Jun 02 20:05:02.875123 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.875090 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e6ef9f2-e46a-4538-9891-ce636e2581ef-metrics-client-ca\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.875303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.875174 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.875303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.875204 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t45jx\" (UniqueName: \"kubernetes.io/projected/6e6ef9f2-e46a-4538-9891-ce636e2581ef-kube-api-access-t45jx\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.875303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.875232 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.875303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.875269 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.875496 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.875313 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-grpc-tls\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.875496 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.875342 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-tls\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.875496 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.875442 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.976886 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.976838 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.977049 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.976914 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e6ef9f2-e46a-4538-9891-ce636e2581ef-metrics-client-ca\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.977049 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.976978 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.977049 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.977014 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t45jx\" (UniqueName: \"kubernetes.io/projected/6e6ef9f2-e46a-4538-9891-ce636e2581ef-kube-api-access-t45jx\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.977049 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.977043 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.977222 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.977075 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.977222 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.977127 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-grpc-tls\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.977222 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.977148 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-tls\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.978747 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.978314 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e6ef9f2-e46a-4538-9891-ce636e2581ef-metrics-client-ca\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.980258 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.980232 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.981653 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.981602 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-grpc-tls\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.981870 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.981844 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.982683 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.982641 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-tls\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.982883 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.982840 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.984398 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.984342 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e6ef9f2-e46a-4538-9891-ce636e2581ef-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:02.986870 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:02.986850 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t45jx\" (UniqueName: \"kubernetes.io/projected/6e6ef9f2-e46a-4538-9891-ce636e2581ef-kube-api-access-t45jx\") pod \"thanos-querier-68955fcbdf-c9zgd\" (UID: \"6e6ef9f2-e46a-4538-9891-ce636e2581ef\") " pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:03.129985 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:03.129882 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:03.226299 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:05:03.226264 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94316b4f_d751_464c_b1c1_522c396961ea.slice/crio-333384a08aec567181ad7d1f29092d57c2a55f3625c9df2b30df57e1f024f39b WatchSource:0}: Error finding container 333384a08aec567181ad7d1f29092d57c2a55f3625c9df2b30df57e1f024f39b: Status 404 returned error can't find the container with id 333384a08aec567181ad7d1f29092d57c2a55f3625c9df2b30df57e1f024f39b Jun 02 20:05:03.305641 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:03.304785 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6mgpm" Jun 02 20:05:03.336936 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:03.336329 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qq9h" event={"ID":"94316b4f-d751-464c-b1c1-522c396961ea","Type":"ContainerStarted","Data":"333384a08aec567181ad7d1f29092d57c2a55f3625c9df2b30df57e1f024f39b"} Jun 02 20:05:03.410641 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:03.410611 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cf6ddb64b-2dtfj"] Jun 02 20:05:03.413081 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:05:03.413052 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6821e6ab_0864_4a22_83ef_5333e190ee0b.slice/crio-34854bf85c5040c1d378c1784107327fe7e586c131b562d0fe7a28e4bf4482b7 WatchSource:0}: Error finding container 34854bf85c5040c1d378c1784107327fe7e586c131b562d0fe7a28e4bf4482b7: Status 404 returned error can't find the container with id 34854bf85c5040c1d378c1784107327fe7e586c131b562d0fe7a28e4bf4482b7 Jun 02 20:05:03.435567 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:03.435536 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:05:03.441132 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:05:03.441105 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f67269b_472d_460b_980f_b3ee243a9576.slice/crio-d9dd15b49a2c4ef02de1a2b57a88d355433d16d54a2c9e08e2524fe39f9b447f WatchSource:0}: Error finding container d9dd15b49a2c4ef02de1a2b57a88d355433d16d54a2c9e08e2524fe39f9b447f: Status 404 returned error can't find the container with id d9dd15b49a2c4ef02de1a2b57a88d355433d16d54a2c9e08e2524fe39f9b447f Jun 02 20:05:03.455425 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:03.455360 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68955fcbdf-c9zgd"] Jun 02 20:05:03.458036 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:05:03.458008 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6ef9f2_e46a_4538_9891_ce636e2581ef.slice/crio-32820161899e2b619d6f52baa91f56fb18dceff0e15414a2aa5909137d709c2f WatchSource:0}: Error finding container 32820161899e2b619d6f52baa91f56fb18dceff0e15414a2aa5909137d709c2f: Status 404 returned error can't find the container with id 32820161899e2b619d6f52baa91f56fb18dceff0e15414a2aa5909137d709c2f Jun 02 20:05:03.655877 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:03.655780 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2qn84"] Jun 02 20:05:03.659774 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:03.659726 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt"] Jun 02 20:05:03.660460 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:05:03.660158 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f74370_b367_4258_9da0_f00e35a438d9.slice/crio-9f3efa3d751e0a376c15a2e43ac27eb220e7dbeeec2bb940d12b4961f8aef6c7 WatchSource:0}: Error finding container 9f3efa3d751e0a376c15a2e43ac27eb220e7dbeeec2bb940d12b4961f8aef6c7: Status 404 returned error can't find the container with id 9f3efa3d751e0a376c15a2e43ac27eb220e7dbeeec2bb940d12b4961f8aef6c7 Jun 02 20:05:03.663450 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:05:03.663426 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda510d05b_ad3e_4b3a_a78e_546fbb860d92.slice/crio-32b40b777b789946a691dbef956d115639dc40ef06b871ee77fce823b4bc3bdc WatchSource:0}: Error finding container 32b40b777b789946a691dbef956d115639dc40ef06b871ee77fce823b4bc3bdc: Status 404 returned error can't find the container with id 32b40b777b789946a691dbef956d115639dc40ef06b871ee77fce823b4bc3bdc Jun 02 20:05:04.270956 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.270927 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f4987f89d-hsksw" Jun 02 20:05:04.351231 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.351187 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-4cw5q" event={"ID":"f30db05c-08a5-4abd-b2b5-2a8d4725737f","Type":"ContainerStarted","Data":"8506ed2a26020b41c27476625cbbd50f9927a2445bbe3346da774f9baf1a44db"} Jun 02 20:05:04.351825 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.351802 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-4cw5q" Jun 02 20:05:04.356400 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.356271 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-4cw5q" Jun 02 20:05:04.356595 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.356565 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" event={"ID":"a510d05b-ad3e-4b3a-a78e-546fbb860d92","Type":"ContainerStarted","Data":"32b40b777b789946a691dbef956d115639dc40ef06b871ee77fce823b4bc3bdc"} Jun 02 20:05:04.358197 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.358170 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerStarted","Data":"d9dd15b49a2c4ef02de1a2b57a88d355433d16d54a2c9e08e2524fe39f9b447f"} Jun 02 20:05:04.361891 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.361871 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2qn84" event={"ID":"b8f74370-b367-4258-9da0-f00e35a438d9","Type":"ContainerStarted","Data":"9f3efa3d751e0a376c15a2e43ac27eb220e7dbeeec2bb940d12b4961f8aef6c7"} Jun 02 20:05:04.365013 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.364987 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" event={"ID":"6e6ef9f2-e46a-4538-9891-ce636e2581ef","Type":"ContainerStarted","Data":"32820161899e2b619d6f52baa91f56fb18dceff0e15414a2aa5909137d709c2f"} Jun 02 20:05:04.366626 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.366602 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf6ddb64b-2dtfj" event={"ID":"6821e6ab-0864-4a22-83ef-5333e190ee0b","Type":"ContainerStarted","Data":"34854bf85c5040c1d378c1784107327fe7e586c131b562d0fe7a28e4bf4482b7"} Jun 02 20:05:04.376500 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.376372 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-4cw5q" podStartSLOduration=2.133820632 podStartE2EDuration="22.376355616s" podCreationTimestamp="2026-06-02 20:04:42 +0000 UTC" firstStartedPulling="2026-06-02 20:04:43.055279124 +0000 UTC m=+154.802061758" lastFinishedPulling="2026-06-02 20:05:03.297814089 +0000 UTC m=+175.044596742" observedRunningTime="2026-06-02 20:05:04.375361055 +0000 UTC m=+176.122143713" watchObservedRunningTime="2026-06-02 20:05:04.376355616 +0000 UTC m=+176.123138276" Jun 02 20:05:04.539847 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.528926 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7"] Jun 02 20:05:04.551794 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.541343 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7"] Jun 02 20:05:04.551794 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.541499 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" Jun 02 20:05:04.551794 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.545581 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 20:05:04.551794 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.545755 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-8drjq\"" Jun 02 20:05:04.599404 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.591814 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/805fd5ab-a364-4045-a1e9-34500f965e26-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-rg2n7\" (UID: \"805fd5ab-a364-4045-a1e9-34500f965e26\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" Jun 02 20:05:04.694217 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:04.693239 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/805fd5ab-a364-4045-a1e9-34500f965e26-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-rg2n7\" (UID: \"805fd5ab-a364-4045-a1e9-34500f965e26\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" Jun 02 20:05:04.694217 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:05:04.693504 2544 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 20:05:04.694217 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:05:04.693583 2544 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/805fd5ab-a364-4045-a1e9-34500f965e26-monitoring-plugin-cert podName:805fd5ab-a364-4045-a1e9-34500f965e26 nodeName:}" failed. No retries permitted until 2026-06-02 20:05:05.193561884 +0000 UTC m=+176.940344536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/805fd5ab-a364-4045-a1e9-34500f965e26-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-rg2n7" (UID: "805fd5ab-a364-4045-a1e9-34500f965e26") : secret "monitoring-plugin-cert" not found Jun 02 20:05:05.198574 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:05.198099 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/805fd5ab-a364-4045-a1e9-34500f965e26-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-rg2n7\" (UID: \"805fd5ab-a364-4045-a1e9-34500f965e26\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" Jun 02 20:05:05.201488 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:05.201433 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/805fd5ab-a364-4045-a1e9-34500f965e26-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-rg2n7\" (UID: \"805fd5ab-a364-4045-a1e9-34500f965e26\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" Jun 02 20:05:05.202401 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:05.202009 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" Jun 02 20:05:05.368230 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:05.368140 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7"] Jun 02 20:05:05.376038 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:05:05.375988 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805fd5ab_a364_4045_a1e9_34500f965e26.slice/crio-6f5a3df1d8419737eaf06b2cddb5d7c4aa844698a6a5a469e7367b94596d8131 WatchSource:0}: Error finding container 6f5a3df1d8419737eaf06b2cddb5d7c4aa844698a6a5a469e7367b94596d8131: Status 404 returned error can't find the container with id 6f5a3df1d8419737eaf06b2cddb5d7c4aa844698a6a5a469e7367b94596d8131 Jun 02 20:05:05.384909 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:05.383622 2544 generic.go:358] "Generic (PLEG): container finished" podID="94316b4f-d751-464c-b1c1-522c396961ea" containerID="4c2fb887f4ea4dde45a3a29cb0945677d0dd751510287fb09324f3886b9d2d5c" exitCode=0 Jun 02 20:05:05.384909 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:05.384665 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qq9h" event={"ID":"94316b4f-d751-464c-b1c1-522c396961ea","Type":"ContainerDied","Data":"4c2fb887f4ea4dde45a3a29cb0945677d0dd751510287fb09324f3886b9d2d5c"} Jun 02 20:05:06.392325 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.392071 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qq9h" event={"ID":"94316b4f-d751-464c-b1c1-522c396961ea","Type":"ContainerStarted","Data":"89eac5f8a541f4c454be07dbb043fe795024daa2666c8bae1825418fd51b2bc5"} Jun 02 20:05:06.399115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.399081 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" event={"ID":"805fd5ab-a364-4045-a1e9-34500f965e26","Type":"ContainerStarted","Data":"6f5a3df1d8419737eaf06b2cddb5d7c4aa844698a6a5a469e7367b94596d8131"} Jun 02 20:05:06.638189 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.638095 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf6ddb64b-2dtfj"] Jun 02 20:05:06.669574 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.669461 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-567b8cd498-rq66p"] Jun 02 20:05:06.690213 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.690189 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567b8cd498-rq66p"] Jun 02 20:05:06.690355 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.690325 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.819553 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.819431 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-console-config\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.819553 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.819477 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-oauth-serving-cert\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.819553 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.819525 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-service-ca\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.819878 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.819567 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-trusted-ca-bundle\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.819878 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.819623 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6gmq\" (UniqueName: \"kubernetes.io/projected/4767c190-aeb7-402c-9240-94d8b1460ac5-kube-api-access-w6gmq\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.819878 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.819653 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-serving-cert\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.819878 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.819709 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-oauth-config\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.920640 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.920554 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-oauth-config\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.920640 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.920621 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-console-config\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.920841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.920648 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-oauth-serving-cert\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.920841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.920698 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-service-ca\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.920841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.920746 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-trusted-ca-bundle\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.920841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.920800 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6gmq\" (UniqueName: \"kubernetes.io/projected/4767c190-aeb7-402c-9240-94d8b1460ac5-kube-api-access-w6gmq\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.920841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.920834 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-serving-cert\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.922038 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.922008 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-console-config\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.922567 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.922535 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-oauth-serving-cert\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.923299 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.923248 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-trusted-ca-bundle\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.924879 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.924850 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-service-ca\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.925969 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.925944 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-serving-cert\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.926797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.926735 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-oauth-config\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:06.935352 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:06.935309 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6gmq\" (UniqueName: \"kubernetes.io/projected/4767c190-aeb7-402c-9240-94d8b1460ac5-kube-api-access-w6gmq\") pod \"console-567b8cd498-rq66p\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:07.004587 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:07.004429 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:11.105750 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.105722 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567b8cd498-rq66p"] Jun 02 20:05:11.116849 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:05:11.116816 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4767c190_aeb7_402c_9240_94d8b1460ac5.slice/crio-f348b60bfcbcc2f830f0f35b5ccd5145fec525c09164a4fa684cb1144761fcdb WatchSource:0}: Error finding container f348b60bfcbcc2f830f0f35b5ccd5145fec525c09164a4fa684cb1144761fcdb: Status 404 returned error can't find the container with id f348b60bfcbcc2f830f0f35b5ccd5145fec525c09164a4fa684cb1144761fcdb Jun 02 20:05:11.416957 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.416924 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4qq9h" event={"ID":"94316b4f-d751-464c-b1c1-522c396961ea","Type":"ContainerStarted","Data":"332858cf78941ccc81a606d3bf5a97ea87cc12682c054a2896a17148691f015f"} Jun 02 20:05:11.419991 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.419635 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" event={"ID":"a510d05b-ad3e-4b3a-a78e-546fbb860d92","Type":"ContainerStarted","Data":"76c3eedddba01f00cd4dee112fdab50e04f73d7fddcbdd2bad4daac0e8be09fb"} Jun 02 20:05:11.419991 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.419668 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" event={"ID":"a510d05b-ad3e-4b3a-a78e-546fbb860d92","Type":"ContainerStarted","Data":"4197eef7e77971ee86f641cebc7a63b072a63c52ff486f9d8e7abed3c31f4080"} Jun 02 20:05:11.423593 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.422793 2544 generic.go:358] "Generic (PLEG): container finished" podID="8f67269b-472d-460b-980f-b3ee243a9576" containerID="d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009" exitCode=0 Jun 02 20:05:11.423593 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.422860 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerDied","Data":"d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009"} Jun 02 20:05:11.428748 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.428699 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2qn84" event={"ID":"b8f74370-b367-4258-9da0-f00e35a438d9","Type":"ContainerStarted","Data":"dbfecb15601a3820d78b22da2112521bc00b4062e9fbcee63c4deae9875b96cc"} Jun 02 20:05:11.430301 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.430220 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf6ddb64b-2dtfj" event={"ID":"6821e6ab-0864-4a22-83ef-5333e190ee0b","Type":"ContainerStarted","Data":"0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49"} Jun 02 20:05:11.431937 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.431892 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" event={"ID":"6e6ef9f2-e46a-4538-9891-ce636e2581ef","Type":"ContainerStarted","Data":"a8eef389a85aad5ba90b7f508b78cfcd59521c33a8e15f2c9277ab0021b571ce"} Jun 02 20:05:11.433298 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.433250 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567b8cd498-rq66p" event={"ID":"4767c190-aeb7-402c-9240-94d8b1460ac5","Type":"ContainerStarted","Data":"f348b60bfcbcc2f830f0f35b5ccd5145fec525c09164a4fa684cb1144761fcdb"} Jun 02 20:05:11.437401 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.437111 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4qq9h" podStartSLOduration=11.380325223 podStartE2EDuration="12.437096306s" podCreationTimestamp="2026-06-02 20:04:59 +0000 UTC" firstStartedPulling="2026-06-02 20:05:03.228262439 +0000 UTC m=+174.975045075" lastFinishedPulling="2026-06-02 20:05:04.285033523 +0000 UTC m=+176.031816158" observedRunningTime="2026-06-02 20:05:11.436220381 +0000 UTC m=+183.183003049" watchObservedRunningTime="2026-06-02 20:05:11.437096306 +0000 UTC m=+183.183878966" Jun 02 20:05:11.528476 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.526538 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2qn84" podStartSLOduration=142.25205053 podStartE2EDuration="2m29.526519442s" podCreationTimestamp="2026-06-02 20:02:42 +0000 UTC" firstStartedPulling="2026-06-02 20:05:03.662863026 +0000 UTC m=+175.409645674" lastFinishedPulling="2026-06-02 20:05:10.937331948 +0000 UTC m=+182.684114586" observedRunningTime="2026-06-02 20:05:11.525980212 +0000 UTC m=+183.272762870" watchObservedRunningTime="2026-06-02 20:05:11.526519442 +0000 UTC m=+183.273302099" Jun 02 20:05:11.528476 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:11.527783 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6cf6ddb64b-2dtfj" podStartSLOduration=4.005796352 podStartE2EDuration="11.52776966s" podCreationTimestamp="2026-06-02 20:05:00 +0000 UTC" firstStartedPulling="2026-06-02 20:05:03.415477193 +0000 UTC m=+175.162259828" lastFinishedPulling="2026-06-02 20:05:10.937450495 +0000 UTC m=+182.684233136" observedRunningTime="2026-06-02 20:05:11.498627709 +0000 UTC m=+183.245410367" watchObservedRunningTime="2026-06-02 20:05:11.52776966 +0000 UTC m=+183.274552322" Jun 02 20:05:12.440310 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.440270 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" event={"ID":"6e6ef9f2-e46a-4538-9891-ce636e2581ef","Type":"ContainerStarted","Data":"5fc8d041ff09c89cfcb44ada6ef58c0d19843c7e28b07bad3b3406e5e236f8a9"} Jun 02 20:05:12.440862 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.440321 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" event={"ID":"6e6ef9f2-e46a-4538-9891-ce636e2581ef","Type":"ContainerStarted","Data":"241f32c1428bd5920f0694c953afa38be51464a6b829d9492955191908329f2b"} Jun 02 20:05:12.442138 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.442111 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567b8cd498-rq66p" event={"ID":"4767c190-aeb7-402c-9240-94d8b1460ac5","Type":"ContainerStarted","Data":"f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633"} Jun 02 20:05:12.443901 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.443876 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" event={"ID":"805fd5ab-a364-4045-a1e9-34500f965e26","Type":"ContainerStarted","Data":"377291e8106879ac7ff367dfd65a802880076f3734a051598da5539b43fb62c4"} Jun 02 20:05:12.444098 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.444062 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" Jun 02 20:05:12.446151 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.446122 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" event={"ID":"a510d05b-ad3e-4b3a-a78e-546fbb860d92","Type":"ContainerStarted","Data":"30369d185cbabd57f172899ee8e0fbce241d2d3d1da59d7e111b5b1e578c9907"} Jun 02 20:05:12.449893 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.449876 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" Jun 02 20:05:12.465181 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.465139 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-567b8cd498-rq66p" podStartSLOduration=6.465127073 podStartE2EDuration="6.465127073s" podCreationTimestamp="2026-06-02 20:05:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:05:12.463530978 +0000 UTC m=+184.210313634" watchObservedRunningTime="2026-06-02 20:05:12.465127073 +0000 UTC m=+184.211909729" Jun 02 20:05:12.482634 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.482588 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-rg2n7" podStartSLOduration=2.56297655 podStartE2EDuration="8.482577259s" podCreationTimestamp="2026-06-02 20:05:04 +0000 UTC" firstStartedPulling="2026-06-02 20:05:05.382167631 +0000 UTC m=+177.128950278" lastFinishedPulling="2026-06-02 20:05:11.301768348 +0000 UTC m=+183.048550987" observedRunningTime="2026-06-02 20:05:12.480872387 +0000 UTC m=+184.227655046" watchObservedRunningTime="2026-06-02 20:05:12.482577259 +0000 UTC m=+184.229359916" Jun 02 20:05:12.503320 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:12.503272 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-2n8rt" podStartSLOduration=6.232413303 podStartE2EDuration="13.503258426s" podCreationTimestamp="2026-06-02 20:04:59 +0000 UTC" firstStartedPulling="2026-06-02 20:05:03.66604167 +0000 UTC m=+175.412824320" lastFinishedPulling="2026-06-02 20:05:10.936886801 +0000 UTC m=+182.683669443" observedRunningTime="2026-06-02 20:05:12.50148085 +0000 UTC m=+184.248263520" watchObservedRunningTime="2026-06-02 20:05:12.503258426 +0000 UTC m=+184.250041087" Jun 02 20:05:14.460477 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.457206 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" event={"ID":"6e6ef9f2-e46a-4538-9891-ce636e2581ef","Type":"ContainerStarted","Data":"c5de95d57239d9bfa2ea2785ed2a971d4634315301a9a49eeb8603d112f33f9d"} Jun 02 20:05:14.460477 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.457252 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" event={"ID":"6e6ef9f2-e46a-4538-9891-ce636e2581ef","Type":"ContainerStarted","Data":"1ba0ea2810c0c8e9aaf200d4bd1b518d8ed47cdc6e9670afd8beee888dc40001"} Jun 02 20:05:14.460477 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.457266 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" event={"ID":"6e6ef9f2-e46a-4538-9891-ce636e2581ef","Type":"ContainerStarted","Data":"57cea32f2a2a4946f14300061a0abea33cdc84e9e1e9663252b5cbfb040aadc2"} Jun 02 20:05:14.460477 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.458310 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:14.461731 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.461702 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerStarted","Data":"16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f"} Jun 02 20:05:14.461731 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.461731 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerStarted","Data":"6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e"} Jun 02 20:05:14.461913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.461742 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerStarted","Data":"b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f"} Jun 02 20:05:14.461913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.461750 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerStarted","Data":"4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8"} Jun 02 20:05:14.461913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.461758 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerStarted","Data":"c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689"} Jun 02 20:05:14.461913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.461765 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerStarted","Data":"f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937"} Jun 02 20:05:14.485422 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.485362 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" podStartSLOduration=2.546700265 podStartE2EDuration="12.485349554s" podCreationTimestamp="2026-06-02 20:05:02 +0000 UTC" firstStartedPulling="2026-06-02 20:05:03.459914893 +0000 UTC m=+175.206697529" lastFinishedPulling="2026-06-02 20:05:13.398564168 +0000 UTC m=+185.145346818" observedRunningTime="2026-06-02 20:05:14.483276129 +0000 UTC m=+186.230058798" watchObservedRunningTime="2026-06-02 20:05:14.485349554 +0000 UTC m=+186.232132261" Jun 02 20:05:14.512149 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:14.512111 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.177353113 podStartE2EDuration="14.512099947s" podCreationTimestamp="2026-06-02 20:05:00 +0000 UTC" firstStartedPulling="2026-06-02 20:05:03.443194992 +0000 UTC m=+175.189977630" lastFinishedPulling="2026-06-02 20:05:13.777941813 +0000 UTC m=+185.524724464" observedRunningTime="2026-06-02 20:05:14.510273513 +0000 UTC m=+186.257056182" watchObservedRunningTime="2026-06-02 20:05:14.512099947 +0000 UTC m=+186.258882603" Jun 02 20:05:16.472840 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:16.472812 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68955fcbdf-c9zgd" Jun 02 20:05:17.004988 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:17.004962 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:17.005137 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:17.005078 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:17.009755 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:17.009735 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:17.474401 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:17.474359 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:05:21.169901 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:21.169867 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:36.474613 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.474558 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6cf6ddb64b-2dtfj" podUID="6821e6ab-0864-4a22-83ef-5333e190ee0b" containerName="console" containerID="cri-o://0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49" gracePeriod=15 Jun 02 20:05:36.753485 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.753461 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cf6ddb64b-2dtfj_6821e6ab-0864-4a22-83ef-5333e190ee0b/console/0.log" Jun 02 20:05:36.753596 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.753541 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:36.773847 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.773821 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-config\") pod \"6821e6ab-0864-4a22-83ef-5333e190ee0b\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " Jun 02 20:05:36.773967 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.773858 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-oauth-config\") pod \"6821e6ab-0864-4a22-83ef-5333e190ee0b\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " Jun 02 20:05:36.773967 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.773878 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-trusted-ca-bundle\") pod \"6821e6ab-0864-4a22-83ef-5333e190ee0b\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " Jun 02 20:05:36.773967 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.773898 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-serving-cert\") pod \"6821e6ab-0864-4a22-83ef-5333e190ee0b\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " Jun 02 20:05:36.773967 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.773927 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps6vf\" (UniqueName: \"kubernetes.io/projected/6821e6ab-0864-4a22-83ef-5333e190ee0b-kube-api-access-ps6vf\") pod \"6821e6ab-0864-4a22-83ef-5333e190ee0b\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " Jun 02 20:05:36.773967 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.773962 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-oauth-serving-cert\") pod \"6821e6ab-0864-4a22-83ef-5333e190ee0b\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " Jun 02 20:05:36.774220 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.774003 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-service-ca\") pod \"6821e6ab-0864-4a22-83ef-5333e190ee0b\" (UID: \"6821e6ab-0864-4a22-83ef-5333e190ee0b\") " Jun 02 20:05:36.774735 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.774575 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-config" (OuterVolumeSpecName: "console-config") pod "6821e6ab-0864-4a22-83ef-5333e190ee0b" (UID: "6821e6ab-0864-4a22-83ef-5333e190ee0b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:05:36.774735 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.774579 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-service-ca" (OuterVolumeSpecName: "service-ca") pod "6821e6ab-0864-4a22-83ef-5333e190ee0b" (UID: "6821e6ab-0864-4a22-83ef-5333e190ee0b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:05:36.774735 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.774657 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6821e6ab-0864-4a22-83ef-5333e190ee0b" (UID: "6821e6ab-0864-4a22-83ef-5333e190ee0b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:05:36.774963 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.774835 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6821e6ab-0864-4a22-83ef-5333e190ee0b" (UID: "6821e6ab-0864-4a22-83ef-5333e190ee0b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:05:36.776439 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.776399 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6821e6ab-0864-4a22-83ef-5333e190ee0b" (UID: "6821e6ab-0864-4a22-83ef-5333e190ee0b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:05:36.776673 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.776645 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6821e6ab-0864-4a22-83ef-5333e190ee0b-kube-api-access-ps6vf" (OuterVolumeSpecName: "kube-api-access-ps6vf") pod "6821e6ab-0864-4a22-83ef-5333e190ee0b" (UID: "6821e6ab-0864-4a22-83ef-5333e190ee0b"). InnerVolumeSpecName "kube-api-access-ps6vf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:05:36.776753 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.776705 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6821e6ab-0864-4a22-83ef-5333e190ee0b" (UID: "6821e6ab-0864-4a22-83ef-5333e190ee0b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:05:36.875017 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.874993 2544 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:05:36.875017 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.875016 2544 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-oauth-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:05:36.875131 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.875026 2544 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-trusted-ca-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:05:36.875131 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.875036 2544 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6821e6ab-0864-4a22-83ef-5333e190ee0b-console-serving-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:05:36.875131 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.875045 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps6vf\" (UniqueName: \"kubernetes.io/projected/6821e6ab-0864-4a22-83ef-5333e190ee0b-kube-api-access-ps6vf\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:05:36.875131 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.875054 2544 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-oauth-serving-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:05:36.875131 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:36.875062 2544 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6821e6ab-0864-4a22-83ef-5333e190ee0b-service-ca\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:05:37.528493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.528463 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cf6ddb64b-2dtfj_6821e6ab-0864-4a22-83ef-5333e190ee0b/console/0.log" Jun 02 20:05:37.528896 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.528506 2544 generic.go:358] "Generic (PLEG): container finished" podID="6821e6ab-0864-4a22-83ef-5333e190ee0b" containerID="0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49" exitCode=2 Jun 02 20:05:37.528896 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.528544 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf6ddb64b-2dtfj" event={"ID":"6821e6ab-0864-4a22-83ef-5333e190ee0b","Type":"ContainerDied","Data":"0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49"} Jun 02 20:05:37.528896 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.528572 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cf6ddb64b-2dtfj" event={"ID":"6821e6ab-0864-4a22-83ef-5333e190ee0b","Type":"ContainerDied","Data":"34854bf85c5040c1d378c1784107327fe7e586c131b562d0fe7a28e4bf4482b7"} Jun 02 20:05:37.528896 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.528592 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cf6ddb64b-2dtfj" Jun 02 20:05:37.528896 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.528597 2544 scope.go:117] "RemoveContainer" containerID="0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49" Jun 02 20:05:37.536561 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.536541 2544 scope.go:117] "RemoveContainer" containerID="0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49" Jun 02 20:05:37.536802 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:05:37.536784 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49\": container with ID starting with 0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49 not found: ID does not exist" containerID="0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49" Jun 02 20:05:37.536847 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.536810 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49"} err="failed to get container status \"0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49\": rpc error: code = NotFound desc = could not find container \"0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49\": container with ID starting with 0a33695138a4705a5f0e8340c2bf0e4ba993200609f7842fcce86706fb596a49 not found: ID does not exist" Jun 02 20:05:37.546670 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.546639 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cf6ddb64b-2dtfj"] Jun 02 20:05:37.550963 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:37.550944 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cf6ddb64b-2dtfj"] Jun 02 20:05:38.823109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:38.823080 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6821e6ab-0864-4a22-83ef-5333e190ee0b" path="/var/lib/kubelet/pods/6821e6ab-0864-4a22-83ef-5333e190ee0b/volumes" Jun 02 20:05:40.540775 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:40.540748 2544 generic.go:358] "Generic (PLEG): container finished" podID="7adfe181-c23f-4d0b-bb13-d20112279078" containerID="e0344cbb81baf64f4218f0ea179893863659ea8a1060c1b4fee07d52a9d88b81" exitCode=0 Jun 02 20:05:40.541121 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:40.540821 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2dsqx" event={"ID":"7adfe181-c23f-4d0b-bb13-d20112279078","Type":"ContainerDied","Data":"e0344cbb81baf64f4218f0ea179893863659ea8a1060c1b4fee07d52a9d88b81"} Jun 02 20:05:40.541161 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:40.541119 2544 scope.go:117] "RemoveContainer" containerID="e0344cbb81baf64f4218f0ea179893863659ea8a1060c1b4fee07d52a9d88b81" Jun 02 20:05:41.544827 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:41.544798 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2dsqx" event={"ID":"7adfe181-c23f-4d0b-bb13-d20112279078","Type":"ContainerStarted","Data":"cd6d7f5d7a347c2e33c9c5be18550f9fd814ba3ed3d51896a9d0514b33f83dda"} Jun 02 20:05:45.555940 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:45.555908 2544 generic.go:358] "Generic (PLEG): container finished" podID="3f17c3fb-b66a-41e7-91ec-51331d17a999" containerID="56757b1eceb0339942449d3467e2fb3f2176d9ce3844f41c3fe22a27853a4012" exitCode=0 Jun 02 20:05:45.556342 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:45.555980 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" event={"ID":"3f17c3fb-b66a-41e7-91ec-51331d17a999","Type":"ContainerDied","Data":"56757b1eceb0339942449d3467e2fb3f2176d9ce3844f41c3fe22a27853a4012"} Jun 02 20:05:45.556342 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:45.556238 2544 scope.go:117] "RemoveContainer" containerID="56757b1eceb0339942449d3467e2fb3f2176d9ce3844f41c3fe22a27853a4012" Jun 02 20:05:46.560326 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:05:46.560273 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-stwds" event={"ID":"3f17c3fb-b66a-41e7-91ec-51331d17a999","Type":"ContainerStarted","Data":"3d8878ce828ec8edb1cbbecc00ee2f3b4a30d6464c54747398f1dfe9ec9232bf"} Jun 02 20:06:20.104841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.104810 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:06:20.105273 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.105227 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="alertmanager" containerID="cri-o://f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937" gracePeriod=120 Jun 02 20:06:20.105350 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.105289 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy-metric" containerID="cri-o://6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e" gracePeriod=120 Jun 02 20:06:20.105456 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.105338 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="prom-label-proxy" containerID="cri-o://16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f" gracePeriod=120 Jun 02 20:06:20.105456 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.105372 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="config-reloader" containerID="cri-o://c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689" gracePeriod=120 Jun 02 20:06:20.105558 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.105380 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy" containerID="cri-o://b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f" gracePeriod=120 Jun 02 20:06:20.105558 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.105379 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy-web" containerID="cri-o://4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8" gracePeriod=120 Jun 02 20:06:20.658542 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658512 2544 generic.go:358] "Generic (PLEG): container finished" podID="8f67269b-472d-460b-980f-b3ee243a9576" containerID="16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f" exitCode=0 Jun 02 20:06:20.658542 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658536 2544 generic.go:358] "Generic (PLEG): container finished" podID="8f67269b-472d-460b-980f-b3ee243a9576" containerID="6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e" exitCode=0 Jun 02 20:06:20.658542 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658543 2544 generic.go:358] "Generic (PLEG): container finished" podID="8f67269b-472d-460b-980f-b3ee243a9576" containerID="b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f" exitCode=0 Jun 02 20:06:20.658542 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658549 2544 generic.go:358] "Generic (PLEG): container finished" podID="8f67269b-472d-460b-980f-b3ee243a9576" containerID="c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689" exitCode=0 Jun 02 20:06:20.658801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658554 2544 generic.go:358] "Generic (PLEG): container finished" podID="8f67269b-472d-460b-980f-b3ee243a9576" containerID="f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937" exitCode=0 Jun 02 20:06:20.658801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658585 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerDied","Data":"16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f"} Jun 02 20:06:20.658801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658620 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerDied","Data":"6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e"} Jun 02 20:06:20.658801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658630 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerDied","Data":"b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f"} Jun 02 20:06:20.658801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658639 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerDied","Data":"c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689"} Jun 02 20:06:20.658801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.658649 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerDied","Data":"f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937"} Jun 02 20:06:20.709138 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.709078 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:06:20.711486 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.711457 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0-metrics-certs\") pod \"network-metrics-daemon-jscwj\" (UID: \"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0\") " pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:06:20.723084 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.723064 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s8fv6\"" Jun 02 20:06:20.730156 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.730142 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jscwj" Jun 02 20:06:20.854866 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:20.854838 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jscwj"] Jun 02 20:06:20.857892 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:06:20.857866 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f8f571_d7ea_40ac_b14b_5fda6b6d95a0.slice/crio-904606bef2070031adf5aed606c4c55b59159e702a6b23349b9461f9500ca06d WatchSource:0}: Error finding container 904606bef2070031adf5aed606c4c55b59159e702a6b23349b9461f9500ca06d: Status 404 returned error can't find the container with id 904606bef2070031adf5aed606c4c55b59159e702a6b23349b9461f9500ca06d Jun 02 20:06:21.368329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.368300 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.516708 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516621 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.516708 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516680 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-metrics-client-ca\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.516950 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516742 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-config-out\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.516950 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516781 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-config-volume\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.516950 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516809 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sv4m\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-kube-api-access-4sv4m\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.516950 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516838 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.516950 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516870 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-tls-assets\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.516950 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516933 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-main-tls\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.517256 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516956 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-cluster-tls-config\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.517256 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516975 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-main-db\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.517256 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.516992 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-web\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.517256 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.517013 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-web-config\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.517256 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.517046 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-trusted-ca-bundle\") pod \"8f67269b-472d-460b-980f-b3ee243a9576\" (UID: \"8f67269b-472d-460b-980f-b3ee243a9576\") " Jun 02 20:06:21.517256 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.517173 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:06:21.517947 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.517318 2544 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-metrics-client-ca\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.517947 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.517563 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:06:21.517947 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.517575 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:06:21.519763 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.519666 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:06:21.521213 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.521187 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:06:21.521425 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.521367 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:06:21.521528 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.521508 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-config-out" (OuterVolumeSpecName: "config-out") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:06:21.521610 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.521590 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:06:21.521728 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.521644 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:06:21.522081 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.522052 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-kube-api-access-4sv4m" (OuterVolumeSpecName: "kube-api-access-4sv4m") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "kube-api-access-4sv4m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:06:21.523360 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.523336 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-config-volume" (OuterVolumeSpecName: "config-volume") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:06:21.527144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.527078 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:06:21.534281 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.534247 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-web-config" (OuterVolumeSpecName: "web-config") pod "8f67269b-472d-460b-980f-b3ee243a9576" (UID: "8f67269b-472d-460b-980f-b3ee243a9576"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:06:21.618704 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618667 2544 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618704 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618698 2544 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-config-out\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618704 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618707 2544 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-config-volume\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618704 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618718 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sv4m\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-kube-api-access-4sv4m\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618728 2544 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618737 2544 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8f67269b-472d-460b-980f-b3ee243a9576-tls-assets\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618746 2544 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-main-tls\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618755 2544 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-cluster-tls-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618765 2544 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-main-db\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618776 2544 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618785 2544 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8f67269b-472d-460b-980f-b3ee243a9576-web-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.618955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.618793 2544 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f67269b-472d-460b-980f-b3ee243a9576-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:06:21.662676 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.662629 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jscwj" event={"ID":"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0","Type":"ContainerStarted","Data":"904606bef2070031adf5aed606c4c55b59159e702a6b23349b9461f9500ca06d"} Jun 02 20:06:21.665725 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.665694 2544 generic.go:358] "Generic (PLEG): container finished" podID="8f67269b-472d-460b-980f-b3ee243a9576" containerID="4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8" exitCode=0 Jun 02 20:06:21.665851 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.665783 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerDied","Data":"4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8"} Jun 02 20:06:21.665851 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.665823 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8f67269b-472d-460b-980f-b3ee243a9576","Type":"ContainerDied","Data":"d9dd15b49a2c4ef02de1a2b57a88d355433d16d54a2c9e08e2524fe39f9b447f"} Jun 02 20:06:21.665851 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.665822 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.665851 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.665839 2544 scope.go:117] "RemoveContainer" containerID="16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f" Jun 02 20:06:21.675143 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.675121 2544 scope.go:117] "RemoveContainer" containerID="6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e" Jun 02 20:06:21.682223 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.682205 2544 scope.go:117] "RemoveContainer" containerID="b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f" Jun 02 20:06:21.690717 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.690693 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:06:21.696579 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.696548 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:06:21.724521 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724492 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:06:21.724849 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724832 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6821e6ab-0864-4a22-83ef-5333e190ee0b" containerName="console" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724852 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="6821e6ab-0864-4a22-83ef-5333e190ee0b" containerName="console" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724868 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="alertmanager" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724877 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="alertmanager" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724892 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="init-config-reloader" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724898 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="init-config-reloader" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724909 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="config-reloader" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724917 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="config-reloader" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724925 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy-metric" Jun 02 20:06:21.724927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724931 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy-metric" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724937 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy-web" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724943 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy-web" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724951 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="prom-label-proxy" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724956 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="prom-label-proxy" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724966 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.724974 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.725043 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy-metric" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.725055 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="prom-label-proxy" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.725065 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="config-reloader" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.725076 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy-web" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.725086 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="alertmanager" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.725092 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="6821e6ab-0864-4a22-83ef-5333e190ee0b" containerName="console" Jun 02 20:06:21.725354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.725098 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f67269b-472d-460b-980f-b3ee243a9576" containerName="kube-rbac-proxy" Jun 02 20:06:21.728664 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.728645 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.731839 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.731819 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 20:06:21.732422 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.732402 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 20:06:21.732677 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.732657 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 20:06:21.732777 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.732684 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 20:06:21.732777 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.732695 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mtfn5\"" Jun 02 20:06:21.732777 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.732735 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 20:06:21.732926 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.732686 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 20:06:21.733117 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.733100 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 20:06:21.733269 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.733102 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 20:06:21.740865 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.740843 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 20:06:21.743001 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.742980 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:06:21.820347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820271 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820332 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820588 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820361 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5c08ecb-c002-4680-941a-92e0c6429a0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820588 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820436 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5c08ecb-c002-4680-941a-92e0c6429a0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820588 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820467 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxvkz\" (UniqueName: \"kubernetes.io/projected/a5c08ecb-c002-4680-941a-92e0c6429a0c-kube-api-access-vxvkz\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820588 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820493 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820588 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820517 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5c08ecb-c002-4680-941a-92e0c6429a0c-config-out\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820588 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820547 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820588 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820579 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5c08ecb-c002-4680-941a-92e0c6429a0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820853 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820605 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820853 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820628 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-web-config\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820853 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820646 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5c08ecb-c002-4680-941a-92e0c6429a0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.820853 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.820672 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922024 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5c08ecb-c002-4680-941a-92e0c6429a0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922238 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922079 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxvkz\" (UniqueName: \"kubernetes.io/projected/a5c08ecb-c002-4680-941a-92e0c6429a0c-kube-api-access-vxvkz\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922238 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922117 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922238 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922141 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5c08ecb-c002-4680-941a-92e0c6429a0c-config-out\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922238 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922169 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922238 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922203 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5c08ecb-c002-4680-941a-92e0c6429a0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922247 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922289 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-web-config\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922316 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5c08ecb-c002-4680-941a-92e0c6429a0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922349 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922416 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922448 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922476 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5c08ecb-c002-4680-941a-92e0c6429a0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922833 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922704 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a5c08ecb-c002-4680-941a-92e0c6429a0c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.922833 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.922810 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5c08ecb-c002-4680-941a-92e0c6429a0c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.923541 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.923187 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5c08ecb-c002-4680-941a-92e0c6429a0c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.925060 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.925029 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5c08ecb-c002-4680-941a-92e0c6429a0c-config-out\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.925296 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.925273 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5c08ecb-c002-4680-941a-92e0c6429a0c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.925400 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.925284 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.925514 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.925490 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.925630 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.925577 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-web-config\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.925696 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.925671 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.925696 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.925682 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.926153 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.926133 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.926979 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.926959 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a5c08ecb-c002-4680-941a-92e0c6429a0c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.930516 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.930497 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxvkz\" (UniqueName: \"kubernetes.io/projected/a5c08ecb-c002-4680-941a-92e0c6429a0c-kube-api-access-vxvkz\") pod \"alertmanager-main-0\" (UID: \"a5c08ecb-c002-4680-941a-92e0c6429a0c\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:21.931873 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.931858 2544 scope.go:117] "RemoveContainer" containerID="4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8" Jun 02 20:06:21.938468 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.938450 2544 scope.go:117] "RemoveContainer" containerID="c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689" Jun 02 20:06:21.944749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.944734 2544 scope.go:117] "RemoveContainer" containerID="f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937" Jun 02 20:06:21.966061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.966043 2544 scope.go:117] "RemoveContainer" containerID="d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009" Jun 02 20:06:21.972400 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.972370 2544 scope.go:117] "RemoveContainer" containerID="16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f" Jun 02 20:06:21.972635 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:06:21.972620 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f\": container with ID starting with 16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f not found: ID does not exist" containerID="16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f" Jun 02 20:06:21.972686 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.972643 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f"} err="failed to get container status \"16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f\": rpc error: code = NotFound desc = could not find container \"16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f\": container with ID starting with 16d95d0d47dfc66ba482450489aff5e1d946d57ac6a56991abd3a62df461767f not found: ID does not exist" Jun 02 20:06:21.972686 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.972660 2544 scope.go:117] "RemoveContainer" containerID="6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e" Jun 02 20:06:21.972893 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:06:21.972879 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e\": container with ID starting with 6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e not found: ID does not exist" containerID="6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e" Jun 02 20:06:21.972949 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.972896 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e"} err="failed to get container status \"6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e\": rpc error: code = NotFound desc = could not find container \"6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e\": container with ID starting with 6b9d35c75e7e103eb9cdb763b0540ddc08abd88dbfe63b1bbb4bdba3fb7d647e not found: ID does not exist" Jun 02 20:06:21.972949 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.972908 2544 scope.go:117] "RemoveContainer" containerID="b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f" Jun 02 20:06:21.973145 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:06:21.973126 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f\": container with ID starting with b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f not found: ID does not exist" containerID="b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f" Jun 02 20:06:21.973191 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.973150 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f"} err="failed to get container status \"b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f\": rpc error: code = NotFound desc = could not find container \"b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f\": container with ID starting with b9af5a308f3514f28353cc8065e38ac82e0d8ac28023181c5491f95d9934e51f not found: ID does not exist" Jun 02 20:06:21.973191 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.973170 2544 scope.go:117] "RemoveContainer" containerID="4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8" Jun 02 20:06:21.973429 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:06:21.973414 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8\": container with ID starting with 4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8 not found: ID does not exist" containerID="4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8" Jun 02 20:06:21.973477 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.973433 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8"} err="failed to get container status \"4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8\": rpc error: code = NotFound desc = could not find container \"4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8\": container with ID starting with 4bdeca913cde8d80e130b3a6db796796a0e22f4c8db70cf3be07f4a6f412c7e8 not found: ID does not exist" Jun 02 20:06:21.973477 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.973449 2544 scope.go:117] "RemoveContainer" containerID="c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689" Jun 02 20:06:21.973663 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:06:21.973649 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689\": container with ID starting with c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689 not found: ID does not exist" containerID="c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689" Jun 02 20:06:21.973698 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.973666 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689"} err="failed to get container status \"c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689\": rpc error: code = NotFound desc = could not find container \"c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689\": container with ID starting with c17c2d1f4becc365912744d1ff6b2c427d3d01986bc7addf0c0705031548c689 not found: ID does not exist" Jun 02 20:06:21.973698 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.973677 2544 scope.go:117] "RemoveContainer" containerID="f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937" Jun 02 20:06:21.973872 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:06:21.973852 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937\": container with ID starting with f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937 not found: ID does not exist" containerID="f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937" Jun 02 20:06:21.973913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.973875 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937"} err="failed to get container status \"f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937\": rpc error: code = NotFound desc = could not find container \"f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937\": container with ID starting with f9d290cc5a2ffbebb274a4866b48b02ea7d55e8f97703f634c94ffcee1f33937 not found: ID does not exist" Jun 02 20:06:21.973913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.973891 2544 scope.go:117] "RemoveContainer" containerID="d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009" Jun 02 20:06:21.974127 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:06:21.974099 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009\": container with ID starting with d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009 not found: ID does not exist" containerID="d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009" Jun 02 20:06:21.974164 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:21.974138 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009"} err="failed to get container status \"d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009\": rpc error: code = NotFound desc = could not find container \"d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009\": container with ID starting with d96b86d1f2167ed437e62e42583bb7d028d1902b58bd5fb859ec51d38ae42009 not found: ID does not exist" Jun 02 20:06:22.039905 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.039882 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 20:06:22.198287 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.198260 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 20:06:22.200357 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:06:22.200331 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c08ecb_c002_4680_941a_92e0c6429a0c.slice/crio-937d2f7220078bacd1404e0aaf1ea359a823d1acb587fc70025c83937a60e6d4 WatchSource:0}: Error finding container 937d2f7220078bacd1404e0aaf1ea359a823d1acb587fc70025c83937a60e6d4: Status 404 returned error can't find the container with id 937d2f7220078bacd1404e0aaf1ea359a823d1acb587fc70025c83937a60e6d4 Jun 02 20:06:22.670927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.670887 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jscwj" event={"ID":"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0","Type":"ContainerStarted","Data":"4346c00a291d55834dca6183900c53315c4f7efc64ce756b8b0df05c1d182d08"} Jun 02 20:06:22.670927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.670931 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jscwj" event={"ID":"c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0","Type":"ContainerStarted","Data":"4479cc36a0d8798eb9fa9237287ee833a8c53b6fbd505a2295455a79df9eb086"} Jun 02 20:06:22.672175 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.672153 2544 generic.go:358] "Generic (PLEG): container finished" podID="a5c08ecb-c002-4680-941a-92e0c6429a0c" containerID="3afbe3f2c9e5c839d360004e02575b9c0ba6116850f29edadcedad05781a291d" exitCode=0 Jun 02 20:06:22.672244 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.672221 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5c08ecb-c002-4680-941a-92e0c6429a0c","Type":"ContainerDied","Data":"3afbe3f2c9e5c839d360004e02575b9c0ba6116850f29edadcedad05781a291d"} Jun 02 20:06:22.672304 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.672254 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5c08ecb-c002-4680-941a-92e0c6429a0c","Type":"ContainerStarted","Data":"937d2f7220078bacd1404e0aaf1ea359a823d1acb587fc70025c83937a60e6d4"} Jun 02 20:06:22.690123 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.690088 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jscwj" podStartSLOduration=253.575822964 podStartE2EDuration="4m14.690077283s" podCreationTimestamp="2026-06-02 20:02:08 +0000 UTC" firstStartedPulling="2026-06-02 20:06:20.859660892 +0000 UTC m=+252.606443526" lastFinishedPulling="2026-06-02 20:06:21.973915198 +0000 UTC m=+253.720697845" observedRunningTime="2026-06-02 20:06:22.689603184 +0000 UTC m=+254.436385842" watchObservedRunningTime="2026-06-02 20:06:22.690077283 +0000 UTC m=+254.436859939" Jun 02 20:06:22.824047 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:22.824011 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f67269b-472d-460b-980f-b3ee243a9576" path="/var/lib/kubelet/pods/8f67269b-472d-460b-980f-b3ee243a9576/volumes" Jun 02 20:06:23.681348 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:23.681305 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5c08ecb-c002-4680-941a-92e0c6429a0c","Type":"ContainerStarted","Data":"353bc0cec71b1b6d5ada94dc4bc456914ee11e83a3f93b215dfaa2a4d7b1471f"} Jun 02 20:06:23.681348 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:23.681345 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5c08ecb-c002-4680-941a-92e0c6429a0c","Type":"ContainerStarted","Data":"6530b0dddd5932339d3cbb68a332ab935eabdfc975aa5d0655288230f0f9fc5e"} Jun 02 20:06:23.681348 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:23.681354 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5c08ecb-c002-4680-941a-92e0c6429a0c","Type":"ContainerStarted","Data":"2e51841929a6ca717624168690eed71adbe881be67b8d0347851b3be3b13431f"} Jun 02 20:06:23.681907 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:23.681365 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5c08ecb-c002-4680-941a-92e0c6429a0c","Type":"ContainerStarted","Data":"e9479d41aa08a91c17ddaa8de45d6ab6ada4e4d78f8f9b41b29b44c2d34f0a09"} Jun 02 20:06:23.681907 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:23.681374 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5c08ecb-c002-4680-941a-92e0c6429a0c","Type":"ContainerStarted","Data":"7cdadf7048d839b682d24e2073304630f6e74860dcbbf15269fec1744b30a387"} Jun 02 20:06:23.681907 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:23.681394 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a5c08ecb-c002-4680-941a-92e0c6429a0c","Type":"ContainerStarted","Data":"2113fe456debc93acab888a0b071ea106fffbe36fedad486dd271c5c3ff2d16b"} Jun 02 20:06:23.711134 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:23.711071 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.711053143 podStartE2EDuration="2.711053143s" podCreationTimestamp="2026-06-02 20:06:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:06:23.710539495 +0000 UTC m=+255.457322162" watchObservedRunningTime="2026-06-02 20:06:23.711053143 +0000 UTC m=+255.457835804" Jun 02 20:06:24.133514 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.133434 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8599f68b46-nmghx"] Jun 02 20:06:24.136117 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.136097 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.139206 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.139186 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 20:06:24.139206 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.139186 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 20:06:24.139486 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.139470 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-97cjz\"" Jun 02 20:06:24.139574 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.139509 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 20:06:24.139742 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.139723 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 20:06:24.140624 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.140600 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 20:06:24.150149 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.150119 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 20:06:24.151368 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.151346 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8599f68b46-nmghx"] Jun 02 20:06:24.244799 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.244760 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.244799 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.244803 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-metrics-client-ca\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.245042 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.244826 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.245042 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.244861 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-secret-telemeter-client\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.245042 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.244875 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-federate-client-tls\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.245042 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.244969 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-serving-certs-ca-bundle\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.245042 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.245007 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-telemeter-client-tls\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.245042 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.245033 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9274w\" (UniqueName: \"kubernetes.io/projected/b05a5386-d374-40a9-8f5b-b89039768dfa-kube-api-access-9274w\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.346462 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.346412 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.346632 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.346489 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-metrics-client-ca\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.346632 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.346523 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.346632 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.346608 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-secret-telemeter-client\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.346787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.346738 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-federate-client-tls\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.346864 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.346833 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-serving-certs-ca-bundle\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.346921 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.346879 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-telemeter-client-tls\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.346921 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.346912 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9274w\" (UniqueName: \"kubernetes.io/projected/b05a5386-d374-40a9-8f5b-b89039768dfa-kube-api-access-9274w\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.347329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.347246 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-metrics-client-ca\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.347460 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.347432 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.347835 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.347803 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b05a5386-d374-40a9-8f5b-b89039768dfa-serving-certs-ca-bundle\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.349165 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.349144 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-secret-telemeter-client\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.349302 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.349281 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.349638 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.349620 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-federate-client-tls\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.349793 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.349773 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b05a5386-d374-40a9-8f5b-b89039768dfa-telemeter-client-tls\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.355340 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.355317 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9274w\" (UniqueName: \"kubernetes.io/projected/b05a5386-d374-40a9-8f5b-b89039768dfa-kube-api-access-9274w\") pod \"telemeter-client-8599f68b46-nmghx\" (UID: \"b05a5386-d374-40a9-8f5b-b89039768dfa\") " pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.448160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.448125 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" Jun 02 20:06:24.574018 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.573989 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8599f68b46-nmghx"] Jun 02 20:06:24.578211 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:06:24.578178 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05a5386_d374_40a9_8f5b_b89039768dfa.slice/crio-2bde6c9f71b996bf6c4cbf246854a819f320281f5fa0d5c601d4d6a6fc71cfed WatchSource:0}: Error finding container 2bde6c9f71b996bf6c4cbf246854a819f320281f5fa0d5c601d4d6a6fc71cfed: Status 404 returned error can't find the container with id 2bde6c9f71b996bf6c4cbf246854a819f320281f5fa0d5c601d4d6a6fc71cfed Jun 02 20:06:24.686426 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:24.686368 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" event={"ID":"b05a5386-d374-40a9-8f5b-b89039768dfa","Type":"ContainerStarted","Data":"2bde6c9f71b996bf6c4cbf246854a819f320281f5fa0d5c601d4d6a6fc71cfed"} Jun 02 20:06:27.696703 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:27.696668 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" event={"ID":"b05a5386-d374-40a9-8f5b-b89039768dfa","Type":"ContainerStarted","Data":"2495d638922c180c9685c57b8d641d32993fc3465f2860b253a4c62e2ce475c2"} Jun 02 20:06:27.696703 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:27.696705 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" event={"ID":"b05a5386-d374-40a9-8f5b-b89039768dfa","Type":"ContainerStarted","Data":"2d71e1fee9f62e51cf27f18a637c9686f5f52ca4663de21deed0b071c3c0f198"} Jun 02 20:06:27.697112 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:27.696715 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" event={"ID":"b05a5386-d374-40a9-8f5b-b89039768dfa","Type":"ContainerStarted","Data":"415ebe2a18612182faa956f0aee1f34a0c24227e5824a0a079f93f3ec4d9c8c1"} Jun 02 20:06:27.721200 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:27.721146 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8599f68b46-nmghx" podStartSLOduration=1.404507895 podStartE2EDuration="3.721130264s" podCreationTimestamp="2026-06-02 20:06:24 +0000 UTC" firstStartedPulling="2026-06-02 20:06:24.580118674 +0000 UTC m=+256.326901323" lastFinishedPulling="2026-06-02 20:06:26.896741054 +0000 UTC m=+258.643523692" observedRunningTime="2026-06-02 20:06:27.719550352 +0000 UTC m=+259.466333008" watchObservedRunningTime="2026-06-02 20:06:27.721130264 +0000 UTC m=+259.467912922" Jun 02 20:06:28.484245 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.484203 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-849b54fccc-wtgft"] Jun 02 20:06:28.486993 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.486973 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.498021 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.497998 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849b54fccc-wtgft"] Jun 02 20:06:28.585903 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.585877 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-serving-cert\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.586044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.585913 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-service-ca\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.586044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.585936 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-oauth-config\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.586044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.585952 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-trusted-ca-bundle\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.586044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.585970 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-oauth-serving-cert\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.586044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.585985 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-console-config\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.586044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.585999 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8rzx\" (UniqueName: \"kubernetes.io/projected/a42b1026-26fa-4506-a29b-1b7003dd3752-kube-api-access-h8rzx\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.686807 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.686775 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-serving-cert\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.686958 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.686816 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-service-ca\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.686958 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.686850 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-oauth-config\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.686958 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.686876 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-trusted-ca-bundle\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.686958 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.686903 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-oauth-serving-cert\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.686958 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.686928 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-console-config\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.686958 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.686952 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8rzx\" (UniqueName: \"kubernetes.io/projected/a42b1026-26fa-4506-a29b-1b7003dd3752-kube-api-access-h8rzx\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.687630 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.687602 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-service-ca\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.687630 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.687615 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-oauth-serving-cert\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.687809 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.687712 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-trusted-ca-bundle\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.687847 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.687804 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-console-config\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.689318 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.689296 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-serving-cert\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.689428 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.689327 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-oauth-config\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.695459 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.695439 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8rzx\" (UniqueName: \"kubernetes.io/projected/a42b1026-26fa-4506-a29b-1b7003dd3752-kube-api-access-h8rzx\") pod \"console-849b54fccc-wtgft\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.795951 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.795860 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:28.940239 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:28.940217 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849b54fccc-wtgft"] Jun 02 20:06:28.942893 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:06:28.942864 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42b1026_26fa_4506_a29b_1b7003dd3752.slice/crio-d021f67a35736ce5ebf23f7e653d5fcfa50dee0d5fca71a568e97e4e771e5a9a WatchSource:0}: Error finding container d021f67a35736ce5ebf23f7e653d5fcfa50dee0d5fca71a568e97e4e771e5a9a: Status 404 returned error can't find the container with id d021f67a35736ce5ebf23f7e653d5fcfa50dee0d5fca71a568e97e4e771e5a9a Jun 02 20:06:29.704022 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:29.703985 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849b54fccc-wtgft" event={"ID":"a42b1026-26fa-4506-a29b-1b7003dd3752","Type":"ContainerStarted","Data":"bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97"} Jun 02 20:06:29.704022 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:29.704022 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849b54fccc-wtgft" event={"ID":"a42b1026-26fa-4506-a29b-1b7003dd3752","Type":"ContainerStarted","Data":"d021f67a35736ce5ebf23f7e653d5fcfa50dee0d5fca71a568e97e4e771e5a9a"} Jun 02 20:06:29.725583 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:29.725535 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-849b54fccc-wtgft" podStartSLOduration=1.725518463 podStartE2EDuration="1.725518463s" podCreationTimestamp="2026-06-02 20:06:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:06:29.723948874 +0000 UTC m=+261.470731533" watchObservedRunningTime="2026-06-02 20:06:29.725518463 +0000 UTC m=+261.472301126" Jun 02 20:06:38.795964 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:38.795932 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:38.795964 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:38.795969 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:38.801174 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:38.801152 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:39.739466 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:39.739440 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:06:39.791443 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:06:39.791409 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567b8cd498-rq66p"] Jun 02 20:07:04.812431 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:04.812356 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-567b8cd498-rq66p" podUID="4767c190-aeb7-402c-9240-94d8b1460ac5" containerName="console" containerID="cri-o://f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633" gracePeriod=15 Jun 02 20:07:05.050075 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.050054 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-567b8cd498-rq66p_4767c190-aeb7-402c-9240-94d8b1460ac5/console/0.log" Jun 02 20:07:05.050180 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.050112 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:07:05.191515 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.191490 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6gmq\" (UniqueName: \"kubernetes.io/projected/4767c190-aeb7-402c-9240-94d8b1460ac5-kube-api-access-w6gmq\") pod \"4767c190-aeb7-402c-9240-94d8b1460ac5\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " Jun 02 20:07:05.191653 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.191537 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-oauth-serving-cert\") pod \"4767c190-aeb7-402c-9240-94d8b1460ac5\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " Jun 02 20:07:05.191653 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.191560 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-oauth-config\") pod \"4767c190-aeb7-402c-9240-94d8b1460ac5\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " Jun 02 20:07:05.191776 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.191672 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-trusted-ca-bundle\") pod \"4767c190-aeb7-402c-9240-94d8b1460ac5\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " Jun 02 20:07:05.191776 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.191703 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-serving-cert\") pod \"4767c190-aeb7-402c-9240-94d8b1460ac5\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " Jun 02 20:07:05.191776 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.191734 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-console-config\") pod \"4767c190-aeb7-402c-9240-94d8b1460ac5\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " Jun 02 20:07:05.191776 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.191761 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-service-ca\") pod \"4767c190-aeb7-402c-9240-94d8b1460ac5\" (UID: \"4767c190-aeb7-402c-9240-94d8b1460ac5\") " Jun 02 20:07:05.192076 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.192029 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4767c190-aeb7-402c-9240-94d8b1460ac5" (UID: "4767c190-aeb7-402c-9240-94d8b1460ac5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:07:05.192076 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.192036 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4767c190-aeb7-402c-9240-94d8b1460ac5" (UID: "4767c190-aeb7-402c-9240-94d8b1460ac5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:07:05.192249 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.192220 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-service-ca" (OuterVolumeSpecName: "service-ca") pod "4767c190-aeb7-402c-9240-94d8b1460ac5" (UID: "4767c190-aeb7-402c-9240-94d8b1460ac5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:07:05.192308 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.192264 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-console-config" (OuterVolumeSpecName: "console-config") pod "4767c190-aeb7-402c-9240-94d8b1460ac5" (UID: "4767c190-aeb7-402c-9240-94d8b1460ac5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:07:05.193713 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.193691 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4767c190-aeb7-402c-9240-94d8b1460ac5" (UID: "4767c190-aeb7-402c-9240-94d8b1460ac5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:07:05.193713 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.193703 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4767c190-aeb7-402c-9240-94d8b1460ac5-kube-api-access-w6gmq" (OuterVolumeSpecName: "kube-api-access-w6gmq") pod "4767c190-aeb7-402c-9240-94d8b1460ac5" (UID: "4767c190-aeb7-402c-9240-94d8b1460ac5"). InnerVolumeSpecName "kube-api-access-w6gmq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:07:05.193813 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.193712 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4767c190-aeb7-402c-9240-94d8b1460ac5" (UID: "4767c190-aeb7-402c-9240-94d8b1460ac5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:07:05.293050 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.293026 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6gmq\" (UniqueName: \"kubernetes.io/projected/4767c190-aeb7-402c-9240-94d8b1460ac5-kube-api-access-w6gmq\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:07:05.293050 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.293049 2544 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-oauth-serving-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:07:05.293160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.293059 2544 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-oauth-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:07:05.293160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.293068 2544 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-trusted-ca-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:07:05.293160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.293076 2544 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4767c190-aeb7-402c-9240-94d8b1460ac5-console-serving-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:07:05.293160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.293085 2544 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-console-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:07:05.293160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.293094 2544 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4767c190-aeb7-402c-9240-94d8b1460ac5-service-ca\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:07:05.810491 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.810469 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-567b8cd498-rq66p_4767c190-aeb7-402c-9240-94d8b1460ac5/console/0.log" Jun 02 20:07:05.810624 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.810503 2544 generic.go:358] "Generic (PLEG): container finished" podID="4767c190-aeb7-402c-9240-94d8b1460ac5" containerID="f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633" exitCode=2 Jun 02 20:07:05.810624 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.810565 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567b8cd498-rq66p" Jun 02 20:07:05.810624 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.810601 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567b8cd498-rq66p" event={"ID":"4767c190-aeb7-402c-9240-94d8b1460ac5","Type":"ContainerDied","Data":"f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633"} Jun 02 20:07:05.810729 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.810642 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567b8cd498-rq66p" event={"ID":"4767c190-aeb7-402c-9240-94d8b1460ac5","Type":"ContainerDied","Data":"f348b60bfcbcc2f830f0f35b5ccd5145fec525c09164a4fa684cb1144761fcdb"} Jun 02 20:07:05.810729 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.810660 2544 scope.go:117] "RemoveContainer" containerID="f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633" Jun 02 20:07:05.819137 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.818931 2544 scope.go:117] "RemoveContainer" containerID="f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633" Jun 02 20:07:05.819349 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:07:05.819176 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633\": container with ID starting with f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633 not found: ID does not exist" containerID="f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633" Jun 02 20:07:05.819349 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.819195 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633"} err="failed to get container status \"f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633\": rpc error: code = NotFound desc = could not find container \"f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633\": container with ID starting with f3e4da88b564c23626bc468d7f3f5bdf6771edcee1e7a7ff34e881cd0ab96633 not found: ID does not exist" Jun 02 20:07:05.831913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.831890 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567b8cd498-rq66p"] Jun 02 20:07:05.838433 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:05.838412 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567b8cd498-rq66p"] Jun 02 20:07:06.822502 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:06.822472 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4767c190-aeb7-402c-9240-94d8b1460ac5" path="/var/lib/kubelet/pods/4767c190-aeb7-402c-9240-94d8b1460ac5/volumes" Jun 02 20:07:08.706873 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:08.706845 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:07:08.714409 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:08.714364 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:07:08.719754 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:08.719730 2544 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 20:07:34.589941 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.589903 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-ddccc699-d2x86"] Jun 02 20:07:34.592157 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.590224 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4767c190-aeb7-402c-9240-94d8b1460ac5" containerName="console" Jun 02 20:07:34.592157 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.590236 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="4767c190-aeb7-402c-9240-94d8b1460ac5" containerName="console" Jun 02 20:07:34.592157 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.590308 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="4767c190-aeb7-402c-9240-94d8b1460ac5" containerName="console" Jun 02 20:07:34.593147 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.593133 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.626333 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.626312 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ddccc699-d2x86"] Jun 02 20:07:34.695401 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.695367 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-oauth-serving-cert\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.695503 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.695432 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cx4s\" (UniqueName: \"kubernetes.io/projected/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-kube-api-access-2cx4s\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.695554 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.695507 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-serving-cert\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.695624 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.695564 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-oauth-config\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.695624 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.695583 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-trusted-ca-bundle\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.695705 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.695621 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-service-ca\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.695705 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.695651 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-config\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.796291 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.796262 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-oauth-serving-cert\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.796437 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.796297 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cx4s\" (UniqueName: \"kubernetes.io/projected/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-kube-api-access-2cx4s\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.796437 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.796321 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-serving-cert\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.796437 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.796349 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-oauth-config\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.796437 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.796374 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-trusted-ca-bundle\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.796437 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.796430 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-service-ca\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.796707 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.796470 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-config\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.797153 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.797122 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-oauth-serving-cert\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.797237 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.797156 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-service-ca\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.797237 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.797136 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-config\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.797321 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.797306 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-trusted-ca-bundle\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.798786 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.798764 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-serving-cert\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.798786 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.798779 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-oauth-config\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.804622 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.804600 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cx4s\" (UniqueName: \"kubernetes.io/projected/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-kube-api-access-2cx4s\") pod \"console-ddccc699-d2x86\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:34.901804 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:34.901778 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:35.027190 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:35.027171 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ddccc699-d2x86"] Jun 02 20:07:35.029497 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:07:35.029462 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb67e9b_b3d2_4cb0_8ab3_b2d537a38e63.slice/crio-bba7499433e0eb6cf5f28b5565e01265b0617fc16c2b6bb308ab5040ec136216 WatchSource:0}: Error finding container bba7499433e0eb6cf5f28b5565e01265b0617fc16c2b6bb308ab5040ec136216: Status 404 returned error can't find the container with id bba7499433e0eb6cf5f28b5565e01265b0617fc16c2b6bb308ab5040ec136216 Jun 02 20:07:35.031224 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:35.031204 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:07:35.891243 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:35.891209 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddccc699-d2x86" event={"ID":"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63","Type":"ContainerStarted","Data":"d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48"} Jun 02 20:07:35.891243 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:35.891242 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddccc699-d2x86" event={"ID":"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63","Type":"ContainerStarted","Data":"bba7499433e0eb6cf5f28b5565e01265b0617fc16c2b6bb308ab5040ec136216"} Jun 02 20:07:35.911838 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:35.911791 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-ddccc699-d2x86" podStartSLOduration=1.911779084 podStartE2EDuration="1.911779084s" podCreationTimestamp="2026-06-02 20:07:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:07:35.911039565 +0000 UTC m=+327.657822224" watchObservedRunningTime="2026-06-02 20:07:35.911779084 +0000 UTC m=+327.658561740" Jun 02 20:07:44.901965 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:44.901929 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:44.902456 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:44.902076 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:44.906541 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:44.906519 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:44.918831 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:44.918811 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:07:44.978228 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:07:44.978198 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-849b54fccc-wtgft"] Jun 02 20:08:10.004960 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.004860 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-849b54fccc-wtgft" podUID="a42b1026-26fa-4506-a29b-1b7003dd3752" containerName="console" containerID="cri-o://bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97" gracePeriod=15 Jun 02 20:08:10.247188 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.247167 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-849b54fccc-wtgft_a42b1026-26fa-4506-a29b-1b7003dd3752/console/0.log" Jun 02 20:08:10.247310 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.247228 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:08:10.281136 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281072 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-trusted-ca-bundle\") pod \"a42b1026-26fa-4506-a29b-1b7003dd3752\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " Jun 02 20:08:10.281136 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281104 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-oauth-config\") pod \"a42b1026-26fa-4506-a29b-1b7003dd3752\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " Jun 02 20:08:10.281136 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281135 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-oauth-serving-cert\") pod \"a42b1026-26fa-4506-a29b-1b7003dd3752\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " Jun 02 20:08:10.281356 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281159 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-service-ca\") pod \"a42b1026-26fa-4506-a29b-1b7003dd3752\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " Jun 02 20:08:10.281356 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281200 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8rzx\" (UniqueName: \"kubernetes.io/projected/a42b1026-26fa-4506-a29b-1b7003dd3752-kube-api-access-h8rzx\") pod \"a42b1026-26fa-4506-a29b-1b7003dd3752\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " Jun 02 20:08:10.281356 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281217 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-console-config\") pod \"a42b1026-26fa-4506-a29b-1b7003dd3752\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " Jun 02 20:08:10.281356 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281330 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-serving-cert\") pod \"a42b1026-26fa-4506-a29b-1b7003dd3752\" (UID: \"a42b1026-26fa-4506-a29b-1b7003dd3752\") " Jun 02 20:08:10.281784 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281588 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a42b1026-26fa-4506-a29b-1b7003dd3752" (UID: "a42b1026-26fa-4506-a29b-1b7003dd3752"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:08:10.281784 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281634 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-service-ca" (OuterVolumeSpecName: "service-ca") pod "a42b1026-26fa-4506-a29b-1b7003dd3752" (UID: "a42b1026-26fa-4506-a29b-1b7003dd3752"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:08:10.281914 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.281824 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-console-config" (OuterVolumeSpecName: "console-config") pod "a42b1026-26fa-4506-a29b-1b7003dd3752" (UID: "a42b1026-26fa-4506-a29b-1b7003dd3752"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:08:10.282041 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.282003 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a42b1026-26fa-4506-a29b-1b7003dd3752" (UID: "a42b1026-26fa-4506-a29b-1b7003dd3752"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:08:10.283490 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.283459 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42b1026-26fa-4506-a29b-1b7003dd3752-kube-api-access-h8rzx" (OuterVolumeSpecName: "kube-api-access-h8rzx") pod "a42b1026-26fa-4506-a29b-1b7003dd3752" (UID: "a42b1026-26fa-4506-a29b-1b7003dd3752"). InnerVolumeSpecName "kube-api-access-h8rzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:08:10.283575 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.283491 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a42b1026-26fa-4506-a29b-1b7003dd3752" (UID: "a42b1026-26fa-4506-a29b-1b7003dd3752"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:08:10.283706 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.283692 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a42b1026-26fa-4506-a29b-1b7003dd3752" (UID: "a42b1026-26fa-4506-a29b-1b7003dd3752"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:08:10.382174 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.382147 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8rzx\" (UniqueName: \"kubernetes.io/projected/a42b1026-26fa-4506-a29b-1b7003dd3752-kube-api-access-h8rzx\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:08:10.382174 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.382170 2544 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-console-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:08:10.382174 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.382179 2544 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-serving-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:08:10.382405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.382189 2544 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-trusted-ca-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:08:10.382405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.382198 2544 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a42b1026-26fa-4506-a29b-1b7003dd3752-console-oauth-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:08:10.382405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.382206 2544 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-oauth-serving-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:08:10.382405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.382215 2544 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a42b1026-26fa-4506-a29b-1b7003dd3752-service-ca\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:08:10.990746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.990720 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-849b54fccc-wtgft_a42b1026-26fa-4506-a29b-1b7003dd3752/console/0.log" Jun 02 20:08:10.990916 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.990761 2544 generic.go:358] "Generic (PLEG): container finished" podID="a42b1026-26fa-4506-a29b-1b7003dd3752" containerID="bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97" exitCode=2 Jun 02 20:08:10.990916 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.990823 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849b54fccc-wtgft" event={"ID":"a42b1026-26fa-4506-a29b-1b7003dd3752","Type":"ContainerDied","Data":"bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97"} Jun 02 20:08:10.990916 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.990834 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849b54fccc-wtgft" Jun 02 20:08:10.990916 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.990855 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849b54fccc-wtgft" event={"ID":"a42b1026-26fa-4506-a29b-1b7003dd3752","Type":"ContainerDied","Data":"d021f67a35736ce5ebf23f7e653d5fcfa50dee0d5fca71a568e97e4e771e5a9a"} Jun 02 20:08:10.990916 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.990875 2544 scope.go:117] "RemoveContainer" containerID="bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97" Jun 02 20:08:10.998984 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.998961 2544 scope.go:117] "RemoveContainer" containerID="bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97" Jun 02 20:08:10.999241 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:08:10.999221 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97\": container with ID starting with bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97 not found: ID does not exist" containerID="bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97" Jun 02 20:08:10.999296 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:10.999248 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97"} err="failed to get container status \"bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97\": rpc error: code = NotFound desc = could not find container \"bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97\": container with ID starting with bc8a2f746cfceca9435a75cb5d011b6ffdde2ab4c762e6b81e9522d3d34a7d97 not found: ID does not exist" Jun 02 20:08:11.010616 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:11.010593 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-849b54fccc-wtgft"] Jun 02 20:08:11.016952 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:11.016932 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-849b54fccc-wtgft"] Jun 02 20:08:12.823534 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:12.823502 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a42b1026-26fa-4506-a29b-1b7003dd3752" path="/var/lib/kubelet/pods/a42b1026-26fa-4506-a29b-1b7003dd3752/volumes" Jun 02 20:08:21.392841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.392809 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lqh67"] Jun 02 20:08:21.393214 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.393151 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42b1026-26fa-4506-a29b-1b7003dd3752" containerName="console" Jun 02 20:08:21.393214 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.393163 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42b1026-26fa-4506-a29b-1b7003dd3752" containerName="console" Jun 02 20:08:21.393214 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.393214 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="a42b1026-26fa-4506-a29b-1b7003dd3752" containerName="console" Jun 02 20:08:21.396137 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.396121 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.398787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.398769 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 20:08:21.404706 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.404680 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lqh67"] Jun 02 20:08:21.473920 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.473896 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/072e5ffc-7196-49e7-b4c9-9ec8878c986d-kubelet-config\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.474013 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.473934 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/072e5ffc-7196-49e7-b4c9-9ec8878c986d-dbus\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.474013 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.473959 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/072e5ffc-7196-49e7-b4c9-9ec8878c986d-original-pull-secret\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.575111 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.575078 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/072e5ffc-7196-49e7-b4c9-9ec8878c986d-kubelet-config\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.575199 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.575125 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/072e5ffc-7196-49e7-b4c9-9ec8878c986d-dbus\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.575199 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.575151 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/072e5ffc-7196-49e7-b4c9-9ec8878c986d-original-pull-secret\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.575274 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.575207 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/072e5ffc-7196-49e7-b4c9-9ec8878c986d-kubelet-config\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.575314 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.575272 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/072e5ffc-7196-49e7-b4c9-9ec8878c986d-dbus\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.577303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.577284 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/072e5ffc-7196-49e7-b4c9-9ec8878c986d-original-pull-secret\") pod \"global-pull-secret-syncer-lqh67\" (UID: \"072e5ffc-7196-49e7-b4c9-9ec8878c986d\") " pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.705765 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.705700 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lqh67" Jun 02 20:08:21.831136 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:21.831113 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lqh67"] Jun 02 20:08:21.833516 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:08:21.833491 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072e5ffc_7196_49e7_b4c9_9ec8878c986d.slice/crio-4fc5890cc540c319585d28070ed6b5cf1be906d3d72585761d48de74d7be3f1d WatchSource:0}: Error finding container 4fc5890cc540c319585d28070ed6b5cf1be906d3d72585761d48de74d7be3f1d: Status 404 returned error can't find the container with id 4fc5890cc540c319585d28070ed6b5cf1be906d3d72585761d48de74d7be3f1d Jun 02 20:08:22.022671 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:22.022592 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lqh67" event={"ID":"072e5ffc-7196-49e7-b4c9-9ec8878c986d","Type":"ContainerStarted","Data":"4fc5890cc540c319585d28070ed6b5cf1be906d3d72585761d48de74d7be3f1d"} Jun 02 20:08:27.036780 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:27.036744 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lqh67" event={"ID":"072e5ffc-7196-49e7-b4c9-9ec8878c986d","Type":"ContainerStarted","Data":"5c765a94f1cb7fef5615425ed2fc488d4e4f4155fdeb44e01ecb1b5cd1e7ff55"} Jun 02 20:08:27.062075 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:27.062030 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lqh67" podStartSLOduration=1.380451417 podStartE2EDuration="6.06201766s" podCreationTimestamp="2026-06-02 20:08:21 +0000 UTC" firstStartedPulling="2026-06-02 20:08:21.835098406 +0000 UTC m=+373.581881041" lastFinishedPulling="2026-06-02 20:08:26.516664641 +0000 UTC m=+378.263447284" observedRunningTime="2026-06-02 20:08:27.061650618 +0000 UTC m=+378.808433275" watchObservedRunningTime="2026-06-02 20:08:27.06201766 +0000 UTC m=+378.808800323" Jun 02 20:08:38.883719 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:38.883690 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f"] Jun 02 20:08:38.886882 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:38.886863 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:38.889625 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:38.889569 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t9r55\"" Jun 02 20:08:38.889797 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:38.889785 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 20:08:38.890759 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:38.890742 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 20:08:38.900821 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:38.900802 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f"] Jun 02 20:08:39.006875 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.006843 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sg6x\" (UniqueName: \"kubernetes.io/projected/6881f55b-ed38-4c25-9bd2-dcb441dddb04-kube-api-access-4sg6x\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.006992 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.006885 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.006992 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.006948 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.107720 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.107689 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sg6x\" (UniqueName: \"kubernetes.io/projected/6881f55b-ed38-4c25-9bd2-dcb441dddb04-kube-api-access-4sg6x\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.107842 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.107732 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.107842 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.107766 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.108164 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.108144 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.108164 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.108156 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.116557 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.116536 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sg6x\" (UniqueName: \"kubernetes.io/projected/6881f55b-ed38-4c25-9bd2-dcb441dddb04-kube-api-access-4sg6x\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.196450 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.196422 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:08:39.324850 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:39.324821 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f"] Jun 02 20:08:39.326431 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:08:39.326399 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6881f55b_ed38_4c25_9bd2_dcb441dddb04.slice/crio-7950e76a19abf463c2fddb8bab00b0e36822d1cc581bf1670a8a6e84f450527e WatchSource:0}: Error finding container 7950e76a19abf463c2fddb8bab00b0e36822d1cc581bf1670a8a6e84f450527e: Status 404 returned error can't find the container with id 7950e76a19abf463c2fddb8bab00b0e36822d1cc581bf1670a8a6e84f450527e Jun 02 20:08:40.074068 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:40.074021 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" event={"ID":"6881f55b-ed38-4c25-9bd2-dcb441dddb04","Type":"ContainerStarted","Data":"7950e76a19abf463c2fddb8bab00b0e36822d1cc581bf1670a8a6e84f450527e"} Jun 02 20:08:49.106628 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:49.106592 2544 generic.go:358] "Generic (PLEG): container finished" podID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerID="1ba43e83b70bf300af93e5f80b7df35b88108cf8711441f12f8b1f1f508c975a" exitCode=0 Jun 02 20:08:49.107076 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:49.106669 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" event={"ID":"6881f55b-ed38-4c25-9bd2-dcb441dddb04","Type":"ContainerDied","Data":"1ba43e83b70bf300af93e5f80b7df35b88108cf8711441f12f8b1f1f508c975a"} Jun 02 20:08:51.114842 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:51.114809 2544 generic.go:358] "Generic (PLEG): container finished" podID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerID="b021559a223c254b5484acd979fe0eaf5089b25e66c4753a3d78f4d5c711f1d5" exitCode=0 Jun 02 20:08:51.115132 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:08:51.114866 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" event={"ID":"6881f55b-ed38-4c25-9bd2-dcb441dddb04","Type":"ContainerDied","Data":"b021559a223c254b5484acd979fe0eaf5089b25e66c4753a3d78f4d5c711f1d5"} Jun 02 20:09:06.165117 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:06.165079 2544 generic.go:358] "Generic (PLEG): container finished" podID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerID="d877286486a513cc78a7edd60b8d2f7b80b1ffb3e1343ea26d4a5082e9715314" exitCode=0 Jun 02 20:09:06.165566 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:06.165132 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" event={"ID":"6881f55b-ed38-4c25-9bd2-dcb441dddb04","Type":"ContainerDied","Data":"d877286486a513cc78a7edd60b8d2f7b80b1ffb3e1343ea26d4a5082e9715314"} Jun 02 20:09:07.290918 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.290892 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:09:07.350466 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.350431 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-bundle\") pod \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " Jun 02 20:09:07.350653 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.350492 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sg6x\" (UniqueName: \"kubernetes.io/projected/6881f55b-ed38-4c25-9bd2-dcb441dddb04-kube-api-access-4sg6x\") pod \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " Jun 02 20:09:07.350653 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.350611 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-util\") pod \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\" (UID: \"6881f55b-ed38-4c25-9bd2-dcb441dddb04\") " Jun 02 20:09:07.351194 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.351166 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-bundle" (OuterVolumeSpecName: "bundle") pod "6881f55b-ed38-4c25-9bd2-dcb441dddb04" (UID: "6881f55b-ed38-4c25-9bd2-dcb441dddb04"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:09:07.352632 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.352609 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6881f55b-ed38-4c25-9bd2-dcb441dddb04-kube-api-access-4sg6x" (OuterVolumeSpecName: "kube-api-access-4sg6x") pod "6881f55b-ed38-4c25-9bd2-dcb441dddb04" (UID: "6881f55b-ed38-4c25-9bd2-dcb441dddb04"). InnerVolumeSpecName "kube-api-access-4sg6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:09:07.355312 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.355283 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-util" (OuterVolumeSpecName: "util") pod "6881f55b-ed38-4c25-9bd2-dcb441dddb04" (UID: "6881f55b-ed38-4c25-9bd2-dcb441dddb04"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:09:07.451634 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.451541 2544 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:09:07.451634 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.451577 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sg6x\" (UniqueName: \"kubernetes.io/projected/6881f55b-ed38-4c25-9bd2-dcb441dddb04-kube-api-access-4sg6x\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:09:07.451634 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:07.451587 2544 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6881f55b-ed38-4c25-9bd2-dcb441dddb04-util\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:09:08.173494 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:08.173458 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" event={"ID":"6881f55b-ed38-4c25-9bd2-dcb441dddb04","Type":"ContainerDied","Data":"7950e76a19abf463c2fddb8bab00b0e36822d1cc581bf1670a8a6e84f450527e"} Jun 02 20:09:08.173494 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:08.173492 2544 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7950e76a19abf463c2fddb8bab00b0e36822d1cc581bf1670a8a6e84f450527e" Jun 02 20:09:08.173730 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:08.173504 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgmq5f" Jun 02 20:09:26.011915 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.011833 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-n9ll9"] Jun 02 20:09:26.012379 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.012200 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerName="extract" Jun 02 20:09:26.012379 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.012213 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerName="extract" Jun 02 20:09:26.012379 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.012231 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerName="pull" Jun 02 20:09:26.012379 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.012237 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerName="pull" Jun 02 20:09:26.012379 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.012250 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerName="util" Jun 02 20:09:26.012379 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.012255 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerName="util" Jun 02 20:09:26.012379 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.012313 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="6881f55b-ed38-4c25-9bd2-dcb441dddb04" containerName="extract" Jun 02 20:09:26.014188 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.014173 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-n9ll9" Jun 02 20:09:26.016750 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.016732 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 20:09:26.016856 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.016750 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 20:09:26.016896 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.016850 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9pzql\"" Jun 02 20:09:26.023996 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.023974 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-n9ll9"] Jun 02 20:09:26.112405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.112357 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6685e4de-b4bc-4bbe-9e59-16277ed0223b-bound-sa-token\") pod \"cert-manager-79c8d999ff-n9ll9\" (UID: \"6685e4de-b4bc-4bbe-9e59-16277ed0223b\") " pod="cert-manager/cert-manager-79c8d999ff-n9ll9" Jun 02 20:09:26.112571 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.112435 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv45k\" (UniqueName: \"kubernetes.io/projected/6685e4de-b4bc-4bbe-9e59-16277ed0223b-kube-api-access-wv45k\") pod \"cert-manager-79c8d999ff-n9ll9\" (UID: \"6685e4de-b4bc-4bbe-9e59-16277ed0223b\") " pod="cert-manager/cert-manager-79c8d999ff-n9ll9" Jun 02 20:09:26.213443 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.213410 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6685e4de-b4bc-4bbe-9e59-16277ed0223b-bound-sa-token\") pod \"cert-manager-79c8d999ff-n9ll9\" (UID: \"6685e4de-b4bc-4bbe-9e59-16277ed0223b\") " pod="cert-manager/cert-manager-79c8d999ff-n9ll9" Jun 02 20:09:26.213617 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.213467 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wv45k\" (UniqueName: \"kubernetes.io/projected/6685e4de-b4bc-4bbe-9e59-16277ed0223b-kube-api-access-wv45k\") pod \"cert-manager-79c8d999ff-n9ll9\" (UID: \"6685e4de-b4bc-4bbe-9e59-16277ed0223b\") " pod="cert-manager/cert-manager-79c8d999ff-n9ll9" Jun 02 20:09:26.221936 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.221915 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6685e4de-b4bc-4bbe-9e59-16277ed0223b-bound-sa-token\") pod \"cert-manager-79c8d999ff-n9ll9\" (UID: \"6685e4de-b4bc-4bbe-9e59-16277ed0223b\") " pod="cert-manager/cert-manager-79c8d999ff-n9ll9" Jun 02 20:09:26.222196 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.222176 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv45k\" (UniqueName: \"kubernetes.io/projected/6685e4de-b4bc-4bbe-9e59-16277ed0223b-kube-api-access-wv45k\") pod \"cert-manager-79c8d999ff-n9ll9\" (UID: \"6685e4de-b4bc-4bbe-9e59-16277ed0223b\") " pod="cert-manager/cert-manager-79c8d999ff-n9ll9" Jun 02 20:09:26.341499 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.341414 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-n9ll9" Jun 02 20:09:26.461823 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:26.461797 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-n9ll9"] Jun 02 20:09:26.464237 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:09:26.464208 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6685e4de_b4bc_4bbe_9e59_16277ed0223b.slice/crio-36d047992e180ce21bf36bbd0fddb37b9610470e020e95ef07807fbdc770ba5b WatchSource:0}: Error finding container 36d047992e180ce21bf36bbd0fddb37b9610470e020e95ef07807fbdc770ba5b: Status 404 returned error can't find the container with id 36d047992e180ce21bf36bbd0fddb37b9610470e020e95ef07807fbdc770ba5b Jun 02 20:09:27.235046 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:27.235005 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-n9ll9" event={"ID":"6685e4de-b4bc-4bbe-9e59-16277ed0223b","Type":"ContainerStarted","Data":"36d047992e180ce21bf36bbd0fddb37b9610470e020e95ef07807fbdc770ba5b"} Jun 02 20:09:29.243902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:29.243862 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-n9ll9" event={"ID":"6685e4de-b4bc-4bbe-9e59-16277ed0223b","Type":"ContainerStarted","Data":"5448dd10e44f8979818f873a3db4c36279835c80b46cd06de4d6853c6c2484fb"} Jun 02 20:09:29.260504 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:29.260452 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-n9ll9" podStartSLOduration=2.024212095 podStartE2EDuration="4.260433814s" podCreationTimestamp="2026-06-02 20:09:25 +0000 UTC" firstStartedPulling="2026-06-02 20:09:26.466023837 +0000 UTC m=+438.212806473" lastFinishedPulling="2026-06-02 20:09:28.702245558 +0000 UTC m=+440.449028192" observedRunningTime="2026-06-02 20:09:29.260081129 +0000 UTC m=+441.006863786" watchObservedRunningTime="2026-06-02 20:09:29.260433814 +0000 UTC m=+441.007216473" Jun 02 20:09:40.230684 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.230651 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269"] Jun 02 20:09:40.233000 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.232981 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" Jun 02 20:09:40.235904 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.235886 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 20:09:40.236002 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.235910 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 20:09:40.237049 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.237031 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-l86g6\"" Jun 02 20:09:40.243884 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.243863 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269"] Jun 02 20:09:40.328139 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.328111 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2b4330-5c5e-487d-a41d-df0085665dad-tmp\") pod \"openshift-lws-operator-bfc7f696d-g7269\" (UID: \"eb2b4330-5c5e-487d-a41d-df0085665dad\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" Jun 02 20:09:40.328242 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.328188 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v2mr\" (UniqueName: \"kubernetes.io/projected/eb2b4330-5c5e-487d-a41d-df0085665dad-kube-api-access-9v2mr\") pod \"openshift-lws-operator-bfc7f696d-g7269\" (UID: \"eb2b4330-5c5e-487d-a41d-df0085665dad\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" Jun 02 20:09:40.428907 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.428882 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9v2mr\" (UniqueName: \"kubernetes.io/projected/eb2b4330-5c5e-487d-a41d-df0085665dad-kube-api-access-9v2mr\") pod \"openshift-lws-operator-bfc7f696d-g7269\" (UID: \"eb2b4330-5c5e-487d-a41d-df0085665dad\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" Jun 02 20:09:40.429002 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.428921 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2b4330-5c5e-487d-a41d-df0085665dad-tmp\") pod \"openshift-lws-operator-bfc7f696d-g7269\" (UID: \"eb2b4330-5c5e-487d-a41d-df0085665dad\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" Jun 02 20:09:40.429289 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.429271 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb2b4330-5c5e-487d-a41d-df0085665dad-tmp\") pod \"openshift-lws-operator-bfc7f696d-g7269\" (UID: \"eb2b4330-5c5e-487d-a41d-df0085665dad\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" Jun 02 20:09:40.438270 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.438250 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v2mr\" (UniqueName: \"kubernetes.io/projected/eb2b4330-5c5e-487d-a41d-df0085665dad-kube-api-access-9v2mr\") pod \"openshift-lws-operator-bfc7f696d-g7269\" (UID: \"eb2b4330-5c5e-487d-a41d-df0085665dad\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" Jun 02 20:09:40.541491 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.541440 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" Jun 02 20:09:40.662458 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:40.662432 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269"] Jun 02 20:09:40.664812 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:09:40.664782 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeb2b4330_5c5e_487d_a41d_df0085665dad.slice/crio-097135fadacfd24866e0b4501d72d17268bf299ce4a8e4aef524e65f76c3ad65 WatchSource:0}: Error finding container 097135fadacfd24866e0b4501d72d17268bf299ce4a8e4aef524e65f76c3ad65: Status 404 returned error can't find the container with id 097135fadacfd24866e0b4501d72d17268bf299ce4a8e4aef524e65f76c3ad65 Jun 02 20:09:41.281490 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:41.281456 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" event={"ID":"eb2b4330-5c5e-487d-a41d-df0085665dad","Type":"ContainerStarted","Data":"097135fadacfd24866e0b4501d72d17268bf299ce4a8e4aef524e65f76c3ad65"} Jun 02 20:09:44.295310 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:44.295260 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" event={"ID":"eb2b4330-5c5e-487d-a41d-df0085665dad","Type":"ContainerStarted","Data":"7ba9e7b237f5be140e707841491d5d2cc15025368dcc3e5f5b448ba49b6ea1b3"} Jun 02 20:09:44.312100 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:09:44.312052 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-g7269" podStartSLOduration=1.538812203 podStartE2EDuration="4.312040157s" podCreationTimestamp="2026-06-02 20:09:40 +0000 UTC" firstStartedPulling="2026-06-02 20:09:40.666643772 +0000 UTC m=+452.413426410" lastFinishedPulling="2026-06-02 20:09:43.43987173 +0000 UTC m=+455.186654364" observedRunningTime="2026-06-02 20:09:44.311733658 +0000 UTC m=+456.058516318" watchObservedRunningTime="2026-06-02 20:09:44.312040157 +0000 UTC m=+456.058822814" Jun 02 20:10:01.606002 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.605964 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f89f75957-77sd2"] Jun 02 20:10:01.609280 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.609256 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.613186 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.613163 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 20:10:01.613306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.613202 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 20:10:01.613306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.613163 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gvngf\"" Jun 02 20:10:01.613306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.613204 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 20:10:01.620882 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.620860 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f89f75957-77sd2"] Jun 02 20:10:01.699044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.699009 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b904a22-a03b-4b21-a8be-8068005c9a84-manager-config\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.699044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.699044 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b904a22-a03b-4b21-a8be-8068005c9a84-cert\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.699323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.699299 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b904a22-a03b-4b21-a8be-8068005c9a84-metrics-cert\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.699406 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.699367 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4nhx\" (UniqueName: \"kubernetes.io/projected/4b904a22-a03b-4b21-a8be-8068005c9a84-kube-api-access-d4nhx\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.800681 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.800647 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b904a22-a03b-4b21-a8be-8068005c9a84-metrics-cert\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.800681 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.800682 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4nhx\" (UniqueName: \"kubernetes.io/projected/4b904a22-a03b-4b21-a8be-8068005c9a84-kube-api-access-d4nhx\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.800875 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.800716 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b904a22-a03b-4b21-a8be-8068005c9a84-manager-config\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.800875 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.800739 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b904a22-a03b-4b21-a8be-8068005c9a84-cert\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.801436 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.801380 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4b904a22-a03b-4b21-a8be-8068005c9a84-manager-config\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.803200 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.803182 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b904a22-a03b-4b21-a8be-8068005c9a84-cert\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.803358 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.803337 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4b904a22-a03b-4b21-a8be-8068005c9a84-metrics-cert\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.824014 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.823988 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4nhx\" (UniqueName: \"kubernetes.io/projected/4b904a22-a03b-4b21-a8be-8068005c9a84-kube-api-access-d4nhx\") pod \"lws-controller-manager-f89f75957-77sd2\" (UID: \"4b904a22-a03b-4b21-a8be-8068005c9a84\") " pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:01.918122 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:01.918075 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:02.060646 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:02.060615 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f89f75957-77sd2"] Jun 02 20:10:02.062229 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:10:02.062201 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b904a22_a03b_4b21_a8be_8068005c9a84.slice/crio-0cfbd77e04c0f485dfbee5d9c91dd3f8edff62c5e8343152e3d08bb6d67d8a54 WatchSource:0}: Error finding container 0cfbd77e04c0f485dfbee5d9c91dd3f8edff62c5e8343152e3d08bb6d67d8a54: Status 404 returned error can't find the container with id 0cfbd77e04c0f485dfbee5d9c91dd3f8edff62c5e8343152e3d08bb6d67d8a54 Jun 02 20:10:02.354846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:02.354754 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" event={"ID":"4b904a22-a03b-4b21-a8be-8068005c9a84","Type":"ContainerStarted","Data":"0cfbd77e04c0f485dfbee5d9c91dd3f8edff62c5e8343152e3d08bb6d67d8a54"} Jun 02 20:10:04.094517 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.094485 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725"] Jun 02 20:10:04.098317 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.098299 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.107359 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.107335 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 20:10:04.107465 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.107366 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 20:10:04.107465 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.107379 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 20:10:04.107581 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.107472 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 20:10:04.107727 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.107712 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-998mr\"" Jun 02 20:10:04.119790 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.119766 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ab05963d-f959-406b-90fd-2c76c91dde45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.119878 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.119818 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ab05963d-f959-406b-90fd-2c76c91dde45-manifests\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.119878 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.119861 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab05963d-f959-406b-90fd-2c76c91dde45-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.119961 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.119880 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fn4\" (UniqueName: \"kubernetes.io/projected/ab05963d-f959-406b-90fd-2c76c91dde45-kube-api-access-v9fn4\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.119961 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.119937 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab05963d-f959-406b-90fd-2c76c91dde45-tmp\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.158917 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.158886 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725"] Jun 02 20:10:04.220956 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.220923 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ab05963d-f959-406b-90fd-2c76c91dde45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.221134 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.220981 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ab05963d-f959-406b-90fd-2c76c91dde45-manifests\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.221134 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.221009 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab05963d-f959-406b-90fd-2c76c91dde45-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.221134 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.221040 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fn4\" (UniqueName: \"kubernetes.io/projected/ab05963d-f959-406b-90fd-2c76c91dde45-kube-api-access-v9fn4\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.221134 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.221069 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab05963d-f959-406b-90fd-2c76c91dde45-tmp\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.221468 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.221439 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ab05963d-f959-406b-90fd-2c76c91dde45-manifests\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.223362 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.223334 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab05963d-f959-406b-90fd-2c76c91dde45-tmp\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.223589 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.223571 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ab05963d-f959-406b-90fd-2c76c91dde45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.223628 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.223585 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ab05963d-f959-406b-90fd-2c76c91dde45-webhook-cert\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.233085 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.233063 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fn4\" (UniqueName: \"kubernetes.io/projected/ab05963d-f959-406b-90fd-2c76c91dde45-kube-api-access-v9fn4\") pod \"opendatahub-operator-controller-manager-58b87b6c86-k7725\" (UID: \"ab05963d-f959-406b-90fd-2c76c91dde45\") " pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.409408 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.409365 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:04.541910 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:04.541882 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725"] Jun 02 20:10:04.542911 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:10:04.542887 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab05963d_f959_406b_90fd_2c76c91dde45.slice/crio-d617325b0d17390ea1504fc2bdaae755ff3fe015738c2e3e2b12816456670e96 WatchSource:0}: Error finding container d617325b0d17390ea1504fc2bdaae755ff3fe015738c2e3e2b12816456670e96: Status 404 returned error can't find the container with id d617325b0d17390ea1504fc2bdaae755ff3fe015738c2e3e2b12816456670e96 Jun 02 20:10:05.368549 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:05.368500 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" event={"ID":"ab05963d-f959-406b-90fd-2c76c91dde45","Type":"ContainerStarted","Data":"d617325b0d17390ea1504fc2bdaae755ff3fe015738c2e3e2b12816456670e96"} Jun 02 20:10:08.381975 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:08.381939 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" event={"ID":"ab05963d-f959-406b-90fd-2c76c91dde45","Type":"ContainerStarted","Data":"5534e08480de577114b4b717811080ca924d431c3029c8a96681a31cbaa51cf1"} Jun 02 20:10:09.385826 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:09.385782 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" event={"ID":"4b904a22-a03b-4b21-a8be-8068005c9a84","Type":"ContainerStarted","Data":"e5ebfd2d1823609f3c3bade47062f2aa6170c30b3e7f1b7049451ebb416b1bae"} Jun 02 20:10:09.386222 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:09.385834 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:09.387172 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:09.387144 2544 generic.go:358] "Generic (PLEG): container finished" podID="ab05963d-f959-406b-90fd-2c76c91dde45" containerID="5534e08480de577114b4b717811080ca924d431c3029c8a96681a31cbaa51cf1" exitCode=0 Jun 02 20:10:09.387263 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:09.387216 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" event={"ID":"ab05963d-f959-406b-90fd-2c76c91dde45","Type":"ContainerDied","Data":"5534e08480de577114b4b717811080ca924d431c3029c8a96681a31cbaa51cf1"} Jun 02 20:10:09.479053 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:09.479008 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" podStartSLOduration=1.924995988 podStartE2EDuration="8.478996636s" podCreationTimestamp="2026-06-02 20:10:01 +0000 UTC" firstStartedPulling="2026-06-02 20:10:02.064164752 +0000 UTC m=+473.810947390" lastFinishedPulling="2026-06-02 20:10:08.618165403 +0000 UTC m=+480.364948038" observedRunningTime="2026-06-02 20:10:09.43063882 +0000 UTC m=+481.177421476" watchObservedRunningTime="2026-06-02 20:10:09.478996636 +0000 UTC m=+481.225779293" Jun 02 20:10:10.391689 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:10.391655 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" event={"ID":"ab05963d-f959-406b-90fd-2c76c91dde45","Type":"ContainerStarted","Data":"33508afae4da9585924c6bf4e9c2fd77d07c3971ee4c7df31d4a95c5c8cc4df5"} Jun 02 20:10:10.392100 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:10.391896 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:10.427813 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:10.427768 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" podStartSLOduration=1.268025068 podStartE2EDuration="6.427755072s" podCreationTimestamp="2026-06-02 20:10:04 +0000 UTC" firstStartedPulling="2026-06-02 20:10:04.54467885 +0000 UTC m=+476.291461488" lastFinishedPulling="2026-06-02 20:10:09.704408853 +0000 UTC m=+481.451191492" observedRunningTime="2026-06-02 20:10:10.426599917 +0000 UTC m=+482.173382574" watchObservedRunningTime="2026-06-02 20:10:10.427755072 +0000 UTC m=+482.174537728" Jun 02 20:10:20.393971 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:20.393942 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f89f75957-77sd2" Jun 02 20:10:21.400606 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:21.400582 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58b87b6c86-k7725" Jun 02 20:10:54.404743 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.404704 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws"] Jun 02 20:10:54.411284 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.411261 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.414222 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.414201 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2rj2q\"" Jun 02 20:10:54.414339 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.414204 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 20:10:54.420774 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.420747 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws"] Jun 02 20:10:54.432501 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432477 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.432605 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432517 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63ff767-54a9-4ead-8031-f5c6068ddd63-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.432605 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432547 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.432683 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432644 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.432721 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432697 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jsqs\" (UniqueName: \"kubernetes.io/projected/e63ff767-54a9-4ead-8031-f5c6068ddd63-kube-api-access-2jsqs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.432763 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432753 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.432806 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432794 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.432846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432827 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.432900 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.432885 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534192 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534169 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534289 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534199 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63ff767-54a9-4ead-8031-f5c6068ddd63-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534289 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534216 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534289 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534265 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534448 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534313 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jsqs\" (UniqueName: \"kubernetes.io/projected/e63ff767-54a9-4ead-8031-f5c6068ddd63-kube-api-access-2jsqs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534448 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534351 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534448 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534370 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534448 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534410 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534646 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534472 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534701 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534679 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534746 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534721 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.534946 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.534925 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e63ff767-54a9-4ead-8031-f5c6068ddd63-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.535124 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.535108 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.535242 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.535222 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.536787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.536761 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.536872 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.536847 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.547050 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.547021 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e63ff767-54a9-4ead-8031-f5c6068ddd63-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.548407 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.548370 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jsqs\" (UniqueName: \"kubernetes.io/projected/e63ff767-54a9-4ead-8031-f5c6068ddd63-kube-api-access-2jsqs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws\" (UID: \"e63ff767-54a9-4ead-8031-f5c6068ddd63\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.722909 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.722851 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:54.803657 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.803623 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-64d74bb8cd-xnfhg"] Jun 02 20:10:54.807579 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.807554 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" Jun 02 20:10:54.811162 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.810259 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8d9lh\"" Jun 02 20:10:54.811162 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.810577 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 20:10:54.835838 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.835816 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64d74bb8cd-xnfhg"] Jun 02 20:10:54.836577 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.836314 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng7b7\" (UniqueName: \"kubernetes.io/projected/e54639c4-e4da-42ea-8fdf-507210a96608-kube-api-access-ng7b7\") pod \"dashboard-redirect-64d74bb8cd-xnfhg\" (UID: \"e54639c4-e4da-42ea-8fdf-507210a96608\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" Jun 02 20:10:54.836786 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.836765 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e54639c4-e4da-42ea-8fdf-507210a96608-redirect-config\") pod \"dashboard-redirect-64d74bb8cd-xnfhg\" (UID: \"e54639c4-e4da-42ea-8fdf-507210a96608\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" Jun 02 20:10:54.875548 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.875525 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws"] Jun 02 20:10:54.876901 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:10:54.876879 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63ff767_54a9_4ead_8031_f5c6068ddd63.slice/crio-e876a4c6a117cd1af2e4784bd0c83e7c882920935035493ceaafb62e2e0e22f0 WatchSource:0}: Error finding container e876a4c6a117cd1af2e4784bd0c83e7c882920935035493ceaafb62e2e0e22f0: Status 404 returned error can't find the container with id e876a4c6a117cd1af2e4784bd0c83e7c882920935035493ceaafb62e2e0e22f0 Jun 02 20:10:54.938006 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.937986 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ng7b7\" (UniqueName: \"kubernetes.io/projected/e54639c4-e4da-42ea-8fdf-507210a96608-kube-api-access-ng7b7\") pod \"dashboard-redirect-64d74bb8cd-xnfhg\" (UID: \"e54639c4-e4da-42ea-8fdf-507210a96608\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" Jun 02 20:10:54.938102 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.938020 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e54639c4-e4da-42ea-8fdf-507210a96608-redirect-config\") pod \"dashboard-redirect-64d74bb8cd-xnfhg\" (UID: \"e54639c4-e4da-42ea-8fdf-507210a96608\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" Jun 02 20:10:54.938723 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.938706 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e54639c4-e4da-42ea-8fdf-507210a96608-redirect-config\") pod \"dashboard-redirect-64d74bb8cd-xnfhg\" (UID: \"e54639c4-e4da-42ea-8fdf-507210a96608\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" Jun 02 20:10:54.950323 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:54.950304 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng7b7\" (UniqueName: \"kubernetes.io/projected/e54639c4-e4da-42ea-8fdf-507210a96608-kube-api-access-ng7b7\") pod \"dashboard-redirect-64d74bb8cd-xnfhg\" (UID: \"e54639c4-e4da-42ea-8fdf-507210a96608\") " pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" Jun 02 20:10:55.123581 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:55.123510 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" Jun 02 20:10:55.454146 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:55.454117 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64d74bb8cd-xnfhg"] Jun 02 20:10:55.456102 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:10:55.456071 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54639c4_e4da_42ea_8fdf_507210a96608.slice/crio-4e5ce7d8661988134198231e7dc8990dfeb6df95d8511f7c42a7755432b256b7 WatchSource:0}: Error finding container 4e5ce7d8661988134198231e7dc8990dfeb6df95d8511f7c42a7755432b256b7: Status 404 returned error can't find the container with id 4e5ce7d8661988134198231e7dc8990dfeb6df95d8511f7c42a7755432b256b7 Jun 02 20:10:55.545302 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:55.545265 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" event={"ID":"e63ff767-54a9-4ead-8031-f5c6068ddd63","Type":"ContainerStarted","Data":"e876a4c6a117cd1af2e4784bd0c83e7c882920935035493ceaafb62e2e0e22f0"} Jun 02 20:10:55.546584 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:55.546559 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" event={"ID":"e54639c4-e4da-42ea-8fdf-507210a96608","Type":"ContainerStarted","Data":"4e5ce7d8661988134198231e7dc8990dfeb6df95d8511f7c42a7755432b256b7"} Jun 02 20:10:57.920801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:57.920761 2544 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 20:10:57.921061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:57.920839 2544 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 20:10:57.921061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:57.920867 2544 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 20:10:58.558815 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:58.558778 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" event={"ID":"e63ff767-54a9-4ead-8031-f5c6068ddd63","Type":"ContainerStarted","Data":"179c499bb79b994037c164e7671f0dab5116dc7af8343882ea6f42c2a518eb81"} Jun 02 20:10:58.560082 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:58.560052 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" event={"ID":"e54639c4-e4da-42ea-8fdf-507210a96608","Type":"ContainerStarted","Data":"73ddf98b1d4e681ef11dcd074ae569f3d222d64b9fa64b74f8ea87a63862763e"} Jun 02 20:10:58.584776 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:58.584732 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" podStartSLOduration=1.5428211649999999 podStartE2EDuration="4.584719699s" podCreationTimestamp="2026-06-02 20:10:54 +0000 UTC" firstStartedPulling="2026-06-02 20:10:54.87862748 +0000 UTC m=+526.625410114" lastFinishedPulling="2026-06-02 20:10:57.92052601 +0000 UTC m=+529.667308648" observedRunningTime="2026-06-02 20:10:58.582435133 +0000 UTC m=+530.329217789" watchObservedRunningTime="2026-06-02 20:10:58.584719699 +0000 UTC m=+530.331502354" Jun 02 20:10:58.598449 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:58.598407 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-64d74bb8cd-xnfhg" podStartSLOduration=2.106104344 podStartE2EDuration="4.598375639s" podCreationTimestamp="2026-06-02 20:10:54 +0000 UTC" firstStartedPulling="2026-06-02 20:10:55.457617535 +0000 UTC m=+527.204400169" lastFinishedPulling="2026-06-02 20:10:57.949888815 +0000 UTC m=+529.696671464" observedRunningTime="2026-06-02 20:10:58.597480617 +0000 UTC m=+530.344263276" watchObservedRunningTime="2026-06-02 20:10:58.598375639 +0000 UTC m=+530.345158305" Jun 02 20:10:58.723084 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:58.723052 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:10:59.727909 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:10:59.727877 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:11:00.567299 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:00.567261 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:11:00.568251 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:00.568227 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws" Jun 02 20:11:25.322332 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.322297 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7k69w"] Jun 02 20:11:25.327594 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.327574 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" Jun 02 20:11:25.330692 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.330671 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 20:11:25.331687 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.331670 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-snwz5\"" Jun 02 20:11:25.331763 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.331739 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 20:11:25.338725 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.338700 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7k69w"] Jun 02 20:11:25.494660 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.494630 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s56bq\" (UniqueName: \"kubernetes.io/projected/9418ba7e-6286-4315-bb52-b457cf252d93-kube-api-access-s56bq\") pod \"kuadrant-operator-catalog-7k69w\" (UID: \"9418ba7e-6286-4315-bb52-b457cf252d93\") " pod="kuadrant-system/kuadrant-operator-catalog-7k69w" Jun 02 20:11:25.595532 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.595445 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s56bq\" (UniqueName: \"kubernetes.io/projected/9418ba7e-6286-4315-bb52-b457cf252d93-kube-api-access-s56bq\") pod \"kuadrant-operator-catalog-7k69w\" (UID: \"9418ba7e-6286-4315-bb52-b457cf252d93\") " pod="kuadrant-system/kuadrant-operator-catalog-7k69w" Jun 02 20:11:25.604078 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.604047 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s56bq\" (UniqueName: \"kubernetes.io/projected/9418ba7e-6286-4315-bb52-b457cf252d93-kube-api-access-s56bq\") pod \"kuadrant-operator-catalog-7k69w\" (UID: \"9418ba7e-6286-4315-bb52-b457cf252d93\") " pod="kuadrant-system/kuadrant-operator-catalog-7k69w" Jun 02 20:11:25.638300 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.638267 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" Jun 02 20:11:25.677934 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.677889 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7k69w"] Jun 02 20:11:25.766623 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.766597 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7k69w"] Jun 02 20:11:25.769001 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:25.768959 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9418ba7e_6286_4315_bb52_b457cf252d93.slice/crio-406be4690b6a894562e0c0951cb829b0e6d480df2e3f485f61da985954566450 WatchSource:0}: Error finding container 406be4690b6a894562e0c0951cb829b0e6d480df2e3f485f61da985954566450: Status 404 returned error can't find the container with id 406be4690b6a894562e0c0951cb829b0e6d480df2e3f485f61da985954566450 Jun 02 20:11:25.888281 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.888249 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cz6pz"] Jun 02 20:11:25.891571 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.891553 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:25.899175 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.899140 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cz6pz"] Jun 02 20:11:25.999134 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:25.999093 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgc9q\" (UniqueName: \"kubernetes.io/projected/11368cf3-b80e-4d82-9ed2-f813a0d4941f-kube-api-access-pgc9q\") pod \"kuadrant-operator-catalog-cz6pz\" (UID: \"11368cf3-b80e-4d82-9ed2-f813a0d4941f\") " pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:26.100609 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:26.100578 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgc9q\" (UniqueName: \"kubernetes.io/projected/11368cf3-b80e-4d82-9ed2-f813a0d4941f-kube-api-access-pgc9q\") pod \"kuadrant-operator-catalog-cz6pz\" (UID: \"11368cf3-b80e-4d82-9ed2-f813a0d4941f\") " pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:26.108570 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:26.108549 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgc9q\" (UniqueName: \"kubernetes.io/projected/11368cf3-b80e-4d82-9ed2-f813a0d4941f-kube-api-access-pgc9q\") pod \"kuadrant-operator-catalog-cz6pz\" (UID: \"11368cf3-b80e-4d82-9ed2-f813a0d4941f\") " pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:26.203914 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:26.203848 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:26.331562 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:26.331538 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cz6pz"] Jun 02 20:11:26.333613 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:26.333591 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11368cf3_b80e_4d82_9ed2_f813a0d4941f.slice/crio-1a0fd71aaec56526fd38d5ffc557d18c7c43658cb06f6be721337bae2946a36d WatchSource:0}: Error finding container 1a0fd71aaec56526fd38d5ffc557d18c7c43658cb06f6be721337bae2946a36d: Status 404 returned error can't find the container with id 1a0fd71aaec56526fd38d5ffc557d18c7c43658cb06f6be721337bae2946a36d Jun 02 20:11:26.656561 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:26.656529 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" event={"ID":"11368cf3-b80e-4d82-9ed2-f813a0d4941f","Type":"ContainerStarted","Data":"1a0fd71aaec56526fd38d5ffc557d18c7c43658cb06f6be721337bae2946a36d"} Jun 02 20:11:26.659269 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:26.659230 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" event={"ID":"9418ba7e-6286-4315-bb52-b457cf252d93","Type":"ContainerStarted","Data":"406be4690b6a894562e0c0951cb829b0e6d480df2e3f485f61da985954566450"} Jun 02 20:11:28.668582 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:28.668548 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" event={"ID":"9418ba7e-6286-4315-bb52-b457cf252d93","Type":"ContainerStarted","Data":"3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741"} Jun 02 20:11:28.669044 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:28.668629 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" podUID="9418ba7e-6286-4315-bb52-b457cf252d93" containerName="registry-server" containerID="cri-o://3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741" gracePeriod=2 Jun 02 20:11:28.669863 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:28.669839 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" event={"ID":"11368cf3-b80e-4d82-9ed2-f813a0d4941f","Type":"ContainerStarted","Data":"7202100ede3c438bca80f936880870fdc921fbbd97942531643b01fda6cae23a"} Jun 02 20:11:28.685650 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:28.685611 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" podStartSLOduration=1.222093821 podStartE2EDuration="3.685597331s" podCreationTimestamp="2026-06-02 20:11:25 +0000 UTC" firstStartedPulling="2026-06-02 20:11:25.770230481 +0000 UTC m=+557.517013115" lastFinishedPulling="2026-06-02 20:11:28.233733987 +0000 UTC m=+559.980516625" observedRunningTime="2026-06-02 20:11:28.683978004 +0000 UTC m=+560.430760662" watchObservedRunningTime="2026-06-02 20:11:28.685597331 +0000 UTC m=+560.432379988" Jun 02 20:11:28.700999 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:28.700957 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" podStartSLOduration=1.799745593 podStartE2EDuration="3.700945281s" podCreationTimestamp="2026-06-02 20:11:25 +0000 UTC" firstStartedPulling="2026-06-02 20:11:26.335139392 +0000 UTC m=+558.081922026" lastFinishedPulling="2026-06-02 20:11:28.23633908 +0000 UTC m=+559.983121714" observedRunningTime="2026-06-02 20:11:28.698985954 +0000 UTC m=+560.445768612" watchObservedRunningTime="2026-06-02 20:11:28.700945281 +0000 UTC m=+560.447727938" Jun 02 20:11:28.914590 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:28.914567 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" Jun 02 20:11:29.027630 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.027551 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7546bff6fd-jdwsb"] Jun 02 20:11:29.027846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.027792 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s56bq\" (UniqueName: \"kubernetes.io/projected/9418ba7e-6286-4315-bb52-b457cf252d93-kube-api-access-s56bq\") pod \"9418ba7e-6286-4315-bb52-b457cf252d93\" (UID: \"9418ba7e-6286-4315-bb52-b457cf252d93\") " Jun 02 20:11:29.027954 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.027937 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9418ba7e-6286-4315-bb52-b457cf252d93" containerName="registry-server" Jun 02 20:11:29.028005 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.027959 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="9418ba7e-6286-4315-bb52-b457cf252d93" containerName="registry-server" Jun 02 20:11:29.028091 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.028077 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="9418ba7e-6286-4315-bb52-b457cf252d93" containerName="registry-server" Jun 02 20:11:29.029938 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.029908 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9418ba7e-6286-4315-bb52-b457cf252d93-kube-api-access-s56bq" (OuterVolumeSpecName: "kube-api-access-s56bq") pod "9418ba7e-6286-4315-bb52-b457cf252d93" (UID: "9418ba7e-6286-4315-bb52-b457cf252d93"). InnerVolumeSpecName "kube-api-access-s56bq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:11:29.031079 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.031052 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.043498 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.043463 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7546bff6fd-jdwsb"] Jun 02 20:11:29.128538 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.128501 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8374b69f-02ec-4333-b608-b2abd54b8e97-console-oauth-config\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.128538 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.128541 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-oauth-serving-cert\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.128749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.128582 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwxsn\" (UniqueName: \"kubernetes.io/projected/8374b69f-02ec-4333-b608-b2abd54b8e97-kube-api-access-vwxsn\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.128749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.128659 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8374b69f-02ec-4333-b608-b2abd54b8e97-console-serving-cert\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.128749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.128693 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-trusted-ca-bundle\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.128749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.128719 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-console-config\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.128866 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.128811 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-service-ca\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.128902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.128872 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s56bq\" (UniqueName: \"kubernetes.io/projected/9418ba7e-6286-4315-bb52-b457cf252d93-kube-api-access-s56bq\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:29.229493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.229454 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8374b69f-02ec-4333-b608-b2abd54b8e97-console-oauth-config\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.229493 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.229497 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-oauth-serving-cert\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.229697 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.229518 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwxsn\" (UniqueName: \"kubernetes.io/projected/8374b69f-02ec-4333-b608-b2abd54b8e97-kube-api-access-vwxsn\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.229697 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.229545 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8374b69f-02ec-4333-b608-b2abd54b8e97-console-serving-cert\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.229697 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.229565 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-trusted-ca-bundle\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.229697 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.229586 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-console-config\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.229697 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.229677 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-service-ca\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.230226 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.230200 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-oauth-serving-cert\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.230343 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.230318 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-console-config\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.230444 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.230353 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-service-ca\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.230514 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.230458 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8374b69f-02ec-4333-b608-b2abd54b8e97-trusted-ca-bundle\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.231943 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.231926 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8374b69f-02ec-4333-b608-b2abd54b8e97-console-oauth-config\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.232064 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.232046 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8374b69f-02ec-4333-b608-b2abd54b8e97-console-serving-cert\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.238578 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.238559 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwxsn\" (UniqueName: \"kubernetes.io/projected/8374b69f-02ec-4333-b608-b2abd54b8e97-kube-api-access-vwxsn\") pod \"console-7546bff6fd-jdwsb\" (UID: \"8374b69f-02ec-4333-b608-b2abd54b8e97\") " pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.340813 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.340744 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:29.468803 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.468777 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7546bff6fd-jdwsb"] Jun 02 20:11:29.470245 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:29.470215 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8374b69f_02ec_4333_b608_b2abd54b8e97.slice/crio-13229fd43a8393f77848d46cf5b317ce6c56add9da4d4755e6edf82713f5b6a7 WatchSource:0}: Error finding container 13229fd43a8393f77848d46cf5b317ce6c56add9da4d4755e6edf82713f5b6a7: Status 404 returned error can't find the container with id 13229fd43a8393f77848d46cf5b317ce6c56add9da4d4755e6edf82713f5b6a7 Jun 02 20:11:29.675282 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.675248 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7546bff6fd-jdwsb" event={"ID":"8374b69f-02ec-4333-b608-b2abd54b8e97","Type":"ContainerStarted","Data":"ae647cea835fb820bc0673022b20212352f1391689ef016f8fb46c2c69597334"} Jun 02 20:11:29.675736 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.675291 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7546bff6fd-jdwsb" event={"ID":"8374b69f-02ec-4333-b608-b2abd54b8e97","Type":"ContainerStarted","Data":"13229fd43a8393f77848d46cf5b317ce6c56add9da4d4755e6edf82713f5b6a7"} Jun 02 20:11:29.676353 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.676326 2544 generic.go:358] "Generic (PLEG): container finished" podID="9418ba7e-6286-4315-bb52-b457cf252d93" containerID="3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741" exitCode=0 Jun 02 20:11:29.676449 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.676376 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" Jun 02 20:11:29.676449 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.676419 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" event={"ID":"9418ba7e-6286-4315-bb52-b457cf252d93","Type":"ContainerDied","Data":"3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741"} Jun 02 20:11:29.676514 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.676454 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7k69w" event={"ID":"9418ba7e-6286-4315-bb52-b457cf252d93","Type":"ContainerDied","Data":"406be4690b6a894562e0c0951cb829b0e6d480df2e3f485f61da985954566450"} Jun 02 20:11:29.676514 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.676471 2544 scope.go:117] "RemoveContainer" containerID="3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741" Jun 02 20:11:29.684893 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.684879 2544 scope.go:117] "RemoveContainer" containerID="3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741" Jun 02 20:11:29.685143 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:11:29.685121 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741\": container with ID starting with 3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741 not found: ID does not exist" containerID="3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741" Jun 02 20:11:29.685278 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.685146 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741"} err="failed to get container status \"3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741\": rpc error: code = NotFound desc = could not find container \"3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741\": container with ID starting with 3a6dfc6a45f918d88b3c3231bf7cc6dc5bd81e4ba9d0c13320c31edbb0d64741 not found: ID does not exist" Jun 02 20:11:29.696203 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.696164 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7546bff6fd-jdwsb" podStartSLOduration=0.696154887 podStartE2EDuration="696.154887ms" podCreationTimestamp="2026-06-02 20:11:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:11:29.694769546 +0000 UTC m=+561.441552201" watchObservedRunningTime="2026-06-02 20:11:29.696154887 +0000 UTC m=+561.442937544" Jun 02 20:11:29.709186 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.709163 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7k69w"] Jun 02 20:11:29.713137 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:29.713118 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7k69w"] Jun 02 20:11:30.823405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:30.823359 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9418ba7e-6286-4315-bb52-b457cf252d93" path="/var/lib/kubelet/pods/9418ba7e-6286-4315-bb52-b457cf252d93/volumes" Jun 02 20:11:36.204951 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:36.204917 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:36.204951 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:36.204955 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:36.227184 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:36.227155 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:36.723441 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:36.723405 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cz6pz" Jun 02 20:11:39.341376 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:39.341344 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:39.341376 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:39.341393 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:39.345899 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:39.345878 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:39.715283 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:39.715256 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7546bff6fd-jdwsb" Jun 02 20:11:39.764702 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:39.764675 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ddccc699-d2x86"] Jun 02 20:11:40.924511 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:40.924476 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w"] Jun 02 20:11:40.929241 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:40.929222 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:40.931697 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:40.931677 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-92vdk\"" Jun 02 20:11:40.935547 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:40.935522 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:40.935649 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:40.935565 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vckm\" (UniqueName: \"kubernetes.io/projected/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-kube-api-access-9vckm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:40.935649 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:40.935612 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:40.935951 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:40.935934 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w"] Jun 02 20:11:41.036518 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.036485 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:41.036662 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.036524 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vckm\" (UniqueName: \"kubernetes.io/projected/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-kube-api-access-9vckm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:41.036662 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.036568 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:41.036846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.036828 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:41.036913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.036896 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:41.044758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.044735 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vckm\" (UniqueName: \"kubernetes.io/projected/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-kube-api-access-9vckm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:41.239382 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.239303 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:41.327850 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.327816 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b"] Jun 02 20:11:41.333434 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.333411 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.339520 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.339470 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.339667 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.339643 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxq9g\" (UniqueName: \"kubernetes.io/projected/4ba364c6-c3d6-43e4-83cf-f970456284f1-kube-api-access-hxq9g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.339759 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.339734 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.341669 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.341634 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b"] Jun 02 20:11:41.368755 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.368708 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w"] Jun 02 20:11:41.370951 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:41.370931 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577e9d4a_21ac_4bd4_9dcb_4c177906bcb4.slice/crio-be0462619d94d9e543e55499aff86746d450c06df557776d977f8fd0a586fec2 WatchSource:0}: Error finding container be0462619d94d9e543e55499aff86746d450c06df557776d977f8fd0a586fec2: Status 404 returned error can't find the container with id be0462619d94d9e543e55499aff86746d450c06df557776d977f8fd0a586fec2 Jun 02 20:11:41.440115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.440089 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.440233 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.440171 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hxq9g\" (UniqueName: \"kubernetes.io/projected/4ba364c6-c3d6-43e4-83cf-f970456284f1-kube-api-access-hxq9g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.440233 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.440220 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.440598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.440578 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.440598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.440581 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.449134 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.449110 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxq9g\" (UniqueName: \"kubernetes.io/projected/4ba364c6-c3d6-43e4-83cf-f970456284f1-kube-api-access-hxq9g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.648184 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.648151 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:41.725609 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.725577 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb"] Jun 02 20:11:41.726491 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.726435 2544 generic.go:358] "Generic (PLEG): container finished" podID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerID="92fce79dceaa220bc21ba605a37d2b1b5394a8b8e3ed906fdb3189568a43cdbd" exitCode=0 Jun 02 20:11:41.730740 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.730717 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" event={"ID":"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4","Type":"ContainerDied","Data":"92fce79dceaa220bc21ba605a37d2b1b5394a8b8e3ed906fdb3189568a43cdbd"} Jun 02 20:11:41.730835 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.730742 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" event={"ID":"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4","Type":"ContainerStarted","Data":"be0462619d94d9e543e55499aff86746d450c06df557776d977f8fd0a586fec2"} Jun 02 20:11:41.730835 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.730817 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.736147 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.736043 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb"] Jun 02 20:11:41.743023 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.742997 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.743136 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.743072 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpxvw\" (UniqueName: \"kubernetes.io/projected/545706f1-c651-439a-998c-c842c933cb1f-kube-api-access-qpxvw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.743136 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.743127 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.790808 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.790787 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b"] Jun 02 20:11:41.792676 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:41.792652 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba364c6_c3d6_43e4_83cf_f970456284f1.slice/crio-d52660d0e47cad893e5a5518e41fb941789bcdc16ddbd359a3dccb7ff6adacae WatchSource:0}: Error finding container d52660d0e47cad893e5a5518e41fb941789bcdc16ddbd359a3dccb7ff6adacae: Status 404 returned error can't find the container with id d52660d0e47cad893e5a5518e41fb941789bcdc16ddbd359a3dccb7ff6adacae Jun 02 20:11:41.844230 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.844204 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.844375 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.844352 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qpxvw\" (UniqueName: \"kubernetes.io/projected/545706f1-c651-439a-998c-c842c933cb1f-kube-api-access-qpxvw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.844464 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.844449 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.844630 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.844609 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.844740 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.844720 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:41.852893 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:41.852870 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpxvw\" (UniqueName: \"kubernetes.io/projected/545706f1-c651-439a-998c-c842c933cb1f-kube-api-access-qpxvw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:42.042019 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.041963 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:42.127486 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.127454 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6"] Jun 02 20:11:42.133186 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.133161 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.138927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.138905 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6"] Jun 02 20:11:42.147885 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.147859 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.148035 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.147906 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.148035 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.147939 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gwl9\" (UniqueName: \"kubernetes.io/projected/d5be48cc-8436-47c6-bfbc-7709893656f5-kube-api-access-9gwl9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.172341 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.172320 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb"] Jun 02 20:11:42.174330 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:42.174308 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545706f1_c651_439a_998c_c842c933cb1f.slice/crio-b04266f24172349f2c48c13a7caf3a9ea2ace6f56cd2f5ac9454bae80998ebfd WatchSource:0}: Error finding container b04266f24172349f2c48c13a7caf3a9ea2ace6f56cd2f5ac9454bae80998ebfd: Status 404 returned error can't find the container with id b04266f24172349f2c48c13a7caf3a9ea2ace6f56cd2f5ac9454bae80998ebfd Jun 02 20:11:42.248678 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.248654 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.248833 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.248696 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.248833 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.248716 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gwl9\" (UniqueName: \"kubernetes.io/projected/d5be48cc-8436-47c6-bfbc-7709893656f5-kube-api-access-9gwl9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.249037 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.249017 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.249109 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.249087 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.257070 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.257040 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gwl9\" (UniqueName: \"kubernetes.io/projected/d5be48cc-8436-47c6-bfbc-7709893656f5-kube-api-access-9gwl9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.445701 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.445667 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:42.582815 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.582789 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6"] Jun 02 20:11:42.593230 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:42.593201 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5be48cc_8436_47c6_bfbc_7709893656f5.slice/crio-3bd72a4817f49e4d6d6ae0e3fa3188d688ac0091abdb01f6428e359f851a33dd WatchSource:0}: Error finding container 3bd72a4817f49e4d6d6ae0e3fa3188d688ac0091abdb01f6428e359f851a33dd: Status 404 returned error can't find the container with id 3bd72a4817f49e4d6d6ae0e3fa3188d688ac0091abdb01f6428e359f851a33dd Jun 02 20:11:42.735080 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.735003 2544 generic.go:358] "Generic (PLEG): container finished" podID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerID="fb835f1e7795e1b0e742cfe9ed041f4bcb1a0400e35d86211437b14ae0a0411b" exitCode=0 Jun 02 20:11:42.735201 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.735089 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" event={"ID":"d5be48cc-8436-47c6-bfbc-7709893656f5","Type":"ContainerDied","Data":"fb835f1e7795e1b0e742cfe9ed041f4bcb1a0400e35d86211437b14ae0a0411b"} Jun 02 20:11:42.735201 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.735126 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" event={"ID":"d5be48cc-8436-47c6-bfbc-7709893656f5","Type":"ContainerStarted","Data":"3bd72a4817f49e4d6d6ae0e3fa3188d688ac0091abdb01f6428e359f851a33dd"} Jun 02 20:11:42.736766 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.736742 2544 generic.go:358] "Generic (PLEG): container finished" podID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerID="fd4bd277ea998591d1dc5e53e4e7fbaccb52bf2fea2cfbc7c4b3101f99ead52f" exitCode=0 Jun 02 20:11:42.736875 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.736772 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" event={"ID":"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4","Type":"ContainerDied","Data":"fd4bd277ea998591d1dc5e53e4e7fbaccb52bf2fea2cfbc7c4b3101f99ead52f"} Jun 02 20:11:42.738336 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.738250 2544 generic.go:358] "Generic (PLEG): container finished" podID="545706f1-c651-439a-998c-c842c933cb1f" containerID="70173500dd6e53b05bbe6da53f1b3a761037ee81e50aad0bbc0e844000a68494" exitCode=0 Jun 02 20:11:42.738336 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.738323 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" event={"ID":"545706f1-c651-439a-998c-c842c933cb1f","Type":"ContainerDied","Data":"70173500dd6e53b05bbe6da53f1b3a761037ee81e50aad0bbc0e844000a68494"} Jun 02 20:11:42.738488 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.738356 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" event={"ID":"545706f1-c651-439a-998c-c842c933cb1f","Type":"ContainerStarted","Data":"b04266f24172349f2c48c13a7caf3a9ea2ace6f56cd2f5ac9454bae80998ebfd"} Jun 02 20:11:42.739717 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.739695 2544 generic.go:358] "Generic (PLEG): container finished" podID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerID="4946dd1b6d5e0c576b1bf3695a6dec5b4a20bea2a223099632c42716a14af3c9" exitCode=0 Jun 02 20:11:42.739814 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.739760 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" event={"ID":"4ba364c6-c3d6-43e4-83cf-f970456284f1","Type":"ContainerDied","Data":"4946dd1b6d5e0c576b1bf3695a6dec5b4a20bea2a223099632c42716a14af3c9"} Jun 02 20:11:42.739814 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:42.739782 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" event={"ID":"4ba364c6-c3d6-43e4-83cf-f970456284f1","Type":"ContainerStarted","Data":"d52660d0e47cad893e5a5518e41fb941789bcdc16ddbd359a3dccb7ff6adacae"} Jun 02 20:11:43.745220 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:43.745188 2544 generic.go:358] "Generic (PLEG): container finished" podID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerID="c51118d51bdab4dc426e3c56d98fa7aed42936ab71a79b0570f0973e06b6ee42" exitCode=0 Jun 02 20:11:43.745554 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:43.745271 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" event={"ID":"4ba364c6-c3d6-43e4-83cf-f970456284f1","Type":"ContainerDied","Data":"c51118d51bdab4dc426e3c56d98fa7aed42936ab71a79b0570f0973e06b6ee42"} Jun 02 20:11:43.746902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:43.746840 2544 generic.go:358] "Generic (PLEG): container finished" podID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerID="e42f7f1795a4f977761fd3132910e1b6098c92cecb3d56b636e8c5f80537bed3" exitCode=0 Jun 02 20:11:43.746902 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:43.746867 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" event={"ID":"d5be48cc-8436-47c6-bfbc-7709893656f5","Type":"ContainerDied","Data":"e42f7f1795a4f977761fd3132910e1b6098c92cecb3d56b636e8c5f80537bed3"} Jun 02 20:11:43.748854 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:43.748835 2544 generic.go:358] "Generic (PLEG): container finished" podID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerID="28b0a5e124a4735e3db089403a5595fc3cbbde73413cecb3f0818c9105fd312f" exitCode=0 Jun 02 20:11:43.749025 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:43.748914 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" event={"ID":"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4","Type":"ContainerDied","Data":"28b0a5e124a4735e3db089403a5595fc3cbbde73413cecb3f0818c9105fd312f"} Jun 02 20:11:43.750435 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:43.750405 2544 generic.go:358] "Generic (PLEG): container finished" podID="545706f1-c651-439a-998c-c842c933cb1f" containerID="414a1976bd610b6918309afdfdf2167167df9b660cf991fc3d5182a67b39d69d" exitCode=0 Jun 02 20:11:43.750497 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:43.750437 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" event={"ID":"545706f1-c651-439a-998c-c842c933cb1f","Type":"ContainerDied","Data":"414a1976bd610b6918309afdfdf2167167df9b660cf991fc3d5182a67b39d69d"} Jun 02 20:11:44.755931 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.755890 2544 generic.go:358] "Generic (PLEG): container finished" podID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerID="7614d9493fb2bef4773c86f9c724166f4731d45716a13b6c2454f6412e7ef18c" exitCode=0 Jun 02 20:11:44.756314 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.755972 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" event={"ID":"4ba364c6-c3d6-43e4-83cf-f970456284f1","Type":"ContainerDied","Data":"7614d9493fb2bef4773c86f9c724166f4731d45716a13b6c2454f6412e7ef18c"} Jun 02 20:11:44.757903 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.757881 2544 generic.go:358] "Generic (PLEG): container finished" podID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerID="72f860d5db01b95b931a8d4260ad28f7474405fa537d77b440bdd7bf524db7ec" exitCode=0 Jun 02 20:11:44.758017 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.757967 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" event={"ID":"d5be48cc-8436-47c6-bfbc-7709893656f5","Type":"ContainerDied","Data":"72f860d5db01b95b931a8d4260ad28f7474405fa537d77b440bdd7bf524db7ec"} Jun 02 20:11:44.759875 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.759855 2544 generic.go:358] "Generic (PLEG): container finished" podID="545706f1-c651-439a-998c-c842c933cb1f" containerID="5f8e8273887ba2c55e1e21b5a1231738de058eafdc8f3f07753d4d53a574012d" exitCode=0 Jun 02 20:11:44.759976 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.759942 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" event={"ID":"545706f1-c651-439a-998c-c842c933cb1f","Type":"ContainerDied","Data":"5f8e8273887ba2c55e1e21b5a1231738de058eafdc8f3f07753d4d53a574012d"} Jun 02 20:11:44.887499 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.887475 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:44.971329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.971301 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vckm\" (UniqueName: \"kubernetes.io/projected/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-kube-api-access-9vckm\") pod \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " Jun 02 20:11:44.971470 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.971350 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-bundle\") pod \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " Jun 02 20:11:44.971514 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.971474 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-util\") pod \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\" (UID: \"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4\") " Jun 02 20:11:44.971986 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.971957 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-bundle" (OuterVolumeSpecName: "bundle") pod "577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" (UID: "577e9d4a-21ac-4bd4-9dcb-4c177906bcb4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:11:44.973300 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.973276 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-kube-api-access-9vckm" (OuterVolumeSpecName: "kube-api-access-9vckm") pod "577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" (UID: "577e9d4a-21ac-4bd4-9dcb-4c177906bcb4"). InnerVolumeSpecName "kube-api-access-9vckm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:11:44.979602 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:44.979578 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-util" (OuterVolumeSpecName: "util") pod "577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" (UID: "577e9d4a-21ac-4bd4-9dcb-4c177906bcb4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:11:45.072910 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.072860 2544 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-util\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:45.072910 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.072882 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vckm\" (UniqueName: \"kubernetes.io/projected/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-kube-api-access-9vckm\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:45.072910 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.072892 2544 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/577e9d4a-21ac-4bd4-9dcb-4c177906bcb4-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:45.764581 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.764550 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" Jun 02 20:11:45.764581 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.764561 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w" event={"ID":"577e9d4a-21ac-4bd4-9dcb-4c177906bcb4","Type":"ContainerDied","Data":"be0462619d94d9e543e55499aff86746d450c06df557776d977f8fd0a586fec2"} Jun 02 20:11:45.765020 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.764593 2544 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be0462619d94d9e543e55499aff86746d450c06df557776d977f8fd0a586fec2" Jun 02 20:11:45.924711 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.924692 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:45.929819 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.929797 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:45.957056 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.957031 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:45.979461 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979438 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gwl9\" (UniqueName: \"kubernetes.io/projected/d5be48cc-8436-47c6-bfbc-7709893656f5-kube-api-access-9gwl9\") pod \"d5be48cc-8436-47c6-bfbc-7709893656f5\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " Jun 02 20:11:45.979573 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979485 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-bundle\") pod \"d5be48cc-8436-47c6-bfbc-7709893656f5\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " Jun 02 20:11:45.979573 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979524 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpxvw\" (UniqueName: \"kubernetes.io/projected/545706f1-c651-439a-998c-c842c933cb1f-kube-api-access-qpxvw\") pod \"545706f1-c651-439a-998c-c842c933cb1f\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " Jun 02 20:11:45.979573 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979547 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-util\") pod \"d5be48cc-8436-47c6-bfbc-7709893656f5\" (UID: \"d5be48cc-8436-47c6-bfbc-7709893656f5\") " Jun 02 20:11:45.979749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979597 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-bundle\") pod \"4ba364c6-c3d6-43e4-83cf-f970456284f1\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " Jun 02 20:11:45.979749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979614 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxq9g\" (UniqueName: \"kubernetes.io/projected/4ba364c6-c3d6-43e4-83cf-f970456284f1-kube-api-access-hxq9g\") pod \"4ba364c6-c3d6-43e4-83cf-f970456284f1\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " Jun 02 20:11:45.979749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979684 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-util\") pod \"4ba364c6-c3d6-43e4-83cf-f970456284f1\" (UID: \"4ba364c6-c3d6-43e4-83cf-f970456284f1\") " Jun 02 20:11:45.979749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979702 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-util\") pod \"545706f1-c651-439a-998c-c842c933cb1f\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " Jun 02 20:11:45.979749 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.979722 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-bundle\") pod \"545706f1-c651-439a-998c-c842c933cb1f\" (UID: \"545706f1-c651-439a-998c-c842c933cb1f\") " Jun 02 20:11:45.980643 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.980084 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-bundle" (OuterVolumeSpecName: "bundle") pod "d5be48cc-8436-47c6-bfbc-7709893656f5" (UID: "d5be48cc-8436-47c6-bfbc-7709893656f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:11:45.980643 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.980606 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-bundle" (OuterVolumeSpecName: "bundle") pod "4ba364c6-c3d6-43e4-83cf-f970456284f1" (UID: "4ba364c6-c3d6-43e4-83cf-f970456284f1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:11:45.980941 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.980779 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-bundle" (OuterVolumeSpecName: "bundle") pod "545706f1-c651-439a-998c-c842c933cb1f" (UID: "545706f1-c651-439a-998c-c842c933cb1f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:11:45.982120 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.982087 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/545706f1-c651-439a-998c-c842c933cb1f-kube-api-access-qpxvw" (OuterVolumeSpecName: "kube-api-access-qpxvw") pod "545706f1-c651-439a-998c-c842c933cb1f" (UID: "545706f1-c651-439a-998c-c842c933cb1f"). InnerVolumeSpecName "kube-api-access-qpxvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:11:45.987066 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.984771 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba364c6-c3d6-43e4-83cf-f970456284f1-kube-api-access-hxq9g" (OuterVolumeSpecName: "kube-api-access-hxq9g") pod "4ba364c6-c3d6-43e4-83cf-f970456284f1" (UID: "4ba364c6-c3d6-43e4-83cf-f970456284f1"). InnerVolumeSpecName "kube-api-access-hxq9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:11:45.987066 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.984891 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5be48cc-8436-47c6-bfbc-7709893656f5-kube-api-access-9gwl9" (OuterVolumeSpecName: "kube-api-access-9gwl9") pod "d5be48cc-8436-47c6-bfbc-7709893656f5" (UID: "d5be48cc-8436-47c6-bfbc-7709893656f5"). InnerVolumeSpecName "kube-api-access-9gwl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:11:45.987233 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.987167 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-util" (OuterVolumeSpecName: "util") pod "d5be48cc-8436-47c6-bfbc-7709893656f5" (UID: "d5be48cc-8436-47c6-bfbc-7709893656f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:11:45.988022 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.988001 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-util" (OuterVolumeSpecName: "util") pod "545706f1-c651-439a-998c-c842c933cb1f" (UID: "545706f1-c651-439a-998c-c842c933cb1f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:11:45.988933 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:45.988906 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-util" (OuterVolumeSpecName: "util") pod "4ba364c6-c3d6-43e4-83cf-f970456284f1" (UID: "4ba364c6-c3d6-43e4-83cf-f970456284f1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:11:46.080575 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080520 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gwl9\" (UniqueName: \"kubernetes.io/projected/d5be48cc-8436-47c6-bfbc-7709893656f5-kube-api-access-9gwl9\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.080575 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080543 2544 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.080575 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080554 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpxvw\" (UniqueName: \"kubernetes.io/projected/545706f1-c651-439a-998c-c842c933cb1f-kube-api-access-qpxvw\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.080575 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080564 2544 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5be48cc-8436-47c6-bfbc-7709893656f5-util\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.080575 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080572 2544 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.080779 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080581 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxq9g\" (UniqueName: \"kubernetes.io/projected/4ba364c6-c3d6-43e4-83cf-f970456284f1-kube-api-access-hxq9g\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.080779 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080589 2544 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ba364c6-c3d6-43e4-83cf-f970456284f1-util\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.080779 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080597 2544 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-util\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.080779 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.080605 2544 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/545706f1-c651-439a-998c-c842c933cb1f-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:11:46.769508 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.769470 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" event={"ID":"545706f1-c651-439a-998c-c842c933cb1f","Type":"ContainerDied","Data":"b04266f24172349f2c48c13a7caf3a9ea2ace6f56cd2f5ac9454bae80998ebfd"} Jun 02 20:11:46.769508 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.769505 2544 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b04266f24172349f2c48c13a7caf3a9ea2ace6f56cd2f5ac9454bae80998ebfd" Jun 02 20:11:46.769508 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.769503 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb" Jun 02 20:11:46.771184 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.771163 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" event={"ID":"4ba364c6-c3d6-43e4-83cf-f970456284f1","Type":"ContainerDied","Data":"d52660d0e47cad893e5a5518e41fb941789bcdc16ddbd359a3dccb7ff6adacae"} Jun 02 20:11:46.771184 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.771174 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b" Jun 02 20:11:46.771184 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.771186 2544 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d52660d0e47cad893e5a5518e41fb941789bcdc16ddbd359a3dccb7ff6adacae" Jun 02 20:11:46.772804 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.772782 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" Jun 02 20:11:46.772804 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.772785 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6" event={"ID":"d5be48cc-8436-47c6-bfbc-7709893656f5","Type":"ContainerDied","Data":"3bd72a4817f49e4d6d6ae0e3fa3188d688ac0091abdb01f6428e359f851a33dd"} Jun 02 20:11:46.772930 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:46.772815 2544 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bd72a4817f49e4d6d6ae0e3fa3188d688ac0091abdb01f6428e359f851a33dd" Jun 02 20:11:51.026765 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.026736 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j"] Jun 02 20:11:51.032767 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.032725 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerName="util" Jun 02 20:11:51.033038 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033020 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerName="util" Jun 02 20:11:51.033099 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033046 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerName="pull" Jun 02 20:11:51.033099 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033055 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerName="pull" Jun 02 20:11:51.033099 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033068 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545706f1-c651-439a-998c-c842c933cb1f" containerName="util" Jun 02 20:11:51.033099 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033075 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="545706f1-c651-439a-998c-c842c933cb1f" containerName="util" Jun 02 20:11:51.033099 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033085 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerName="pull" Jun 02 20:11:51.033099 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033093 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerName="pull" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033103 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerName="extract" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033111 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerName="extract" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033128 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerName="util" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033136 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerName="util" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033150 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerName="pull" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033157 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerName="pull" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033181 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545706f1-c651-439a-998c-c842c933cb1f" containerName="pull" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033188 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="545706f1-c651-439a-998c-c842c933cb1f" containerName="pull" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033207 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545706f1-c651-439a-998c-c842c933cb1f" containerName="extract" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033214 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="545706f1-c651-439a-998c-c842c933cb1f" containerName="extract" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033223 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerName="extract" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033230 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerName="extract" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033244 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerName="util" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033252 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerName="util" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033260 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerName="extract" Jun 02 20:11:51.033347 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033267 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerName="extract" Jun 02 20:11:51.033796 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033366 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="577e9d4a-21ac-4bd4-9dcb-4c177906bcb4" containerName="extract" Jun 02 20:11:51.033796 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033377 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="4ba364c6-c3d6-43e4-83cf-f970456284f1" containerName="extract" Jun 02 20:11:51.033796 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033409 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="545706f1-c651-439a-998c-c842c933cb1f" containerName="extract" Jun 02 20:11:51.033796 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.033419 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="d5be48cc-8436-47c6-bfbc-7709893656f5" containerName="extract" Jun 02 20:11:51.038130 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.038109 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:11:51.039029 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.039006 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j"] Jun 02 20:11:51.040834 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.040807 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mb766\"" Jun 02 20:11:51.125918 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.125880 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmst9\" (UniqueName: \"kubernetes.io/projected/8ccd4635-50b3-486e-a899-ee86bcba8936-kube-api-access-wmst9\") pod \"limitador-operator-controller-manager-85c4996f8c-qvg8j\" (UID: \"8ccd4635-50b3-486e-a899-ee86bcba8936\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:11:51.227396 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.227350 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmst9\" (UniqueName: \"kubernetes.io/projected/8ccd4635-50b3-486e-a899-ee86bcba8936-kube-api-access-wmst9\") pod \"limitador-operator-controller-manager-85c4996f8c-qvg8j\" (UID: \"8ccd4635-50b3-486e-a899-ee86bcba8936\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:11:51.241271 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.241240 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmst9\" (UniqueName: \"kubernetes.io/projected/8ccd4635-50b3-486e-a899-ee86bcba8936-kube-api-access-wmst9\") pod \"limitador-operator-controller-manager-85c4996f8c-qvg8j\" (UID: \"8ccd4635-50b3-486e-a899-ee86bcba8936\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:11:51.348799 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.348725 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:11:51.479510 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.479488 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j"] Jun 02 20:11:51.481034 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:51.481009 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ccd4635_50b3_486e_a899_ee86bcba8936.slice/crio-fe4d59d4b69284cb572ffe5fc5d2a64b9d1a869846e846c1e87ccafcc866d34a WatchSource:0}: Error finding container fe4d59d4b69284cb572ffe5fc5d2a64b9d1a869846e846c1e87ccafcc866d34a: Status 404 returned error can't find the container with id fe4d59d4b69284cb572ffe5fc5d2a64b9d1a869846e846c1e87ccafcc866d34a Jun 02 20:11:51.792046 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:51.792008 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" event={"ID":"8ccd4635-50b3-486e-a899-ee86bcba8936","Type":"ContainerStarted","Data":"fe4d59d4b69284cb572ffe5fc5d2a64b9d1a869846e846c1e87ccafcc866d34a"} Jun 02 20:11:53.800035 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:53.800003 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" event={"ID":"8ccd4635-50b3-486e-a899-ee86bcba8936","Type":"ContainerStarted","Data":"f91676de6c8f43543ec7e679e11ce065bf7d1e152dbe8cb0a737c95a47827bab"} Jun 02 20:11:53.800433 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:53.800088 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:11:53.827165 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:53.827123 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" podStartSLOduration=2.017603362 podStartE2EDuration="3.827109026s" podCreationTimestamp="2026-06-02 20:11:50 +0000 UTC" firstStartedPulling="2026-06-02 20:11:51.482959323 +0000 UTC m=+583.229741958" lastFinishedPulling="2026-06-02 20:11:53.29246498 +0000 UTC m=+585.039247622" observedRunningTime="2026-06-02 20:11:53.825951879 +0000 UTC m=+585.572734535" watchObservedRunningTime="2026-06-02 20:11:53.827109026 +0000 UTC m=+585.573891682" Jun 02 20:11:58.391235 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.391199 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr"] Jun 02 20:11:58.396551 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.396524 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" Jun 02 20:11:58.399370 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.399349 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 20:11:58.399973 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.399956 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-c8skj\"" Jun 02 20:11:58.409642 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.409618 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr"] Jun 02 20:11:58.496295 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.496259 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2bqm\" (UniqueName: \"kubernetes.io/projected/8c23d293-4942-49ba-b641-b794113f3a24-kube-api-access-b2bqm\") pod \"dns-operator-controller-manager-648d5c98bc-jjgjr\" (UID: \"8c23d293-4942-49ba-b641-b794113f3a24\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" Jun 02 20:11:58.597104 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.597068 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2bqm\" (UniqueName: \"kubernetes.io/projected/8c23d293-4942-49ba-b641-b794113f3a24-kube-api-access-b2bqm\") pod \"dns-operator-controller-manager-648d5c98bc-jjgjr\" (UID: \"8c23d293-4942-49ba-b641-b794113f3a24\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" Jun 02 20:11:58.609077 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.609046 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2bqm\" (UniqueName: \"kubernetes.io/projected/8c23d293-4942-49ba-b641-b794113f3a24-kube-api-access-b2bqm\") pod \"dns-operator-controller-manager-648d5c98bc-jjgjr\" (UID: \"8c23d293-4942-49ba-b641-b794113f3a24\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" Jun 02 20:11:58.708222 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.708138 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" Jun 02 20:11:58.846331 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:58.846303 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr"] Jun 02 20:11:58.847813 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:11:58.847791 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c23d293_4942_49ba_b641_b794113f3a24.slice/crio-ff42060f3272c881eecc04389e237642278f22fa7eb88b7310e4905bc500206d WatchSource:0}: Error finding container ff42060f3272c881eecc04389e237642278f22fa7eb88b7310e4905bc500206d: Status 404 returned error can't find the container with id ff42060f3272c881eecc04389e237642278f22fa7eb88b7310e4905bc500206d Jun 02 20:11:59.822305 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:11:59.822261 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" event={"ID":"8c23d293-4942-49ba-b641-b794113f3a24","Type":"ContainerStarted","Data":"ff42060f3272c881eecc04389e237642278f22fa7eb88b7310e4905bc500206d"} Jun 02 20:12:01.830578 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:01.830535 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" event={"ID":"8c23d293-4942-49ba-b641-b794113f3a24","Type":"ContainerStarted","Data":"3c47440b77432d24d359f2fb864baaed2fc529190e9b25b2b2c0fd0aaa3038b9"} Jun 02 20:12:01.830976 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:01.830710 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" Jun 02 20:12:01.849872 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:01.849820 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" podStartSLOduration=1.518492031 podStartE2EDuration="3.84980668s" podCreationTimestamp="2026-06-02 20:11:58 +0000 UTC" firstStartedPulling="2026-06-02 20:11:58.850104965 +0000 UTC m=+590.596887603" lastFinishedPulling="2026-06-02 20:12:01.181419604 +0000 UTC m=+592.928202252" observedRunningTime="2026-06-02 20:12:01.847975711 +0000 UTC m=+593.594758368" watchObservedRunningTime="2026-06-02 20:12:01.84980668 +0000 UTC m=+593.596589337" Jun 02 20:12:03.091011 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.090975 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5"] Jun 02 20:12:03.136185 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.136154 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5"] Jun 02 20:12:03.136376 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.136289 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:03.140483 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.140461 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9zl24\"" Jun 02 20:12:03.246090 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.246054 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2njj5\" (UniqueName: \"kubernetes.io/projected/d6322734-e70a-4b11-80cb-ec42de603307-kube-api-access-2njj5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" (UID: \"d6322734-e70a-4b11-80cb-ec42de603307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:03.246235 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.246176 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6322734-e70a-4b11-80cb-ec42de603307-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" (UID: \"d6322734-e70a-4b11-80cb-ec42de603307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:03.347118 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.347037 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6322734-e70a-4b11-80cb-ec42de603307-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" (UID: \"d6322734-e70a-4b11-80cb-ec42de603307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:03.347118 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.347098 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2njj5\" (UniqueName: \"kubernetes.io/projected/d6322734-e70a-4b11-80cb-ec42de603307-kube-api-access-2njj5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" (UID: \"d6322734-e70a-4b11-80cb-ec42de603307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:03.347421 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.347377 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6322734-e70a-4b11-80cb-ec42de603307-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" (UID: \"d6322734-e70a-4b11-80cb-ec42de603307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:03.356343 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.356321 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2njj5\" (UniqueName: \"kubernetes.io/projected/d6322734-e70a-4b11-80cb-ec42de603307-kube-api-access-2njj5\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" (UID: \"d6322734-e70a-4b11-80cb-ec42de603307\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:03.446553 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.446521 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:03.578293 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.578269 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5"] Jun 02 20:12:03.580353 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:12:03.580325 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6322734_e70a_4b11_80cb_ec42de603307.slice/crio-7e5f520cb84d52272787a5d00875be315d34cfb81df1b4b915942479b19e95f7 WatchSource:0}: Error finding container 7e5f520cb84d52272787a5d00875be315d34cfb81df1b4b915942479b19e95f7: Status 404 returned error can't find the container with id 7e5f520cb84d52272787a5d00875be315d34cfb81df1b4b915942479b19e95f7 Jun 02 20:12:03.839174 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:03.839135 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" event={"ID":"d6322734-e70a-4b11-80cb-ec42de603307","Type":"ContainerStarted","Data":"7e5f520cb84d52272787a5d00875be315d34cfb81df1b4b915942479b19e95f7"} Jun 02 20:12:04.787167 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:04.787112 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-ddccc699-d2x86" podUID="5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" containerName="console" containerID="cri-o://d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48" gracePeriod=15 Jun 02 20:12:04.804770 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:04.804751 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:12:04.916448 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:04.916418 2544 patch_prober.go:28] interesting pod/console-ddccc699-d2x86 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.25:8443/health\": dial tcp 10.134.0.25:8443: connect: connection refused" start-of-body= Jun 02 20:12:04.916565 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:04.916470 2544 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-ddccc699-d2x86" podUID="5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" containerName="console" probeResult="failure" output="Get \"https://10.134.0.25:8443/health\": dial tcp 10.134.0.25:8443: connect: connection refused" Jun 02 20:12:05.051293 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.051236 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-ddccc699-d2x86_5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63/console/0.log" Jun 02 20:12:05.051432 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.051307 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:12:05.163010 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.162986 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-trusted-ca-bundle\") pod \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " Jun 02 20:12:05.163163 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163024 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-oauth-serving-cert\") pod \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " Jun 02 20:12:05.163163 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163041 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-service-ca\") pod \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " Jun 02 20:12:05.163266 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163230 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-config\") pod \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " Jun 02 20:12:05.163309 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163289 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cx4s\" (UniqueName: \"kubernetes.io/projected/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-kube-api-access-2cx4s\") pod \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " Jun 02 20:12:05.163363 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163348 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-oauth-config\") pod \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " Jun 02 20:12:05.163427 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163374 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-service-ca" (OuterVolumeSpecName: "service-ca") pod "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" (UID: "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:12:05.163427 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163407 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" (UID: "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:12:05.163427 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163422 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-serving-cert\") pod \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\" (UID: \"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63\") " Jun 02 20:12:05.163613 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163590 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" (UID: "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:12:05.163668 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163636 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-config" (OuterVolumeSpecName: "console-config") pod "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" (UID: "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:12:05.163710 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163691 2544 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-trusted-ca-bundle\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:05.163710 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163702 2544 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-oauth-serving-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:05.163772 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163717 2544 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-service-ca\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:05.163772 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.163730 2544 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:05.165404 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.165364 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" (UID: "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:12:05.165499 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.165435 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-kube-api-access-2cx4s" (OuterVolumeSpecName: "kube-api-access-2cx4s") pod "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" (UID: "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63"). InnerVolumeSpecName "kube-api-access-2cx4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:12:05.165499 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.165466 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" (UID: "5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:12:05.264760 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.264728 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cx4s\" (UniqueName: \"kubernetes.io/projected/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-kube-api-access-2cx4s\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:05.264760 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.264756 2544 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-oauth-config\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:05.264760 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.264767 2544 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63-console-serving-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:05.848926 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.848901 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-ddccc699-d2x86_5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63/console/0.log" Jun 02 20:12:05.849303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.848943 2544 generic.go:358] "Generic (PLEG): container finished" podID="5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" containerID="d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48" exitCode=2 Jun 02 20:12:05.849303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.849015 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ddccc699-d2x86" Jun 02 20:12:05.849303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.849031 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddccc699-d2x86" event={"ID":"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63","Type":"ContainerDied","Data":"d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48"} Jun 02 20:12:05.849303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.849070 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ddccc699-d2x86" event={"ID":"5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63","Type":"ContainerDied","Data":"bba7499433e0eb6cf5f28b5565e01265b0617fc16c2b6bb308ab5040ec136216"} Jun 02 20:12:05.849303 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.849085 2544 scope.go:117] "RemoveContainer" containerID="d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48" Jun 02 20:12:05.857882 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.857867 2544 scope.go:117] "RemoveContainer" containerID="d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48" Jun 02 20:12:05.858116 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:12:05.858100 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48\": container with ID starting with d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48 not found: ID does not exist" containerID="d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48" Jun 02 20:12:05.858156 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.858125 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48"} err="failed to get container status \"d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48\": rpc error: code = NotFound desc = could not find container \"d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48\": container with ID starting with d772bd6549506011cb7d07f89bb1f493e59beaaf7ec48f8681701b0e9a161a48 not found: ID does not exist" Jun 02 20:12:05.873911 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.873890 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ddccc699-d2x86"] Jun 02 20:12:05.878631 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:05.878611 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ddccc699-d2x86"] Jun 02 20:12:06.824171 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:06.824138 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" path="/var/lib/kubelet/pods/5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63/volumes" Jun 02 20:12:09.475728 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:09.475706 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:12:09.476067 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:09.475767 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:12:09.866101 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:09.866009 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" event={"ID":"d6322734-e70a-4b11-80cb-ec42de603307","Type":"ContainerStarted","Data":"437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627"} Jun 02 20:12:09.866101 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:09.866077 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:09.889113 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:09.889067 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" podStartSLOduration=0.984553644 podStartE2EDuration="6.889054244s" podCreationTimestamp="2026-06-02 20:12:03 +0000 UTC" firstStartedPulling="2026-06-02 20:12:03.582962168 +0000 UTC m=+595.329744817" lastFinishedPulling="2026-06-02 20:12:09.487462782 +0000 UTC m=+601.234245417" observedRunningTime="2026-06-02 20:12:09.88577753 +0000 UTC m=+601.632560210" watchObservedRunningTime="2026-06-02 20:12:09.889054244 +0000 UTC m=+601.635836901" Jun 02 20:12:12.836441 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:12.836408 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-jjgjr" Jun 02 20:12:20.871679 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:20.871646 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:21.969877 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:21.969846 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx"] Jun 02 20:12:21.970271 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:21.970256 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" containerName="console" Jun 02 20:12:21.970271 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:21.970272 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" containerName="console" Jun 02 20:12:21.970349 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:21.970333 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="5eb67e9b-b3d2-4cb0-8ab3-b2d537a38e63" containerName="console" Jun 02 20:12:21.973681 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:21.973663 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:21.996115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:21.996087 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx"] Jun 02 20:12:22.104863 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.104833 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" (UID: \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:22.105008 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.104870 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf6hj\" (UniqueName: \"kubernetes.io/projected/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-kube-api-access-wf6hj\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" (UID: \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:22.205892 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.205863 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" (UID: \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:22.206003 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.205897 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wf6hj\" (UniqueName: \"kubernetes.io/projected/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-kube-api-access-wf6hj\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" (UID: \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:22.206201 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.206183 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" (UID: \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:22.214238 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.214213 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf6hj\" (UniqueName: \"kubernetes.io/projected/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-kube-api-access-wf6hj\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" (UID: \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:22.283567 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.283498 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:22.411560 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.411535 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx"] Jun 02 20:12:22.413655 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:12:22.413624 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3c48a8_30e6_403b_ab31_ce65a8a80e6a.slice/crio-4dc51831f5d6f6d8e495f41e3286a04ab72a70ced8c8625cc20666a3a58b4703 WatchSource:0}: Error finding container 4dc51831f5d6f6d8e495f41e3286a04ab72a70ced8c8625cc20666a3a58b4703: Status 404 returned error can't find the container with id 4dc51831f5d6f6d8e495f41e3286a04ab72a70ced8c8625cc20666a3a58b4703 Jun 02 20:12:22.620987 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.620916 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5"] Jun 02 20:12:22.621194 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.621169 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" podUID="d6322734-e70a-4b11-80cb-ec42de603307" containerName="manager" containerID="cri-o://437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627" gracePeriod=2 Jun 02 20:12:22.625633 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.625604 2544 status_manager.go:895] "Failed to get status for pod" podUID="d6322734-e70a-4b11-80cb-ec42de603307" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" is forbidden: User \"system:node:ip-10-0-137-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-123.ec2.internal' and this object" Jun 02 20:12:22.627891 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.627866 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5"] Jun 02 20:12:22.638500 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.638480 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx"] Jun 02 20:12:22.647745 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.647724 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5"] Jun 02 20:12:22.648483 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.648465 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6322734-e70a-4b11-80cb-ec42de603307" containerName="manager" Jun 02 20:12:22.648576 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.648499 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6322734-e70a-4b11-80cb-ec42de603307" containerName="manager" Jun 02 20:12:22.649343 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.648677 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6322734-e70a-4b11-80cb-ec42de603307" containerName="manager" Jun 02 20:12:22.651253 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.651236 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx"] Jun 02 20:12:22.651340 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.651334 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:22.653603 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.653581 2544 status_manager.go:895] "Failed to get status for pod" podUID="d6322734-e70a-4b11-80cb-ec42de603307" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" is forbidden: User \"system:node:ip-10-0-137-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-123.ec2.internal' and this object" Jun 02 20:12:22.658699 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.658673 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg"] Jun 02 20:12:22.659012 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.658998 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" containerName="manager" Jun 02 20:12:22.659059 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.659015 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" containerName="manager" Jun 02 20:12:22.659093 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.659072 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" containerName="manager" Jun 02 20:12:22.663101 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.663083 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:22.665571 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.665546 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5"] Jun 02 20:12:22.668427 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.668403 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j"] Jun 02 20:12:22.668681 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.668657 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" podUID="8ccd4635-50b3-486e-a899-ee86bcba8936" containerName="manager" containerID="cri-o://f91676de6c8f43543ec7e679e11ce065bf7d1e152dbe8cb0a737c95a47827bab" gracePeriod=2 Jun 02 20:12:22.681191 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.681170 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg"] Jun 02 20:12:22.683043 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.682998 2544 status_manager.go:895] "Failed to get status for pod" podUID="d6322734-e70a-4b11-80cb-ec42de603307" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-rblw5\" is forbidden: User \"system:node:ip-10-0-137-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-123.ec2.internal' and this object" Jun 02 20:12:22.684076 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.684056 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j"] Jun 02 20:12:22.709376 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.709348 2544 status_manager.go:895] "Failed to get status for pod" podUID="8ccd4635-50b3-486e-a899-ee86bcba8936" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" err="pods \"limitador-operator-controller-manager-85c4996f8c-qvg8j\" is forbidden: User \"system:node:ip-10-0-137-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-123.ec2.internal' and this object" Jun 02 20:12:22.811468 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.811438 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24drg\" (UID: \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:22.811644 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.811587 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzwlw\" (UniqueName: \"kubernetes.io/projected/484687cc-1307-407e-9a80-5bb8fc578063-kube-api-access-fzwlw\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pr5b5\" (UID: \"484687cc-1307-407e-9a80-5bb8fc578063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:22.811644 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.811637 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484687cc-1307-407e-9a80-5bb8fc578063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pr5b5\" (UID: \"484687cc-1307-407e-9a80-5bb8fc578063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:22.811754 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.811677 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvm4r\" (UniqueName: \"kubernetes.io/projected/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-kube-api-access-lvm4r\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24drg\" (UID: \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:22.912117 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.912091 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:22.912362 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.912336 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fzwlw\" (UniqueName: \"kubernetes.io/projected/484687cc-1307-407e-9a80-5bb8fc578063-kube-api-access-fzwlw\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pr5b5\" (UID: \"484687cc-1307-407e-9a80-5bb8fc578063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:22.912469 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.912413 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484687cc-1307-407e-9a80-5bb8fc578063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pr5b5\" (UID: \"484687cc-1307-407e-9a80-5bb8fc578063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:22.912469 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.912457 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvm4r\" (UniqueName: \"kubernetes.io/projected/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-kube-api-access-lvm4r\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24drg\" (UID: \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:22.912599 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.912522 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24drg\" (UID: \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:22.912926 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.912896 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24drg\" (UID: \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:22.913298 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.913262 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484687cc-1307-407e-9a80-5bb8fc578063-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pr5b5\" (UID: \"484687cc-1307-407e-9a80-5bb8fc578063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:22.913722 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.913699 2544 generic.go:358] "Generic (PLEG): container finished" podID="8ccd4635-50b3-486e-a899-ee86bcba8936" containerID="f91676de6c8f43543ec7e679e11ce065bf7d1e152dbe8cb0a737c95a47827bab" exitCode=0 Jun 02 20:12:22.915467 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:12:22.915446 2544 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" container="manager" Jun 02 20:12:22.916558 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.916527 2544 generic.go:358] "Generic (PLEG): container finished" podID="d6322734-e70a-4b11-80cb-ec42de603307" containerID="437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627" exitCode=0 Jun 02 20:12:22.916667 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.916565 2544 scope.go:117] "RemoveContainer" containerID="437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627" Jun 02 20:12:22.916667 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.916570 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-rblw5" Jun 02 20:12:22.921882 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.921857 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:12:22.925783 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.925681 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvm4r\" (UniqueName: \"kubernetes.io/projected/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-kube-api-access-lvm4r\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-24drg\" (UID: \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:22.925846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.925801 2544 scope.go:117] "RemoveContainer" containerID="437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627" Jun 02 20:12:22.925846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.925826 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzwlw\" (UniqueName: \"kubernetes.io/projected/484687cc-1307-407e-9a80-5bb8fc578063-kube-api-access-fzwlw\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pr5b5\" (UID: \"484687cc-1307-407e-9a80-5bb8fc578063\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:22.926085 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:12:22.926064 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627\": container with ID starting with 437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627 not found: ID does not exist" containerID="437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627" Jun 02 20:12:22.926145 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:22.926094 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627"} err="failed to get container status \"437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627\": rpc error: code = NotFound desc = could not find container \"437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627\": container with ID starting with 437ec136f2e06841004ec0bff3124137f831808728ae0d26cb3fbe2226430627 not found: ID does not exist" Jun 02 20:12:23.013212 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.013184 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6322734-e70a-4b11-80cb-ec42de603307-extensions-socket-volume\") pod \"d6322734-e70a-4b11-80cb-ec42de603307\" (UID: \"d6322734-e70a-4b11-80cb-ec42de603307\") " Jun 02 20:12:23.013536 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.013220 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2njj5\" (UniqueName: \"kubernetes.io/projected/d6322734-e70a-4b11-80cb-ec42de603307-kube-api-access-2njj5\") pod \"d6322734-e70a-4b11-80cb-ec42de603307\" (UID: \"d6322734-e70a-4b11-80cb-ec42de603307\") " Jun 02 20:12:23.013536 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.013328 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmst9\" (UniqueName: \"kubernetes.io/projected/8ccd4635-50b3-486e-a899-ee86bcba8936-kube-api-access-wmst9\") pod \"8ccd4635-50b3-486e-a899-ee86bcba8936\" (UID: \"8ccd4635-50b3-486e-a899-ee86bcba8936\") " Jun 02 20:12:23.013736 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.013706 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6322734-e70a-4b11-80cb-ec42de603307-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d6322734-e70a-4b11-80cb-ec42de603307" (UID: "d6322734-e70a-4b11-80cb-ec42de603307"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:12:23.015194 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.015173 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6322734-e70a-4b11-80cb-ec42de603307-kube-api-access-2njj5" (OuterVolumeSpecName: "kube-api-access-2njj5") pod "d6322734-e70a-4b11-80cb-ec42de603307" (UID: "d6322734-e70a-4b11-80cb-ec42de603307"). InnerVolumeSpecName "kube-api-access-2njj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:12:23.015277 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.015187 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ccd4635-50b3-486e-a899-ee86bcba8936-kube-api-access-wmst9" (OuterVolumeSpecName: "kube-api-access-wmst9") pod "8ccd4635-50b3-486e-a899-ee86bcba8936" (UID: "8ccd4635-50b3-486e-a899-ee86bcba8936"). InnerVolumeSpecName "kube-api-access-wmst9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:12:23.046510 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.046478 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:23.052119 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.052096 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:23.115144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.115101 2544 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6322734-e70a-4b11-80cb-ec42de603307-extensions-socket-volume\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:23.115144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.115137 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2njj5\" (UniqueName: \"kubernetes.io/projected/d6322734-e70a-4b11-80cb-ec42de603307-kube-api-access-2njj5\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:23.115335 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.115158 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmst9\" (UniqueName: \"kubernetes.io/projected/8ccd4635-50b3-486e-a899-ee86bcba8936-kube-api-access-wmst9\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:23.191045 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.191016 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5"] Jun 02 20:12:23.191979 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:12:23.191952 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484687cc_1307_407e_9a80_5bb8fc578063.slice/crio-f9c02a044064b4f02b6bb1d9d7f0b36279b8fd616d99acc014b2de13c231e39f WatchSource:0}: Error finding container f9c02a044064b4f02b6bb1d9d7f0b36279b8fd616d99acc014b2de13c231e39f: Status 404 returned error can't find the container with id f9c02a044064b4f02b6bb1d9d7f0b36279b8fd616d99acc014b2de13c231e39f Jun 02 20:12:23.211011 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.210988 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg"] Jun 02 20:12:23.211638 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:12:23.211607 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd027ac67_09d4_4b17_86e8_b2ff8c8f2be3.slice/crio-d0ed56704d15f8b9a209535f1353f2de37521fdfe68ebcd214692d5f705d35bd WatchSource:0}: Error finding container d0ed56704d15f8b9a209535f1353f2de37521fdfe68ebcd214692d5f705d35bd: Status 404 returned error can't find the container with id d0ed56704d15f8b9a209535f1353f2de37521fdfe68ebcd214692d5f705d35bd Jun 02 20:12:23.921370 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.921329 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" event={"ID":"484687cc-1307-407e-9a80-5bb8fc578063","Type":"ContainerStarted","Data":"0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e"} Jun 02 20:12:23.921576 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.921376 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" event={"ID":"484687cc-1307-407e-9a80-5bb8fc578063","Type":"ContainerStarted","Data":"f9c02a044064b4f02b6bb1d9d7f0b36279b8fd616d99acc014b2de13c231e39f"} Jun 02 20:12:23.921576 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.921493 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:23.922561 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.922537 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qvg8j" Jun 02 20:12:23.922693 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.922564 2544 scope.go:117] "RemoveContainer" containerID="f91676de6c8f43543ec7e679e11ce065bf7d1e152dbe8cb0a737c95a47827bab" Jun 02 20:12:23.924282 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.924256 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" podUID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" containerName="manager" containerID="cri-o://de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f" gracePeriod=2 Jun 02 20:12:23.926961 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.926937 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" event={"ID":"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3","Type":"ContainerStarted","Data":"314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7"} Jun 02 20:12:23.927074 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.926967 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" event={"ID":"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3","Type":"ContainerStarted","Data":"d0ed56704d15f8b9a209535f1353f2de37521fdfe68ebcd214692d5f705d35bd"} Jun 02 20:12:23.927124 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.927080 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:23.948689 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.948650 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" podStartSLOduration=1.948638101 podStartE2EDuration="1.948638101s" podCreationTimestamp="2026-06-02 20:12:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:12:23.944953223 +0000 UTC m=+615.691735882" watchObservedRunningTime="2026-06-02 20:12:23.948638101 +0000 UTC m=+615.695420760" Jun 02 20:12:23.977986 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.977945 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" podStartSLOduration=1.977933583 podStartE2EDuration="1.977933583s" podCreationTimestamp="2026-06-02 20:12:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:12:23.976273253 +0000 UTC m=+615.723055911" watchObservedRunningTime="2026-06-02 20:12:23.977933583 +0000 UTC m=+615.724716240" Jun 02 20:12:23.979165 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:23.979139 2544 status_manager.go:895] "Failed to get status for pod" podUID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" is forbidden: User \"system:node:ip-10-0-137-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-123.ec2.internal' and this object" Jun 02 20:12:24.164023 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.164002 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:24.166444 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.166419 2544 status_manager.go:895] "Failed to get status for pod" podUID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" is forbidden: User \"system:node:ip-10-0-137-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-123.ec2.internal' and this object" Jun 02 20:12:24.326318 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.326256 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-extensions-socket-volume\") pod \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\" (UID: \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\") " Jun 02 20:12:24.326463 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.326418 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf6hj\" (UniqueName: \"kubernetes.io/projected/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-kube-api-access-wf6hj\") pod \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\" (UID: \"db3c48a8-30e6-403b-ab31-ce65a8a80e6a\") " Jun 02 20:12:24.326529 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.326509 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "db3c48a8-30e6-403b-ab31-ce65a8a80e6a" (UID: "db3c48a8-30e6-403b-ab31-ce65a8a80e6a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:12:24.326679 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.326659 2544 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-extensions-socket-volume\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:24.328374 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.328346 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-kube-api-access-wf6hj" (OuterVolumeSpecName: "kube-api-access-wf6hj") pod "db3c48a8-30e6-403b-ab31-ce65a8a80e6a" (UID: "db3c48a8-30e6-403b-ab31-ce65a8a80e6a"). InnerVolumeSpecName "kube-api-access-wf6hj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:12:24.427605 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.427576 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf6hj\" (UniqueName: \"kubernetes.io/projected/db3c48a8-30e6-403b-ab31-ce65a8a80e6a-kube-api-access-wf6hj\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:24.823573 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.823547 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ccd4635-50b3-486e-a899-ee86bcba8936" path="/var/lib/kubelet/pods/8ccd4635-50b3-486e-a899-ee86bcba8936/volumes" Jun 02 20:12:24.823931 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.823917 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6322734-e70a-4b11-80cb-ec42de603307" path="/var/lib/kubelet/pods/d6322734-e70a-4b11-80cb-ec42de603307/volumes" Jun 02 20:12:24.824268 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.824256 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" path="/var/lib/kubelet/pods/db3c48a8-30e6-403b-ab31-ce65a8a80e6a/volumes" Jun 02 20:12:24.938305 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.938276 2544 generic.go:358] "Generic (PLEG): container finished" podID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" containerID="de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f" exitCode=2 Jun 02 20:12:24.938466 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.938343 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" Jun 02 20:12:24.938466 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.938371 2544 scope.go:117] "RemoveContainer" containerID="de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f" Jun 02 20:12:24.942880 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.942851 2544 status_manager.go:895] "Failed to get status for pod" podUID="db3c48a8-30e6-403b-ab31-ce65a8a80e6a" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-44vfx" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-44vfx\" is forbidden: User \"system:node:ip-10-0-137-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-123.ec2.internal' and this object" Jun 02 20:12:24.947070 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.947054 2544 scope.go:117] "RemoveContainer" containerID="de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f" Jun 02 20:12:24.947265 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:12:24.947249 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f\": container with ID starting with de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f not found: ID does not exist" containerID="de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f" Jun 02 20:12:24.947314 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:24.947271 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f"} err="failed to get container status \"de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f\": rpc error: code = NotFound desc = could not find container \"de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f\": container with ID starting with de59ecad716a3dff63209abd232bce268b21ae32d34bc32c978a847203f3399f not found: ID does not exist" Jun 02 20:12:34.940886 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:34.940857 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:34.942407 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:34.940910 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:35.026007 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.025940 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5"] Jun 02 20:12:35.026283 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.026258 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" podUID="484687cc-1307-407e-9a80-5bb8fc578063" containerName="manager" containerID="cri-o://0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e" gracePeriod=10 Jun 02 20:12:35.270779 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.270754 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:35.309487 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.309458 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzwlw\" (UniqueName: \"kubernetes.io/projected/484687cc-1307-407e-9a80-5bb8fc578063-kube-api-access-fzwlw\") pod \"484687cc-1307-407e-9a80-5bb8fc578063\" (UID: \"484687cc-1307-407e-9a80-5bb8fc578063\") " Jun 02 20:12:35.309615 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.309509 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484687cc-1307-407e-9a80-5bb8fc578063-extensions-socket-volume\") pod \"484687cc-1307-407e-9a80-5bb8fc578063\" (UID: \"484687cc-1307-407e-9a80-5bb8fc578063\") " Jun 02 20:12:35.309963 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.309936 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/484687cc-1307-407e-9a80-5bb8fc578063-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "484687cc-1307-407e-9a80-5bb8fc578063" (UID: "484687cc-1307-407e-9a80-5bb8fc578063"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:12:35.311847 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.311820 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484687cc-1307-407e-9a80-5bb8fc578063-kube-api-access-fzwlw" (OuterVolumeSpecName: "kube-api-access-fzwlw") pod "484687cc-1307-407e-9a80-5bb8fc578063" (UID: "484687cc-1307-407e-9a80-5bb8fc578063"). InnerVolumeSpecName "kube-api-access-fzwlw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:12:35.340865 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.340842 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj"] Jun 02 20:12:35.341214 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.341202 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="484687cc-1307-407e-9a80-5bb8fc578063" containerName="manager" Jun 02 20:12:35.341258 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.341216 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="484687cc-1307-407e-9a80-5bb8fc578063" containerName="manager" Jun 02 20:12:35.341258 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.341225 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccd4635-50b3-486e-a899-ee86bcba8936" containerName="manager" Jun 02 20:12:35.341258 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.341231 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccd4635-50b3-486e-a899-ee86bcba8936" containerName="manager" Jun 02 20:12:35.341352 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.341305 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ccd4635-50b3-486e-a899-ee86bcba8936" containerName="manager" Jun 02 20:12:35.341352 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.341313 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="484687cc-1307-407e-9a80-5bb8fc578063" containerName="manager" Jun 02 20:12:35.354968 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.354945 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.357678 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.357655 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj"] Jun 02 20:12:35.410870 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.410840 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf9qj\" (UID: \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.411018 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.411001 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpc7d\" (UniqueName: \"kubernetes.io/projected/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-kube-api-access-gpc7d\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf9qj\" (UID: \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.411092 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.411076 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzwlw\" (UniqueName: \"kubernetes.io/projected/484687cc-1307-407e-9a80-5bb8fc578063-kube-api-access-fzwlw\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:35.411132 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.411095 2544 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/484687cc-1307-407e-9a80-5bb8fc578063-extensions-socket-volume\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:35.511615 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.511560 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpc7d\" (UniqueName: \"kubernetes.io/projected/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-kube-api-access-gpc7d\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf9qj\" (UID: \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.511615 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.511616 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf9qj\" (UID: \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.511969 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.511950 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf9qj\" (UID: \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.520814 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.520784 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpc7d\" (UniqueName: \"kubernetes.io/projected/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-kube-api-access-gpc7d\") pod \"kuadrant-operator-controller-manager-55c7f4c975-cf9qj\" (UID: \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.666061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.666039 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.795642 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.795616 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj"] Jun 02 20:12:35.797083 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:12:35.797057 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a288fa_d8c1_4e4a_80c7_cda259ea37b2.slice/crio-9fe30f649771bc3e4d9d11df2447f91634bcafc8c7cf220499d2574731e4a3e7 WatchSource:0}: Error finding container 9fe30f649771bc3e4d9d11df2447f91634bcafc8c7cf220499d2574731e4a3e7: Status 404 returned error can't find the container with id 9fe30f649771bc3e4d9d11df2447f91634bcafc8c7cf220499d2574731e4a3e7 Jun 02 20:12:35.799298 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.799282 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:12:35.983135 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.983095 2544 generic.go:358] "Generic (PLEG): container finished" podID="484687cc-1307-407e-9a80-5bb8fc578063" containerID="0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e" exitCode=0 Jun 02 20:12:35.983556 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.983162 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" Jun 02 20:12:35.983556 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.983181 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" event={"ID":"484687cc-1307-407e-9a80-5bb8fc578063","Type":"ContainerDied","Data":"0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e"} Jun 02 20:12:35.983556 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.983229 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5" event={"ID":"484687cc-1307-407e-9a80-5bb8fc578063","Type":"ContainerDied","Data":"f9c02a044064b4f02b6bb1d9d7f0b36279b8fd616d99acc014b2de13c231e39f"} Jun 02 20:12:35.983556 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.983252 2544 scope.go:117] "RemoveContainer" containerID="0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e" Jun 02 20:12:35.984849 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.984827 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" event={"ID":"47a288fa-d8c1-4e4a-80c7-cda259ea37b2","Type":"ContainerStarted","Data":"54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00"} Jun 02 20:12:35.984981 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.984854 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" event={"ID":"47a288fa-d8c1-4e4a-80c7-cda259ea37b2","Type":"ContainerStarted","Data":"9fe30f649771bc3e4d9d11df2447f91634bcafc8c7cf220499d2574731e4a3e7"} Jun 02 20:12:35.984981 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.984968 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:35.992142 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.992125 2544 scope.go:117] "RemoveContainer" containerID="0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e" Jun 02 20:12:35.992411 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:12:35.992372 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e\": container with ID starting with 0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e not found: ID does not exist" containerID="0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e" Jun 02 20:12:35.992502 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:35.992416 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e"} err="failed to get container status \"0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e\": rpc error: code = NotFound desc = could not find container \"0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e\": container with ID starting with 0464c99641fa91b53a8ff845c8bfb3ecc1255eeb4ee3e6ab091b3883ed1b654e not found: ID does not exist" Jun 02 20:12:36.015924 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:36.015879 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" podStartSLOduration=1.015868643 podStartE2EDuration="1.015868643s" podCreationTimestamp="2026-06-02 20:12:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:12:36.013642422 +0000 UTC m=+627.760425080" watchObservedRunningTime="2026-06-02 20:12:36.015868643 +0000 UTC m=+627.762651299" Jun 02 20:12:36.027844 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:36.027806 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5"] Jun 02 20:12:36.038787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:36.038764 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pr5b5"] Jun 02 20:12:36.824510 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:36.824479 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="484687cc-1307-407e-9a80-5bb8fc578063" path="/var/lib/kubelet/pods/484687cc-1307-407e-9a80-5bb8fc578063/volumes" Jun 02 20:12:46.992516 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:46.992488 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:12:47.051193 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.051160 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg"] Jun 02 20:12:47.051464 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.051426 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" podUID="d027ac67-09d4-4b17-86e8-b2ff8c8f2be3" containerName="manager" containerID="cri-o://314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7" gracePeriod=10 Jun 02 20:12:47.296645 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.296624 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:47.406496 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.406473 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvm4r\" (UniqueName: \"kubernetes.io/projected/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-kube-api-access-lvm4r\") pod \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\" (UID: \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\") " Jun 02 20:12:47.406651 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.406532 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-extensions-socket-volume\") pod \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\" (UID: \"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3\") " Jun 02 20:12:47.406960 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.406934 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d027ac67-09d4-4b17-86e8-b2ff8c8f2be3" (UID: "d027ac67-09d4-4b17-86e8-b2ff8c8f2be3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:12:47.408436 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.408415 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-kube-api-access-lvm4r" (OuterVolumeSpecName: "kube-api-access-lvm4r") pod "d027ac67-09d4-4b17-86e8-b2ff8c8f2be3" (UID: "d027ac67-09d4-4b17-86e8-b2ff8c8f2be3"). InnerVolumeSpecName "kube-api-access-lvm4r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:12:47.508083 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.508059 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvm4r\" (UniqueName: \"kubernetes.io/projected/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-kube-api-access-lvm4r\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:47.508083 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:47.508081 2544 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3-extensions-socket-volume\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:12:48.035513 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.035478 2544 generic.go:358] "Generic (PLEG): container finished" podID="d027ac67-09d4-4b17-86e8-b2ff8c8f2be3" containerID="314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7" exitCode=0 Jun 02 20:12:48.035913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.035548 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" Jun 02 20:12:48.035913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.035567 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" event={"ID":"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3","Type":"ContainerDied","Data":"314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7"} Jun 02 20:12:48.035913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.035618 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg" event={"ID":"d027ac67-09d4-4b17-86e8-b2ff8c8f2be3","Type":"ContainerDied","Data":"d0ed56704d15f8b9a209535f1353f2de37521fdfe68ebcd214692d5f705d35bd"} Jun 02 20:12:48.035913 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.035642 2544 scope.go:117] "RemoveContainer" containerID="314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7" Jun 02 20:12:48.043753 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.043738 2544 scope.go:117] "RemoveContainer" containerID="314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7" Jun 02 20:12:48.043998 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:12:48.043979 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7\": container with ID starting with 314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7 not found: ID does not exist" containerID="314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7" Jun 02 20:12:48.044054 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.044008 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7"} err="failed to get container status \"314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7\": rpc error: code = NotFound desc = could not find container \"314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7\": container with ID starting with 314cba0a969e33f3cf0c1c148e7014be148a1fc45260f88eb29bee0c3c00f4b7 not found: ID does not exist" Jun 02 20:12:48.061234 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.061210 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg"] Jun 02 20:12:48.064792 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.064771 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-24drg"] Jun 02 20:12:48.824660 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:48.824621 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d027ac67-09d4-4b17-86e8-b2ff8c8f2be3" path="/var/lib/kubelet/pods/d027ac67-09d4-4b17-86e8-b2ff8c8f2be3/volumes" Jun 02 20:12:51.451353 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.451318 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk"] Jun 02 20:12:51.451768 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.451740 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d027ac67-09d4-4b17-86e8-b2ff8c8f2be3" containerName="manager" Jun 02 20:12:51.451768 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.451752 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="d027ac67-09d4-4b17-86e8-b2ff8c8f2be3" containerName="manager" Jun 02 20:12:51.451838 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.451812 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="d027ac67-09d4-4b17-86e8-b2ff8c8f2be3" containerName="manager" Jun 02 20:12:51.455224 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.455200 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.458196 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.458172 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4ftkn\"" Jun 02 20:12:51.468991 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.468968 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk"] Jun 02 20:12:51.538482 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538452 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.538622 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538501 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.538622 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538530 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6fk\" (UniqueName: \"kubernetes.io/projected/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-kube-api-access-jj6fk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.538709 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538618 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.538709 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538669 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.538709 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538687 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.538709 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538707 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.538841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538734 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.538841 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.538751 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639289 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639330 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639597 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639356 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639597 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639431 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639597 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639460 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639597 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639535 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639597 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639580 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639849 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639608 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6fk\" (UniqueName: \"kubernetes.io/projected/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-kube-api-access-jj6fk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639849 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639675 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639849 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639746 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.639849 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639791 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.640048 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639909 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.640048 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.639950 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.640416 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.640371 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.641832 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.641813 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.641944 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.641926 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.647595 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.647572 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.647741 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.647724 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6fk\" (UniqueName: \"kubernetes.io/projected/8c739841-a2e0-4f16-b9fa-0c20ac4f2463-kube-api-access-jj6fk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-qqdpk\" (UID: \"8c739841-a2e0-4f16-b9fa-0c20ac4f2463\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.767786 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.767714 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:51.897844 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.897802 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk"] Jun 02 20:12:51.900641 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:12:51.900614 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c739841_a2e0_4f16_b9fa_0c20ac4f2463.slice/crio-54baadcb363f96cdd2bd440322a0c45f5fe3e9f25dc180f163cb7fd5315375a2 WatchSource:0}: Error finding container 54baadcb363f96cdd2bd440322a0c45f5fe3e9f25dc180f163cb7fd5315375a2: Status 404 returned error can't find the container with id 54baadcb363f96cdd2bd440322a0c45f5fe3e9f25dc180f163cb7fd5315375a2 Jun 02 20:12:51.902801 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.902764 2544 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 20:12:51.902928 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.902829 2544 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 20:12:51.902928 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:51.902857 2544 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 02 20:12:52.053375 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:52.053291 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" event={"ID":"8c739841-a2e0-4f16-b9fa-0c20ac4f2463","Type":"ContainerStarted","Data":"7c6f59e7c44e6637805c33e0c3762e7d8bf8329106cbc8772bd6299d628a70e0"} Jun 02 20:12:52.053375 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:52.053327 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" event={"ID":"8c739841-a2e0-4f16-b9fa-0c20ac4f2463","Type":"ContainerStarted","Data":"54baadcb363f96cdd2bd440322a0c45f5fe3e9f25dc180f163cb7fd5315375a2"} Jun 02 20:12:52.075693 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:52.075645 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" podStartSLOduration=1.075629949 podStartE2EDuration="1.075629949s" podCreationTimestamp="2026-06-02 20:12:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:12:52.073471609 +0000 UTC m=+643.820254267" watchObservedRunningTime="2026-06-02 20:12:52.075629949 +0000 UTC m=+643.822412606" Jun 02 20:12:52.768799 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:52.768769 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:52.773471 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:52.773451 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:53.059451 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:53.059365 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:12:53.060304 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:12:53.060274 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-qqdpk" Jun 02 20:13:06.856551 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:06.856513 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:13:06.859625 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:06.859604 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:06.862443 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:06.862419 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-92vdk\"" Jun 02 20:13:06.862557 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:06.862424 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 20:13:06.871030 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:06.870993 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:13:06.886359 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:06.886329 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:13:06.964268 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:06.964240 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f97rj\" (UniqueName: \"kubernetes.io/projected/c07681f4-7b98-4508-9826-c70f26462b19-kube-api-access-f97rj\") pod \"limitador-limitador-78c99df468-qjqlh\" (UID: \"c07681f4-7b98-4508-9826-c70f26462b19\") " pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:06.964420 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:06.964287 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c07681f4-7b98-4508-9826-c70f26462b19-config-file\") pod \"limitador-limitador-78c99df468-qjqlh\" (UID: \"c07681f4-7b98-4508-9826-c70f26462b19\") " pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:07.065567 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.065535 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f97rj\" (UniqueName: \"kubernetes.io/projected/c07681f4-7b98-4508-9826-c70f26462b19-kube-api-access-f97rj\") pod \"limitador-limitador-78c99df468-qjqlh\" (UID: \"c07681f4-7b98-4508-9826-c70f26462b19\") " pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:07.065719 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.065586 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c07681f4-7b98-4508-9826-c70f26462b19-config-file\") pod \"limitador-limitador-78c99df468-qjqlh\" (UID: \"c07681f4-7b98-4508-9826-c70f26462b19\") " pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:07.066240 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.066220 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c07681f4-7b98-4508-9826-c70f26462b19-config-file\") pod \"limitador-limitador-78c99df468-qjqlh\" (UID: \"c07681f4-7b98-4508-9826-c70f26462b19\") " pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:07.073971 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.073942 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f97rj\" (UniqueName: \"kubernetes.io/projected/c07681f4-7b98-4508-9826-c70f26462b19-kube-api-access-f97rj\") pod \"limitador-limitador-78c99df468-qjqlh\" (UID: \"c07681f4-7b98-4508-9826-c70f26462b19\") " pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:07.172051 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.172027 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:07.303356 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.303327 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:13:07.304751 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:13:07.304723 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07681f4_7b98_4508_9826_c70f26462b19.slice/crio-2ab1978c5fae0c26f4094f64628d1b9dfa28eabb55b89216d31321df08a65c89 WatchSource:0}: Error finding container 2ab1978c5fae0c26f4094f64628d1b9dfa28eabb55b89216d31321df08a65c89: Status 404 returned error can't find the container with id 2ab1978c5fae0c26f4094f64628d1b9dfa28eabb55b89216d31321df08a65c89 Jun 02 20:13:07.584490 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.584416 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-nn4cm"] Jun 02 20:13:07.587818 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.587792 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-nn4cm" Jun 02 20:13:07.590971 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.590951 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5llhj\"" Jun 02 20:13:07.595621 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.595598 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-nn4cm"] Jun 02 20:13:07.670567 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.670541 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vq7g\" (UniqueName: \"kubernetes.io/projected/59a93397-17ff-4fd4-9297-ae4089478ab5-kube-api-access-8vq7g\") pod \"authorino-7498df8756-nn4cm\" (UID: \"59a93397-17ff-4fd4-9297-ae4089478ab5\") " pod="kuadrant-system/authorino-7498df8756-nn4cm" Jun 02 20:13:07.771774 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.771712 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vq7g\" (UniqueName: \"kubernetes.io/projected/59a93397-17ff-4fd4-9297-ae4089478ab5-kube-api-access-8vq7g\") pod \"authorino-7498df8756-nn4cm\" (UID: \"59a93397-17ff-4fd4-9297-ae4089478ab5\") " pod="kuadrant-system/authorino-7498df8756-nn4cm" Jun 02 20:13:07.783699 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.783650 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vq7g\" (UniqueName: \"kubernetes.io/projected/59a93397-17ff-4fd4-9297-ae4089478ab5-kube-api-access-8vq7g\") pod \"authorino-7498df8756-nn4cm\" (UID: \"59a93397-17ff-4fd4-9297-ae4089478ab5\") " pod="kuadrant-system/authorino-7498df8756-nn4cm" Jun 02 20:13:07.901503 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:07.901106 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-nn4cm" Jun 02 20:13:08.055019 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:08.054745 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-nn4cm"] Jun 02 20:13:08.055019 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:13:08.054908 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59a93397_17ff_4fd4_9297_ae4089478ab5.slice/crio-9ae4e4b79983b79b7f9de5edc12c44d165134fd97f0425358670c32b122e5535 WatchSource:0}: Error finding container 9ae4e4b79983b79b7f9de5edc12c44d165134fd97f0425358670c32b122e5535: Status 404 returned error can't find the container with id 9ae4e4b79983b79b7f9de5edc12c44d165134fd97f0425358670c32b122e5535 Jun 02 20:13:08.121873 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:08.121822 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-nn4cm" event={"ID":"59a93397-17ff-4fd4-9297-ae4089478ab5","Type":"ContainerStarted","Data":"9ae4e4b79983b79b7f9de5edc12c44d165134fd97f0425358670c32b122e5535"} Jun 02 20:13:08.123011 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:08.122983 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" event={"ID":"c07681f4-7b98-4508-9826-c70f26462b19","Type":"ContainerStarted","Data":"2ab1978c5fae0c26f4094f64628d1b9dfa28eabb55b89216d31321df08a65c89"} Jun 02 20:13:12.145186 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:12.145147 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-nn4cm" event={"ID":"59a93397-17ff-4fd4-9297-ae4089478ab5","Type":"ContainerStarted","Data":"a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d"} Jun 02 20:13:12.146455 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:12.146422 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" event={"ID":"c07681f4-7b98-4508-9826-c70f26462b19","Type":"ContainerStarted","Data":"6f35e2356cfc319855c0110174768339162d1390f7ce4914785a9da881316fbd"} Jun 02 20:13:12.146604 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:12.146583 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:13:12.161496 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:12.161458 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-nn4cm" podStartSLOduration=1.585215991 podStartE2EDuration="5.161443189s" podCreationTimestamp="2026-06-02 20:13:07 +0000 UTC" firstStartedPulling="2026-06-02 20:13:08.05692465 +0000 UTC m=+659.803707290" lastFinishedPulling="2026-06-02 20:13:11.633151846 +0000 UTC m=+663.379934488" observedRunningTime="2026-06-02 20:13:12.159320333 +0000 UTC m=+663.906102990" watchObservedRunningTime="2026-06-02 20:13:12.161443189 +0000 UTC m=+663.908225847" Jun 02 20:13:12.175448 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:12.175402 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" podStartSLOduration=1.89291712 podStartE2EDuration="6.175373534s" podCreationTimestamp="2026-06-02 20:13:06 +0000 UTC" firstStartedPulling="2026-06-02 20:13:07.306641835 +0000 UTC m=+659.053424471" lastFinishedPulling="2026-06-02 20:13:11.589098233 +0000 UTC m=+663.335880885" observedRunningTime="2026-06-02 20:13:12.174862991 +0000 UTC m=+663.921645650" watchObservedRunningTime="2026-06-02 20:13:12.175373534 +0000 UTC m=+663.922156191" Jun 02 20:13:23.154565 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:13:23.154531 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-qjqlh" Jun 02 20:14:31.974668 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:31.974631 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-fl6zr"] Jun 02 20:14:31.977955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:31.977932 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" Jun 02 20:14:31.980363 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:31.980338 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-fl6zr"] Jun 02 20:14:32.046843 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.046806 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5v49\" (UniqueName: \"kubernetes.io/projected/3d22d516-f21a-4925-af6c-0248c50fbf0a-kube-api-access-f5v49\") pod \"authorino-8b475cf9f-fl6zr\" (UID: \"3d22d516-f21a-4925-af6c-0248c50fbf0a\") " pod="kuadrant-system/authorino-8b475cf9f-fl6zr" Jun 02 20:14:32.148012 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.147972 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5v49\" (UniqueName: \"kubernetes.io/projected/3d22d516-f21a-4925-af6c-0248c50fbf0a-kube-api-access-f5v49\") pod \"authorino-8b475cf9f-fl6zr\" (UID: \"3d22d516-f21a-4925-af6c-0248c50fbf0a\") " pod="kuadrant-system/authorino-8b475cf9f-fl6zr" Jun 02 20:14:32.159128 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.159096 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5v49\" (UniqueName: \"kubernetes.io/projected/3d22d516-f21a-4925-af6c-0248c50fbf0a-kube-api-access-f5v49\") pod \"authorino-8b475cf9f-fl6zr\" (UID: \"3d22d516-f21a-4925-af6c-0248c50fbf0a\") " pod="kuadrant-system/authorino-8b475cf9f-fl6zr" Jun 02 20:14:32.190075 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.190036 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-fl6zr"] Jun 02 20:14:32.190336 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.190323 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" Jun 02 20:14:32.238079 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.237981 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d89b746cb-26js6"] Jun 02 20:14:32.241737 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.241706 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d89b746cb-26js6" Jun 02 20:14:32.256794 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.256765 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d89b746cb-26js6"] Jun 02 20:14:32.335649 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.335616 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-fl6zr"] Jun 02 20:14:32.337038 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:14:32.337013 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d22d516_f21a_4925_af6c_0248c50fbf0a.slice/crio-ea4eae50b8294e6a0d5e18b10e787942131e47aaaadf5d41cabdd5913b7c5ce0 WatchSource:0}: Error finding container ea4eae50b8294e6a0d5e18b10e787942131e47aaaadf5d41cabdd5913b7c5ce0: Status 404 returned error can't find the container with id ea4eae50b8294e6a0d5e18b10e787942131e47aaaadf5d41cabdd5913b7c5ce0 Jun 02 20:14:32.350203 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.350178 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bppz\" (UniqueName: \"kubernetes.io/projected/6cb7a842-a78b-45b5-bf1f-1be80c74fd20-kube-api-access-7bppz\") pod \"authorino-5d89b746cb-26js6\" (UID: \"6cb7a842-a78b-45b5-bf1f-1be80c74fd20\") " pod="kuadrant-system/authorino-5d89b746cb-26js6" Jun 02 20:14:32.451066 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.451034 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bppz\" (UniqueName: \"kubernetes.io/projected/6cb7a842-a78b-45b5-bf1f-1be80c74fd20-kube-api-access-7bppz\") pod \"authorino-5d89b746cb-26js6\" (UID: \"6cb7a842-a78b-45b5-bf1f-1be80c74fd20\") " pod="kuadrant-system/authorino-5d89b746cb-26js6" Jun 02 20:14:32.454021 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.453995 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" event={"ID":"3d22d516-f21a-4925-af6c-0248c50fbf0a","Type":"ContainerStarted","Data":"ea4eae50b8294e6a0d5e18b10e787942131e47aaaadf5d41cabdd5913b7c5ce0"} Jun 02 20:14:32.463519 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.463492 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d89b746cb-26js6"] Jun 02 20:14:32.463807 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:14:32.463787 2544 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7bppz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d89b746cb-26js6" podUID="6cb7a842-a78b-45b5-bf1f-1be80c74fd20" Jun 02 20:14:32.466194 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.466168 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bppz\" (UniqueName: \"kubernetes.io/projected/6cb7a842-a78b-45b5-bf1f-1be80c74fd20-kube-api-access-7bppz\") pod \"authorino-5d89b746cb-26js6\" (UID: \"6cb7a842-a78b-45b5-bf1f-1be80c74fd20\") " pod="kuadrant-system/authorino-5d89b746cb-26js6" Jun 02 20:14:32.533947 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.533862 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-769cb6cb96-9sc4v"] Jun 02 20:14:32.536727 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.536710 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:14:32.540313 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.540292 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 20:14:32.552548 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.552522 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-769cb6cb96-9sc4v"] Jun 02 20:14:32.653829 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.653795 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsjkr\" (UniqueName: \"kubernetes.io/projected/721e5f80-356f-4d34-bc8d-0d040df0f96d-kube-api-access-wsjkr\") pod \"authorino-769cb6cb96-9sc4v\" (UID: \"721e5f80-356f-4d34-bc8d-0d040df0f96d\") " pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:14:32.654022 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.653906 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/721e5f80-356f-4d34-bc8d-0d040df0f96d-tls-cert\") pod \"authorino-769cb6cb96-9sc4v\" (UID: \"721e5f80-356f-4d34-bc8d-0d040df0f96d\") " pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:14:32.754420 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.754380 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/721e5f80-356f-4d34-bc8d-0d040df0f96d-tls-cert\") pod \"authorino-769cb6cb96-9sc4v\" (UID: \"721e5f80-356f-4d34-bc8d-0d040df0f96d\") " pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:14:32.754519 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.754464 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsjkr\" (UniqueName: \"kubernetes.io/projected/721e5f80-356f-4d34-bc8d-0d040df0f96d-kube-api-access-wsjkr\") pod \"authorino-769cb6cb96-9sc4v\" (UID: \"721e5f80-356f-4d34-bc8d-0d040df0f96d\") " pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:14:32.756750 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.756730 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/721e5f80-356f-4d34-bc8d-0d040df0f96d-tls-cert\") pod \"authorino-769cb6cb96-9sc4v\" (UID: \"721e5f80-356f-4d34-bc8d-0d040df0f96d\") " pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:14:32.768710 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.768683 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsjkr\" (UniqueName: \"kubernetes.io/projected/721e5f80-356f-4d34-bc8d-0d040df0f96d-kube-api-access-wsjkr\") pod \"authorino-769cb6cb96-9sc4v\" (UID: \"721e5f80-356f-4d34-bc8d-0d040df0f96d\") " pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:14:32.846064 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.846027 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:14:32.990251 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:32.990225 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-769cb6cb96-9sc4v"] Jun 02 20:14:32.991484 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:14:32.991456 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod721e5f80_356f_4d34_bc8d_0d040df0f96d.slice/crio-947e0b45a85c044c11bfdecca213c9815f0d26d546c4222523763d5228665d94 WatchSource:0}: Error finding container 947e0b45a85c044c11bfdecca213c9815f0d26d546c4222523763d5228665d94: Status 404 returned error can't find the container with id 947e0b45a85c044c11bfdecca213c9815f0d26d546c4222523763d5228665d94 Jun 02 20:14:33.459948 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.459911 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" event={"ID":"3d22d516-f21a-4925-af6c-0248c50fbf0a","Type":"ContainerStarted","Data":"dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa"} Jun 02 20:14:33.460151 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.459995 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" podUID="3d22d516-f21a-4925-af6c-0248c50fbf0a" containerName="authorino" containerID="cri-o://dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa" gracePeriod=30 Jun 02 20:14:33.461610 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.461585 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" event={"ID":"721e5f80-356f-4d34-bc8d-0d040df0f96d","Type":"ContainerStarted","Data":"5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea"} Jun 02 20:14:33.461741 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.461615 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" event={"ID":"721e5f80-356f-4d34-bc8d-0d040df0f96d","Type":"ContainerStarted","Data":"947e0b45a85c044c11bfdecca213c9815f0d26d546c4222523763d5228665d94"} Jun 02 20:14:33.461741 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.461663 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d89b746cb-26js6" Jun 02 20:14:33.468011 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.467988 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d89b746cb-26js6" Jun 02 20:14:33.482456 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.482364 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" podStartSLOduration=2.076704442 podStartE2EDuration="2.482349502s" podCreationTimestamp="2026-06-02 20:14:31 +0000 UTC" firstStartedPulling="2026-06-02 20:14:32.338235261 +0000 UTC m=+744.085017909" lastFinishedPulling="2026-06-02 20:14:32.743880331 +0000 UTC m=+744.490662969" observedRunningTime="2026-06-02 20:14:33.480493495 +0000 UTC m=+745.227276154" watchObservedRunningTime="2026-06-02 20:14:33.482349502 +0000 UTC m=+745.229132159" Jun 02 20:14:33.507583 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.507534 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" podStartSLOduration=1.234794021 podStartE2EDuration="1.507520305s" podCreationTimestamp="2026-06-02 20:14:32 +0000 UTC" firstStartedPulling="2026-06-02 20:14:32.992852679 +0000 UTC m=+744.739635314" lastFinishedPulling="2026-06-02 20:14:33.265578964 +0000 UTC m=+745.012361598" observedRunningTime="2026-06-02 20:14:33.505754975 +0000 UTC m=+745.252537636" watchObservedRunningTime="2026-06-02 20:14:33.507520305 +0000 UTC m=+745.254302961" Jun 02 20:14:33.553325 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.553226 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-nn4cm"] Jun 02 20:14:33.553510 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.553436 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-nn4cm" podUID="59a93397-17ff-4fd4-9297-ae4089478ab5" containerName="authorino" containerID="cri-o://a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d" gracePeriod=30 Jun 02 20:14:33.562130 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.562106 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bppz\" (UniqueName: \"kubernetes.io/projected/6cb7a842-a78b-45b5-bf1f-1be80c74fd20-kube-api-access-7bppz\") pod \"6cb7a842-a78b-45b5-bf1f-1be80c74fd20\" (UID: \"6cb7a842-a78b-45b5-bf1f-1be80c74fd20\") " Jun 02 20:14:33.565003 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.564850 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb7a842-a78b-45b5-bf1f-1be80c74fd20-kube-api-access-7bppz" (OuterVolumeSpecName: "kube-api-access-7bppz") pod "6cb7a842-a78b-45b5-bf1f-1be80c74fd20" (UID: "6cb7a842-a78b-45b5-bf1f-1be80c74fd20"). InnerVolumeSpecName "kube-api-access-7bppz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:14:33.663976 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.663950 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bppz\" (UniqueName: \"kubernetes.io/projected/6cb7a842-a78b-45b5-bf1f-1be80c74fd20-kube-api-access-7bppz\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:14:33.792919 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.792894 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" Jun 02 20:14:33.820102 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.820081 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-nn4cm" Jun 02 20:14:33.866171 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.866141 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5v49\" (UniqueName: \"kubernetes.io/projected/3d22d516-f21a-4925-af6c-0248c50fbf0a-kube-api-access-f5v49\") pod \"3d22d516-f21a-4925-af6c-0248c50fbf0a\" (UID: \"3d22d516-f21a-4925-af6c-0248c50fbf0a\") " Jun 02 20:14:33.866354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.866201 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vq7g\" (UniqueName: \"kubernetes.io/projected/59a93397-17ff-4fd4-9297-ae4089478ab5-kube-api-access-8vq7g\") pod \"59a93397-17ff-4fd4-9297-ae4089478ab5\" (UID: \"59a93397-17ff-4fd4-9297-ae4089478ab5\") " Jun 02 20:14:33.868488 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.868454 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d22d516-f21a-4925-af6c-0248c50fbf0a-kube-api-access-f5v49" (OuterVolumeSpecName: "kube-api-access-f5v49") pod "3d22d516-f21a-4925-af6c-0248c50fbf0a" (UID: "3d22d516-f21a-4925-af6c-0248c50fbf0a"). InnerVolumeSpecName "kube-api-access-f5v49". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:14:33.868605 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.868503 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59a93397-17ff-4fd4-9297-ae4089478ab5-kube-api-access-8vq7g" (OuterVolumeSpecName: "kube-api-access-8vq7g") pod "59a93397-17ff-4fd4-9297-ae4089478ab5" (UID: "59a93397-17ff-4fd4-9297-ae4089478ab5"). InnerVolumeSpecName "kube-api-access-8vq7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:14:33.968027 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.967987 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5v49\" (UniqueName: \"kubernetes.io/projected/3d22d516-f21a-4925-af6c-0248c50fbf0a-kube-api-access-f5v49\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:14:33.968027 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:33.968019 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vq7g\" (UniqueName: \"kubernetes.io/projected/59a93397-17ff-4fd4-9297-ae4089478ab5-kube-api-access-8vq7g\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:14:34.467115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.467018 2544 generic.go:358] "Generic (PLEG): container finished" podID="59a93397-17ff-4fd4-9297-ae4089478ab5" containerID="a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d" exitCode=0 Jun 02 20:14:34.467115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.467070 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-nn4cm" Jun 02 20:14:34.467115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.467099 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-nn4cm" event={"ID":"59a93397-17ff-4fd4-9297-ae4089478ab5","Type":"ContainerDied","Data":"a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d"} Jun 02 20:14:34.467647 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.467133 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-nn4cm" event={"ID":"59a93397-17ff-4fd4-9297-ae4089478ab5","Type":"ContainerDied","Data":"9ae4e4b79983b79b7f9de5edc12c44d165134fd97f0425358670c32b122e5535"} Jun 02 20:14:34.467647 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.467153 2544 scope.go:117] "RemoveContainer" containerID="a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d" Jun 02 20:14:34.468367 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.468344 2544 generic.go:358] "Generic (PLEG): container finished" podID="3d22d516-f21a-4925-af6c-0248c50fbf0a" containerID="dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa" exitCode=0 Jun 02 20:14:34.468486 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.468412 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" Jun 02 20:14:34.468486 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.468433 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" event={"ID":"3d22d516-f21a-4925-af6c-0248c50fbf0a","Type":"ContainerDied","Data":"dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa"} Jun 02 20:14:34.468486 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.468462 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-fl6zr" event={"ID":"3d22d516-f21a-4925-af6c-0248c50fbf0a","Type":"ContainerDied","Data":"ea4eae50b8294e6a0d5e18b10e787942131e47aaaadf5d41cabdd5913b7c5ce0"} Jun 02 20:14:34.468635 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.468519 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d89b746cb-26js6" Jun 02 20:14:34.485007 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.484990 2544 scope.go:117] "RemoveContainer" containerID="a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d" Jun 02 20:14:34.485263 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:14:34.485243 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d\": container with ID starting with a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d not found: ID does not exist" containerID="a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d" Jun 02 20:14:34.485308 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.485272 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d"} err="failed to get container status \"a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d\": rpc error: code = NotFound desc = could not find container \"a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d\": container with ID starting with a3d6e8fd2a3f42ccdbb626461ac4f90227197b46208c105ed02db4751de0b20d not found: ID does not exist" Jun 02 20:14:34.485308 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.485292 2544 scope.go:117] "RemoveContainer" containerID="dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa" Jun 02 20:14:34.493180 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.493164 2544 scope.go:117] "RemoveContainer" containerID="dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa" Jun 02 20:14:34.493457 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:14:34.493436 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa\": container with ID starting with dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa not found: ID does not exist" containerID="dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa" Jun 02 20:14:34.493532 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.493461 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa"} err="failed to get container status \"dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa\": rpc error: code = NotFound desc = could not find container \"dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa\": container with ID starting with dbe294629cabf9437f6cd35fd63456d6ff4e563c80b4815a8f7f09a24f0e81aa not found: ID does not exist" Jun 02 20:14:34.502409 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.502371 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-nn4cm"] Jun 02 20:14:34.505793 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.505772 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-nn4cm"] Jun 02 20:14:34.517546 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.517522 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-fl6zr"] Jun 02 20:14:34.519632 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.519612 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-fl6zr"] Jun 02 20:14:34.547214 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.547190 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d89b746cb-26js6"] Jun 02 20:14:34.550691 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.550663 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d89b746cb-26js6"] Jun 02 20:14:34.824826 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.824731 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d22d516-f21a-4925-af6c-0248c50fbf0a" path="/var/lib/kubelet/pods/3d22d516-f21a-4925-af6c-0248c50fbf0a/volumes" Jun 02 20:14:34.825160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.825139 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59a93397-17ff-4fd4-9297-ae4089478ab5" path="/var/lib/kubelet/pods/59a93397-17ff-4fd4-9297-ae4089478ab5/volumes" Jun 02 20:14:34.825513 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:14:34.825496 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cb7a842-a78b-45b5-bf1f-1be80c74fd20" path="/var/lib/kubelet/pods/6cb7a842-a78b-45b5-bf1f-1be80c74fd20/volumes" Jun 02 20:15:11.776916 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:15:11.776880 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:16:00.190872 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.190833 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c8fbb7b56-6x7jv"] Jun 02 20:16:00.191374 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.191267 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d22d516-f21a-4925-af6c-0248c50fbf0a" containerName="authorino" Jun 02 20:16:00.191374 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.191280 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d22d516-f21a-4925-af6c-0248c50fbf0a" containerName="authorino" Jun 02 20:16:00.191374 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.191296 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59a93397-17ff-4fd4-9297-ae4089478ab5" containerName="authorino" Jun 02 20:16:00.191374 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.191303 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="59a93397-17ff-4fd4-9297-ae4089478ab5" containerName="authorino" Jun 02 20:16:00.191571 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.191374 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="59a93397-17ff-4fd4-9297-ae4089478ab5" containerName="authorino" Jun 02 20:16:00.191571 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.191427 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d22d516-f21a-4925-af6c-0248c50fbf0a" containerName="authorino" Jun 02 20:16:00.193672 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.193657 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.196446 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.196425 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 20:16:00.202313 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.202292 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c8fbb7b56-6x7jv"] Jun 02 20:16:00.306866 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.306835 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-tls-cert\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.307049 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.306885 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-oidc-ca\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.307049 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.306914 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82p54\" (UniqueName: \"kubernetes.io/projected/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-kube-api-access-82p54\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.408369 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.408329 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82p54\" (UniqueName: \"kubernetes.io/projected/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-kube-api-access-82p54\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.408556 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.408477 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-tls-cert\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.408556 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.408522 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-oidc-ca\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.409149 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.409129 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-oidc-ca\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.410877 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.410857 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-tls-cert\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.417306 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.417282 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82p54\" (UniqueName: \"kubernetes.io/projected/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-kube-api-access-82p54\") pod \"authorino-7c8fbb7b56-6x7jv\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.504260 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.504173 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:16:00.636790 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.636761 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c8fbb7b56-6x7jv"] Jun 02 20:16:00.638098 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:16:00.638072 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65c27fdb_8f5d_4700_8c7f_2ea17ecf4185.slice/crio-80c684761a9fd77f2fffb4d51303fd4167ae4a518bcbf81c1dc4f36c44d5824e WatchSource:0}: Error finding container 80c684761a9fd77f2fffb4d51303fd4167ae4a518bcbf81c1dc4f36c44d5824e: Status 404 returned error can't find the container with id 80c684761a9fd77f2fffb4d51303fd4167ae4a518bcbf81c1dc4f36c44d5824e Jun 02 20:16:00.808669 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:00.808574 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" event={"ID":"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185","Type":"ContainerStarted","Data":"80c684761a9fd77f2fffb4d51303fd4167ae4a518bcbf81c1dc4f36c44d5824e"} Jun 02 20:16:01.814978 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:01.814940 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" event={"ID":"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185","Type":"ContainerStarted","Data":"471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835"} Jun 02 20:16:01.844328 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:01.844273 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" podStartSLOduration=1.4883131600000001 podStartE2EDuration="1.844257734s" podCreationTimestamp="2026-06-02 20:16:00 +0000 UTC" firstStartedPulling="2026-06-02 20:16:00.639314816 +0000 UTC m=+832.386097450" lastFinishedPulling="2026-06-02 20:16:00.995259375 +0000 UTC m=+832.742042024" observedRunningTime="2026-06-02 20:16:01.840883886 +0000 UTC m=+833.587666549" watchObservedRunningTime="2026-06-02 20:16:01.844257734 +0000 UTC m=+833.591040390" Jun 02 20:16:01.909618 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:01.909579 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-769cb6cb96-9sc4v"] Jun 02 20:16:01.909805 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:01.909774 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" podUID="721e5f80-356f-4d34-bc8d-0d040df0f96d" containerName="authorino" containerID="cri-o://5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea" gracePeriod=30 Jun 02 20:16:02.182081 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.182053 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:16:02.335598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.335511 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsjkr\" (UniqueName: \"kubernetes.io/projected/721e5f80-356f-4d34-bc8d-0d040df0f96d-kube-api-access-wsjkr\") pod \"721e5f80-356f-4d34-bc8d-0d040df0f96d\" (UID: \"721e5f80-356f-4d34-bc8d-0d040df0f96d\") " Jun 02 20:16:02.335598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.335576 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/721e5f80-356f-4d34-bc8d-0d040df0f96d-tls-cert\") pod \"721e5f80-356f-4d34-bc8d-0d040df0f96d\" (UID: \"721e5f80-356f-4d34-bc8d-0d040df0f96d\") " Jun 02 20:16:02.337671 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.337634 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721e5f80-356f-4d34-bc8d-0d040df0f96d-kube-api-access-wsjkr" (OuterVolumeSpecName: "kube-api-access-wsjkr") pod "721e5f80-356f-4d34-bc8d-0d040df0f96d" (UID: "721e5f80-356f-4d34-bc8d-0d040df0f96d"). InnerVolumeSpecName "kube-api-access-wsjkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:16:02.347172 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.347144 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/721e5f80-356f-4d34-bc8d-0d040df0f96d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "721e5f80-356f-4d34-bc8d-0d040df0f96d" (UID: "721e5f80-356f-4d34-bc8d-0d040df0f96d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:16:02.436772 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.436734 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsjkr\" (UniqueName: \"kubernetes.io/projected/721e5f80-356f-4d34-bc8d-0d040df0f96d-kube-api-access-wsjkr\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:16:02.436772 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.436766 2544 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/721e5f80-356f-4d34-bc8d-0d040df0f96d-tls-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:16:02.820620 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.820583 2544 generic.go:358] "Generic (PLEG): container finished" podID="721e5f80-356f-4d34-bc8d-0d040df0f96d" containerID="5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea" exitCode=0 Jun 02 20:16:02.821061 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.820706 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" Jun 02 20:16:02.825642 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.825612 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" event={"ID":"721e5f80-356f-4d34-bc8d-0d040df0f96d","Type":"ContainerDied","Data":"5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea"} Jun 02 20:16:02.825642 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.825644 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-769cb6cb96-9sc4v" event={"ID":"721e5f80-356f-4d34-bc8d-0d040df0f96d","Type":"ContainerDied","Data":"947e0b45a85c044c11bfdecca213c9815f0d26d546c4222523763d5228665d94"} Jun 02 20:16:02.825853 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.825672 2544 scope.go:117] "RemoveContainer" containerID="5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea" Jun 02 20:16:02.835944 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.835926 2544 scope.go:117] "RemoveContainer" containerID="5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea" Jun 02 20:16:02.836215 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:16:02.836197 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea\": container with ID starting with 5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea not found: ID does not exist" containerID="5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea" Jun 02 20:16:02.836258 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.836223 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea"} err="failed to get container status \"5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea\": rpc error: code = NotFound desc = could not find container \"5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea\": container with ID starting with 5c09bde156e7eeadf3de56e932ab2fefa95b289ac0cf9c08cf86d1cc1a1f2cea not found: ID does not exist" Jun 02 20:16:02.847545 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.847520 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-769cb6cb96-9sc4v"] Jun 02 20:16:02.852030 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:02.852009 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-769cb6cb96-9sc4v"] Jun 02 20:16:04.824037 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:04.824005 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="721e5f80-356f-4d34-bc8d-0d040df0f96d" path="/var/lib/kubelet/pods/721e5f80-356f-4d34-bc8d-0d040df0f96d/volumes" Jun 02 20:16:29.009664 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:29.009628 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:16:35.884864 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.884831 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd"] Jun 02 20:16:35.885502 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.885485 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721e5f80-356f-4d34-bc8d-0d040df0f96d" containerName="authorino" Jun 02 20:16:35.885563 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.885507 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="721e5f80-356f-4d34-bc8d-0d040df0f96d" containerName="authorino" Jun 02 20:16:35.885610 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.885599 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="721e5f80-356f-4d34-bc8d-0d040df0f96d" containerName="authorino" Jun 02 20:16:35.888823 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.888801 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:35.892933 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.892907 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-glkvx\"" Jun 02 20:16:35.892933 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.892927 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 20:16:35.893121 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.892927 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 20:16:35.893121 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.892966 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 20:16:35.899023 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:35.898996 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd"] Jun 02 20:16:36.045285 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.045247 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.045523 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.045296 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.045523 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.045399 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.045523 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.045456 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcncr\" (UniqueName: \"kubernetes.io/projected/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-kube-api-access-gcncr\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.045703 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.045519 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.045703 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.045569 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.146846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.146750 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.146846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.146797 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.146846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.146834 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.147149 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.146863 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcncr\" (UniqueName: \"kubernetes.io/projected/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-kube-api-access-gcncr\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.147149 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.146917 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.147149 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.146960 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.147305 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.147170 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.147305 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.147236 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.147305 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.147288 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.149294 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.149267 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.149602 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.149584 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.156474 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.156452 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcncr\" (UniqueName: \"kubernetes.io/projected/ca88a12b-39a1-4e3b-a13b-664f5d6778ea-kube-api-access-gcncr\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-k77pd\" (UID: \"ca88a12b-39a1-4e3b-a13b-664f5d6778ea\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.200988 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.200950 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:36.358549 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.358526 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd"] Jun 02 20:16:36.360296 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:16:36.360262 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca88a12b_39a1_4e3b_a13b_664f5d6778ea.slice/crio-b3f2f592fff77dd219ba1df826360fe10df9d1bcf4b62f21c892973aad35a000 WatchSource:0}: Error finding container b3f2f592fff77dd219ba1df826360fe10df9d1bcf4b62f21c892973aad35a000: Status 404 returned error can't find the container with id b3f2f592fff77dd219ba1df826360fe10df9d1bcf4b62f21c892973aad35a000 Jun 02 20:16:36.629793 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.629707 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:16:36.956998 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:36.956956 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" event={"ID":"ca88a12b-39a1-4e3b-a13b-664f5d6778ea","Type":"ContainerStarted","Data":"b3f2f592fff77dd219ba1df826360fe10df9d1bcf4b62f21c892973aad35a000"} Jun 02 20:16:39.971802 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:39.971759 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" event={"ID":"ca88a12b-39a1-4e3b-a13b-664f5d6778ea","Type":"ContainerStarted","Data":"ae2f11f1533730410eb7fb41afdf3a8a0dbde29d587fd28aa63f6c72da4c350b"} Jun 02 20:16:41.982216 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:41.982180 2544 generic.go:358] "Generic (PLEG): container finished" podID="ca88a12b-39a1-4e3b-a13b-664f5d6778ea" containerID="ae2f11f1533730410eb7fb41afdf3a8a0dbde29d587fd28aa63f6c72da4c350b" exitCode=0 Jun 02 20:16:41.982658 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:41.982255 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" event={"ID":"ca88a12b-39a1-4e3b-a13b-664f5d6778ea","Type":"ContainerDied","Data":"ae2f11f1533730410eb7fb41afdf3a8a0dbde29d587fd28aa63f6c72da4c350b"} Jun 02 20:16:43.225319 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:43.225285 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:16:43.992184 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:43.992147 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" event={"ID":"ca88a12b-39a1-4e3b-a13b-664f5d6778ea","Type":"ContainerStarted","Data":"629749a38345251138e59468d672594264db0b553fd2c782e97b70cfa5bd4907"} Jun 02 20:16:44.014006 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:44.013952 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" podStartSLOduration=2.106440456 podStartE2EDuration="9.013938887s" podCreationTimestamp="2026-06-02 20:16:35 +0000 UTC" firstStartedPulling="2026-06-02 20:16:36.362063647 +0000 UTC m=+868.108846282" lastFinishedPulling="2026-06-02 20:16:43.269562079 +0000 UTC m=+875.016344713" observedRunningTime="2026-06-02 20:16:44.012549515 +0000 UTC m=+875.759332175" watchObservedRunningTime="2026-06-02 20:16:44.013938887 +0000 UTC m=+875.760721543" Jun 02 20:16:46.201551 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:46.201493 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:46.201551 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:46.201556 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:46.214853 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:46.214822 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:47.014599 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:47.014563 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-k77pd" Jun 02 20:16:49.894847 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.894816 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj"] Jun 02 20:16:49.901671 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.901651 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:49.905041 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.905021 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 20:16:49.910483 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.910459 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj"] Jun 02 20:16:49.989244 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.989211 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:49.989376 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.989255 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-549mx\" (UniqueName: \"kubernetes.io/projected/10cedd26-1c15-44c5-87d5-0df13aa10bdf-kube-api-access-549mx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:49.989376 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.989356 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:49.989498 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.989464 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:49.989547 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.989496 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:49.989600 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:49.989577 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10cedd26-1c15-44c5-87d5-0df13aa10bdf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.090538 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.090502 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.090895 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.090550 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-549mx\" (UniqueName: \"kubernetes.io/projected/10cedd26-1c15-44c5-87d5-0df13aa10bdf-kube-api-access-549mx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.090895 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.090578 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.090895 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.090622 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.090895 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.090651 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.090895 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.090708 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10cedd26-1c15-44c5-87d5-0df13aa10bdf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.091163 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.090944 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.091163 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.091092 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.091163 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.091120 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.093125 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.093092 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10cedd26-1c15-44c5-87d5-0df13aa10bdf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.093270 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.093251 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10cedd26-1c15-44c5-87d5-0df13aa10bdf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.099773 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.099745 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-549mx\" (UniqueName: \"kubernetes.io/projected/10cedd26-1c15-44c5-87d5-0df13aa10bdf-kube-api-access-549mx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj\" (UID: \"10cedd26-1c15-44c5-87d5-0df13aa10bdf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.233897 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.233792 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:16:50.371577 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:50.371545 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj"] Jun 02 20:16:50.373067 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:16:50.373039 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10cedd26_1c15_44c5_87d5_0df13aa10bdf.slice/crio-44ff0ae5f3765dc9285c96eab742f0138ca43ee5363a727a4ad5b5ed50d8ca0b WatchSource:0}: Error finding container 44ff0ae5f3765dc9285c96eab742f0138ca43ee5363a727a4ad5b5ed50d8ca0b: Status 404 returned error can't find the container with id 44ff0ae5f3765dc9285c96eab742f0138ca43ee5363a727a4ad5b5ed50d8ca0b Jun 02 20:16:51.001296 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:51.001257 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:16:51.029897 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:51.029864 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" event={"ID":"10cedd26-1c15-44c5-87d5-0df13aa10bdf","Type":"ContainerStarted","Data":"06a6defef357a4fa4e657801b3a006722774aaa019d4bdea79276f6f917f8bf0"} Jun 02 20:16:51.029897 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:51.029896 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" event={"ID":"10cedd26-1c15-44c5-87d5-0df13aa10bdf","Type":"ContainerStarted","Data":"44ff0ae5f3765dc9285c96eab742f0138ca43ee5363a727a4ad5b5ed50d8ca0b"} Jun 02 20:16:52.035197 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.035110 2544 generic.go:358] "Generic (PLEG): container finished" podID="10cedd26-1c15-44c5-87d5-0df13aa10bdf" containerID="06a6defef357a4fa4e657801b3a006722774aaa019d4bdea79276f6f917f8bf0" exitCode=0 Jun 02 20:16:52.035197 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.035151 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" event={"ID":"10cedd26-1c15-44c5-87d5-0df13aa10bdf","Type":"ContainerDied","Data":"06a6defef357a4fa4e657801b3a006722774aaa019d4bdea79276f6f917f8bf0"} Jun 02 20:16:52.764241 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.764158 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7"] Jun 02 20:16:52.832271 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.832227 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7"] Jun 02 20:16:52.832497 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.832466 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:52.835402 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.835332 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 20:16:52.918538 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.918499 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:52.918538 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.918545 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:52.918810 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.918672 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:52.918810 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.918785 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704e16d5-9f73-472b-bc98-b9e28d91eb37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:52.918810 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.918806 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jczwq\" (UniqueName: \"kubernetes.io/projected/704e16d5-9f73-472b-bc98-b9e28d91eb37-kube-api-access-jczwq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:52.918974 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:52.918831 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020332 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020247 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704e16d5-9f73-472b-bc98-b9e28d91eb37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020332 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020304 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jczwq\" (UniqueName: \"kubernetes.io/projected/704e16d5-9f73-472b-bc98-b9e28d91eb37-kube-api-access-jczwq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020546 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020334 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020546 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020376 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020546 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020441 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020546 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020528 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020847 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020812 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020847 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020838 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.020999 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.020862 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.022688 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.022658 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/704e16d5-9f73-472b-bc98-b9e28d91eb37-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.022784 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.022766 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/704e16d5-9f73-472b-bc98-b9e28d91eb37-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.031677 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.031650 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jczwq\" (UniqueName: \"kubernetes.io/projected/704e16d5-9f73-472b-bc98-b9e28d91eb37-kube-api-access-jczwq\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7\" (UID: \"704e16d5-9f73-472b-bc98-b9e28d91eb37\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.041172 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.041140 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" event={"ID":"10cedd26-1c15-44c5-87d5-0df13aa10bdf","Type":"ContainerStarted","Data":"ad5262c0803a0acfee63326e6a61744234c6ef0e9b00461853302c71e32f49cb"} Jun 02 20:16:53.062552 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.062507 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" podStartSLOduration=3.603676201 podStartE2EDuration="4.06249233s" podCreationTimestamp="2026-06-02 20:16:49 +0000 UTC" firstStartedPulling="2026-06-02 20:16:52.035706204 +0000 UTC m=+883.782488839" lastFinishedPulling="2026-06-02 20:16:52.494522333 +0000 UTC m=+884.241304968" observedRunningTime="2026-06-02 20:16:53.059793545 +0000 UTC m=+884.806576202" watchObservedRunningTime="2026-06-02 20:16:53.06249233 +0000 UTC m=+884.809274986" Jun 02 20:16:53.155922 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.155890 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:16:53.289040 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:53.289009 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7"] Jun 02 20:16:53.290057 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:16:53.290027 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704e16d5_9f73_472b_bc98_b9e28d91eb37.slice/crio-608e085db4a64aacf1de4c49a33274f9cde1b4429f44833700efaf379fe2e56f WatchSource:0}: Error finding container 608e085db4a64aacf1de4c49a33274f9cde1b4429f44833700efaf379fe2e56f: Status 404 returned error can't find the container with id 608e085db4a64aacf1de4c49a33274f9cde1b4429f44833700efaf379fe2e56f Jun 02 20:16:54.046350 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:54.046309 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" event={"ID":"704e16d5-9f73-472b-bc98-b9e28d91eb37","Type":"ContainerStarted","Data":"a899b1b295382b9688093c8468c1dc7ea9f0ea60be2e5b6aacebb0629be557f9"} Jun 02 20:16:54.046350 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:54.046358 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" event={"ID":"704e16d5-9f73-472b-bc98-b9e28d91eb37","Type":"ContainerStarted","Data":"608e085db4a64aacf1de4c49a33274f9cde1b4429f44833700efaf379fe2e56f"} Jun 02 20:16:54.504103 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:54.504066 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:16:55.052360 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:55.052322 2544 generic.go:358] "Generic (PLEG): container finished" podID="704e16d5-9f73-472b-bc98-b9e28d91eb37" containerID="a899b1b295382b9688093c8468c1dc7ea9f0ea60be2e5b6aacebb0629be557f9" exitCode=0 Jun 02 20:16:55.052814 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:55.052375 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" event={"ID":"704e16d5-9f73-472b-bc98-b9e28d91eb37","Type":"ContainerDied","Data":"a899b1b295382b9688093c8468c1dc7ea9f0ea60be2e5b6aacebb0629be557f9"} Jun 02 20:16:56.058928 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:56.058884 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" event={"ID":"704e16d5-9f73-472b-bc98-b9e28d91eb37","Type":"ContainerStarted","Data":"7b28a737d9e0a225113193dbd7561272f303b10cd7fcc073cb9fe569f7ffc54d"} Jun 02 20:16:56.080167 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:56.080114 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" podStartSLOduration=3.79468235 podStartE2EDuration="4.080099241s" podCreationTimestamp="2026-06-02 20:16:52 +0000 UTC" firstStartedPulling="2026-06-02 20:16:55.052951404 +0000 UTC m=+886.799734038" lastFinishedPulling="2026-06-02 20:16:55.338368293 +0000 UTC m=+887.085150929" observedRunningTime="2026-06-02 20:16:56.079112483 +0000 UTC m=+887.825895139" watchObservedRunningTime="2026-06-02 20:16:56.080099241 +0000 UTC m=+887.826881897" Jun 02 20:16:59.044981 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:16:59.044940 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:17:00.234845 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:00.234805 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:17:00.234845 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:00.234850 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:17:00.247369 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:00.247340 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:17:01.089489 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:01.089460 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj" Jun 02 20:17:03.156143 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:03.156111 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:17:03.156143 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:03.156154 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:17:03.168694 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:03.168668 2544 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:17:04.101181 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:04.101145 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7" Jun 02 20:17:09.509528 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:09.509501 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:17:09.509955 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:09.509508 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:17:38.245799 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.245756 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-647456b445-d97b6"] Jun 02 20:17:38.257111 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.257073 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-647456b445-d97b6"] Jun 02 20:17:38.257111 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.257097 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.387932 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.387889 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a80ddac0-4e92-432d-8789-b1f30a3e3859-oidc-ca\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.388111 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.387951 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a80ddac0-4e92-432d-8789-b1f30a3e3859-tls-cert\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.388111 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.387996 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkcxg\" (UniqueName: \"kubernetes.io/projected/a80ddac0-4e92-432d-8789-b1f30a3e3859-kube-api-access-qkcxg\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.488905 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.488851 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qkcxg\" (UniqueName: \"kubernetes.io/projected/a80ddac0-4e92-432d-8789-b1f30a3e3859-kube-api-access-qkcxg\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.489115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.488991 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a80ddac0-4e92-432d-8789-b1f30a3e3859-oidc-ca\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.489115 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.489051 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a80ddac0-4e92-432d-8789-b1f30a3e3859-tls-cert\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.489639 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.489616 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a80ddac0-4e92-432d-8789-b1f30a3e3859-oidc-ca\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.491399 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.491361 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a80ddac0-4e92-432d-8789-b1f30a3e3859-tls-cert\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.497177 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.497120 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkcxg\" (UniqueName: \"kubernetes.io/projected/a80ddac0-4e92-432d-8789-b1f30a3e3859-kube-api-access-qkcxg\") pod \"authorino-647456b445-d97b6\" (UID: \"a80ddac0-4e92-432d-8789-b1f30a3e3859\") " pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.567285 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.567254 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647456b445-d97b6" Jun 02 20:17:38.702754 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.702728 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-647456b445-d97b6"] Jun 02 20:17:38.704377 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:17:38.704341 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda80ddac0_4e92_432d_8789_b1f30a3e3859.slice/crio-0b921caaa51402dbf19744a46bce9ddd49baefea350928395e9ca6ef63643fb0 WatchSource:0}: Error finding container 0b921caaa51402dbf19744a46bce9ddd49baefea350928395e9ca6ef63643fb0: Status 404 returned error can't find the container with id 0b921caaa51402dbf19744a46bce9ddd49baefea350928395e9ca6ef63643fb0 Jun 02 20:17:38.705627 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:38.705605 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:17:39.235084 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.235044 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647456b445-d97b6" event={"ID":"a80ddac0-4e92-432d-8789-b1f30a3e3859","Type":"ContainerStarted","Data":"e13636e82b9cc002173888dfac161f14b6272667f6823b849cbfaee7b1294380"} Jun 02 20:17:39.235258 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.235101 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647456b445-d97b6" event={"ID":"a80ddac0-4e92-432d-8789-b1f30a3e3859","Type":"ContainerStarted","Data":"0b921caaa51402dbf19744a46bce9ddd49baefea350928395e9ca6ef63643fb0"} Jun 02 20:17:39.255218 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.255168 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-647456b445-d97b6" podStartSLOduration=0.852267143 podStartE2EDuration="1.255154134s" podCreationTimestamp="2026-06-02 20:17:38 +0000 UTC" firstStartedPulling="2026-06-02 20:17:38.705724394 +0000 UTC m=+930.452507029" lastFinishedPulling="2026-06-02 20:17:39.108611368 +0000 UTC m=+930.855394020" observedRunningTime="2026-06-02 20:17:39.25261361 +0000 UTC m=+930.999396265" watchObservedRunningTime="2026-06-02 20:17:39.255154134 +0000 UTC m=+931.001936790" Jun 02 20:17:39.284126 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.284092 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c8fbb7b56-6x7jv"] Jun 02 20:17:39.284403 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.284334 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" podUID="65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" containerName="authorino" containerID="cri-o://471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835" gracePeriod=30 Jun 02 20:17:39.555407 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.555357 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:17:39.600942 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.600907 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-tls-cert\") pod \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " Jun 02 20:17:39.601141 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.600970 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-oidc-ca\") pod \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " Jun 02 20:17:39.601141 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.601135 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82p54\" (UniqueName: \"kubernetes.io/projected/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-kube-api-access-82p54\") pod \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\" (UID: \"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185\") " Jun 02 20:17:39.603125 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.603094 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-kube-api-access-82p54" (OuterVolumeSpecName: "kube-api-access-82p54") pod "65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" (UID: "65c27fdb-8f5d-4700-8c7f-2ea17ecf4185"). InnerVolumeSpecName "kube-api-access-82p54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:17:39.608242 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.608216 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" (UID: "65c27fdb-8f5d-4700-8c7f-2ea17ecf4185"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 20:17:39.614832 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.614808 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" (UID: "65c27fdb-8f5d-4700-8c7f-2ea17ecf4185"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 20:17:39.702758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.702652 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82p54\" (UniqueName: \"kubernetes.io/projected/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-kube-api-access-82p54\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:17:39.702758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.702690 2544 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-tls-cert\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:17:39.702758 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:39.702705 2544 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185-oidc-ca\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:17:40.240483 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.240445 2544 generic.go:358] "Generic (PLEG): container finished" podID="65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" containerID="471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835" exitCode=0 Jun 02 20:17:40.240690 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.240503 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" Jun 02 20:17:40.240690 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.240523 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" event={"ID":"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185","Type":"ContainerDied","Data":"471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835"} Jun 02 20:17:40.240690 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.240563 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c8fbb7b56-6x7jv" event={"ID":"65c27fdb-8f5d-4700-8c7f-2ea17ecf4185","Type":"ContainerDied","Data":"80c684761a9fd77f2fffb4d51303fd4167ae4a518bcbf81c1dc4f36c44d5824e"} Jun 02 20:17:40.240690 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.240585 2544 scope.go:117] "RemoveContainer" containerID="471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835" Jun 02 20:17:40.251072 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.251053 2544 scope.go:117] "RemoveContainer" containerID="471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835" Jun 02 20:17:40.251347 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:17:40.251326 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835\": container with ID starting with 471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835 not found: ID does not exist" containerID="471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835" Jun 02 20:17:40.251422 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.251355 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835"} err="failed to get container status \"471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835\": rpc error: code = NotFound desc = could not find container \"471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835\": container with ID starting with 471f9e0680723e7b598de030aa18e91641b2041939d4801598b35c1547c98835 not found: ID does not exist" Jun 02 20:17:40.265185 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.265157 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c8fbb7b56-6x7jv"] Jun 02 20:17:40.270968 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.270946 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c8fbb7b56-6x7jv"] Jun 02 20:17:40.824039 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:17:40.824005 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" path="/var/lib/kubelet/pods/65c27fdb-8f5d-4700-8c7f-2ea17ecf4185/volumes" Jun 02 20:18:12.313613 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:18:12.313580 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:18:23.305538 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:18:23.305495 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:18:32.007750 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:18:32.007660 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:18:43.501702 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:18:43.501665 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:18:51.912542 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:18:51.912508 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:19:01.314596 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:19:01.314557 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:20:17.506621 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:20:17.506590 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:20:32.998019 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:20:32.997974 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:21:11.506096 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:21:11.506058 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:21:28.611703 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:21:28.611620 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:21:42.314361 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:21:42.314322 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:21:58.804171 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:21:58.804135 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:22:09.542060 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:22:09.542032 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:22:09.544139 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:22:09.544117 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:22:56.611194 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:22:56.611113 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:23:05.908989 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:23:05.908953 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:23:21.509360 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:23:21.509315 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:23:31.105971 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:23:31.105929 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:23:47.218345 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:23:47.218305 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:23:56.197787 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:23:56.197752 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:24:27.803809 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:24:27.803726 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:24:36.399927 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:24:36.399893 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:24:45.799447 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:24:45.799414 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:24:53.298288 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:24:53.298246 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:25:01.273095 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:25:01.273059 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:25:09.104055 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:25:09.104013 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:25:14.399941 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:25:14.399899 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:25:19.998457 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:25:19.998424 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:25:32.018545 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:25:32.018509 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:26:21.433012 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:26:21.432968 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:26:29.909050 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:26:29.909006 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:26:35.433666 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:26:35.433625 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:26:43.915106 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:26:43.915066 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:26:53.221329 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:26:53.221290 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:27:00.005789 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:00.005753 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:27:09.575409 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:09.575365 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:27:09.577582 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:09.577562 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:27:10.517615 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:10.517582 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:27:20.012349 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:20.012302 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:27:28.813541 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:28.813447 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:27:35.997528 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:35.997477 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:27:46.509480 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:46.509447 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:27:53.926144 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:27:53.926096 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:28:02.608277 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:28:02.608233 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:28:11.713397 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:28:11.713348 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:28:20.205565 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:28:20.205527 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:28:28.811774 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:28:28.811741 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:28:37.603426 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:28:37.603370 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:28:46.999690 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:28:46.999657 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:29:37.091526 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.091491 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj"] Jun 02 20:29:37.092069 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.091728 2544 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" podUID="47a288fa-d8c1-4e4a-80c7-cda259ea37b2" containerName="manager" containerID="cri-o://54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00" gracePeriod=10 Jun 02 20:29:37.345410 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.345335 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:29:37.454495 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.454462 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpc7d\" (UniqueName: \"kubernetes.io/projected/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-kube-api-access-gpc7d\") pod \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\" (UID: \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\") " Jun 02 20:29:37.454495 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.454500 2544 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-extensions-socket-volume\") pod \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\" (UID: \"47a288fa-d8c1-4e4a-80c7-cda259ea37b2\") " Jun 02 20:29:37.454892 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.454866 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47a288fa-d8c1-4e4a-80c7-cda259ea37b2" (UID: "47a288fa-d8c1-4e4a-80c7-cda259ea37b2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 20:29:37.456464 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.456442 2544 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-kube-api-access-gpc7d" (OuterVolumeSpecName: "kube-api-access-gpc7d") pod "47a288fa-d8c1-4e4a-80c7-cda259ea37b2" (UID: "47a288fa-d8c1-4e4a-80c7-cda259ea37b2"). InnerVolumeSpecName "kube-api-access-gpc7d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 20:29:37.555399 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.555361 2544 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpc7d\" (UniqueName: \"kubernetes.io/projected/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-kube-api-access-gpc7d\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:29:37.555564 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:37.555421 2544 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47a288fa-d8c1-4e4a-80c7-cda259ea37b2-extensions-socket-volume\") on node \"ip-10-0-137-123.ec2.internal\" DevicePath \"\"" Jun 02 20:29:38.119883 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.119847 2544 generic.go:358] "Generic (PLEG): container finished" podID="47a288fa-d8c1-4e4a-80c7-cda259ea37b2" containerID="54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00" exitCode=0 Jun 02 20:29:38.120358 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.119902 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" event={"ID":"47a288fa-d8c1-4e4a-80c7-cda259ea37b2","Type":"ContainerDied","Data":"54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00"} Jun 02 20:29:38.120358 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.119944 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" event={"ID":"47a288fa-d8c1-4e4a-80c7-cda259ea37b2","Type":"ContainerDied","Data":"9fe30f649771bc3e4d9d11df2447f91634bcafc8c7cf220499d2574731e4a3e7"} Jun 02 20:29:38.120358 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.119958 2544 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj" Jun 02 20:29:38.120358 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.119963 2544 scope.go:117] "RemoveContainer" containerID="54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00" Jun 02 20:29:38.130446 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.130426 2544 scope.go:117] "RemoveContainer" containerID="54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00" Jun 02 20:29:38.130713 ip-10-0-137-123 kubenswrapper[2544]: E0602 20:29:38.130694 2544 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00\": container with ID starting with 54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00 not found: ID does not exist" containerID="54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00" Jun 02 20:29:38.130759 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.130719 2544 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00"} err="failed to get container status \"54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00\": rpc error: code = NotFound desc = could not find container \"54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00\": container with ID starting with 54062ef725172c3c48d4396a1d3b1da3aa9ff0183d5ae36e4777e422271e1d00 not found: ID does not exist" Jun 02 20:29:38.143152 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.143130 2544 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj"] Jun 02 20:29:38.146752 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.146730 2544 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-cf9qj"] Jun 02 20:29:38.825479 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:29:38.825446 2544 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47a288fa-d8c1-4e4a-80c7-cda259ea37b2" path="/var/lib/kubelet/pods/47a288fa-d8c1-4e4a-80c7-cda259ea37b2/volumes" Jun 02 20:30:43.236037 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.235951 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4"] Jun 02 20:30:43.236604 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.236572 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" containerName="authorino" Jun 02 20:30:43.236604 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.236588 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" containerName="authorino" Jun 02 20:30:43.236716 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.236628 2544 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47a288fa-d8c1-4e4a-80c7-cda259ea37b2" containerName="manager" Jun 02 20:30:43.236716 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.236636 2544 state_mem.go:107] "Deleted CPUSet assignment" podUID="47a288fa-d8c1-4e4a-80c7-cda259ea37b2" containerName="manager" Jun 02 20:30:43.236780 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.236730 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="47a288fa-d8c1-4e4a-80c7-cda259ea37b2" containerName="manager" Jun 02 20:30:43.236780 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.236745 2544 memory_manager.go:356] "RemoveStaleState removing state" podUID="65c27fdb-8f5d-4700-8c7f-2ea17ecf4185" containerName="authorino" Jun 02 20:30:43.240106 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.240086 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:43.245579 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.245555 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9zl24\"" Jun 02 20:30:43.258877 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.258852 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4"] Jun 02 20:30:43.281154 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.281121 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8j5r\" (UniqueName: \"kubernetes.io/projected/58650207-6b58-4684-927a-e52ee2a603b4-kube-api-access-t8j5r\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lskz4\" (UID: \"58650207-6b58-4684-927a-e52ee2a603b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:43.281333 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.281305 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58650207-6b58-4684-927a-e52ee2a603b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lskz4\" (UID: \"58650207-6b58-4684-927a-e52ee2a603b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:43.382815 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.382780 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58650207-6b58-4684-927a-e52ee2a603b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lskz4\" (UID: \"58650207-6b58-4684-927a-e52ee2a603b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:43.383026 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.382845 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8j5r\" (UniqueName: \"kubernetes.io/projected/58650207-6b58-4684-927a-e52ee2a603b4-kube-api-access-t8j5r\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lskz4\" (UID: \"58650207-6b58-4684-927a-e52ee2a603b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:43.383223 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.383201 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58650207-6b58-4684-927a-e52ee2a603b4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lskz4\" (UID: \"58650207-6b58-4684-927a-e52ee2a603b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:43.393436 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.393410 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8j5r\" (UniqueName: \"kubernetes.io/projected/58650207-6b58-4684-927a-e52ee2a603b4-kube-api-access-t8j5r\") pod \"kuadrant-operator-controller-manager-55c7f4c975-lskz4\" (UID: \"58650207-6b58-4684-927a-e52ee2a603b4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:43.550160 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.550067 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:43.693615 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.693582 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4"] Jun 02 20:30:43.694535 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:30:43.694499 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58650207_6b58_4684_927a_e52ee2a603b4.slice/crio-fcf5506cc7cf2cbd5dde70ad165956ca122d84602fcee1f1d0acf3ecd32b70a3 WatchSource:0}: Error finding container fcf5506cc7cf2cbd5dde70ad165956ca122d84602fcee1f1d0acf3ecd32b70a3: Status 404 returned error can't find the container with id fcf5506cc7cf2cbd5dde70ad165956ca122d84602fcee1f1d0acf3ecd32b70a3 Jun 02 20:30:43.696713 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:43.696693 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:30:44.373597 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:44.373561 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" event={"ID":"58650207-6b58-4684-927a-e52ee2a603b4","Type":"ContainerStarted","Data":"84790095577fb1e083e3c47aef699b413870c63e16bd079ac0a41b9c0ce278e8"} Jun 02 20:30:44.373964 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:44.373608 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:30:44.373964 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:44.373623 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" event={"ID":"58650207-6b58-4684-927a-e52ee2a603b4","Type":"ContainerStarted","Data":"fcf5506cc7cf2cbd5dde70ad165956ca122d84602fcee1f1d0acf3ecd32b70a3"} Jun 02 20:30:44.400925 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:44.400879 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" podStartSLOduration=1.400864599 podStartE2EDuration="1.400864599s" podCreationTimestamp="2026-06-02 20:30:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:30:44.397648124 +0000 UTC m=+1716.144430787" watchObservedRunningTime="2026-06-02 20:30:44.400864599 +0000 UTC m=+1716.147647255" Jun 02 20:30:55.381211 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:30:55.381179 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-lskz4" Jun 02 20:31:04.900238 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:31:04.900202 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:31:12.807193 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:31:12.807155 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:31:35.902759 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:31:35.902722 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:31:44.004402 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:31:44.004346 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:31:53.230233 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:31:53.230197 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:32:03.910819 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:32:03.910785 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:32:09.606972 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:32:09.606944 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:32:09.610698 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:32:09.610677 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:32:12.705122 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:32:12.705082 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:32:23.310069 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:32:23.310024 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:32:32.102656 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:32:32.102612 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:32:42.810276 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:32:42.810245 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:32:51.509042 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:32:51.509001 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:33:02.308485 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:33:02.308441 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:33:10.811075 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:33:10.811042 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:33:46.003671 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:33:46.003587 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:34:28.841517 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:34:28.841477 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:34:38.646633 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:34:38.646591 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:34:47.359518 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:34:47.359486 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:34:55.156689 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:34:55.156635 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:35:03.923093 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:35:03.923056 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:35:17.445803 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:35:17.445762 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:35:26.849958 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:35:26.849914 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:35:35.064839 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:35:35.064805 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:35:45.550448 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:35:45.550408 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:35:52.583361 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:35:52.583318 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:36:00.619425 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:36:00.619379 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:36:12.433196 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:36:12.433157 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:36:29.728228 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:36:29.728134 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:36:39.116544 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:36:39.116506 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:36:47.920928 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:36:47.920893 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:36:54.517875 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:36:54.517834 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:37:09.652623 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:37:09.652597 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:37:09.660591 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:37:09.660569 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vq2bj_1e1e183e-9a8f-495f-88ad-0d1fcc510ce2/ovn-acl-logging/0.log" Jun 02 20:37:13.520949 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:37:13.520915 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:37:21.511554 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:37:21.511520 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:37:30.109586 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:37:30.109547 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:37:37.208579 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:37:37.208542 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:37:47.615426 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:37:47.615377 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:37:54.811131 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:37:54.811092 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:38:05.012288 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:38:05.012248 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:38:18.012149 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:38:18.012111 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:38:26.515405 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:38:26.515359 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:38:39.819182 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:38:39.819143 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:38:51.207244 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:38:51.207206 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:38:58.767985 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:38:58.767945 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:39:04.813354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:39:04.813313 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:39:15.117969 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:39:15.117931 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:39:33.430088 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:39:33.430007 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:39:41.724319 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:39:41.724283 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:39:50.314625 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:39:50.314587 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:40:01.336899 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:01.336868 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:40:24.917886 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:24.917851 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:40:37.110945 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:37.110911 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qjqlh"] Jun 02 20:40:42.082911 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:42.082870 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-647456b445-d97b6_a80ddac0-4e92-432d-8789-b1f30a3e3859/authorino/0.log" Jun 02 20:40:46.969558 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:46.969528 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64d74bb8cd-xnfhg_e54639c4-e4da-42ea-8fdf-507210a96608/nginx/0.log" Jun 02 20:40:48.178277 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:48.178244 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b87b6c86-k7725_ab05963d-f959-406b-90fd-2c76c91dde45/copy-manifests/0.log" Jun 02 20:40:48.187240 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:48.187214 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b87b6c86-k7725_ab05963d-f959-406b-90fd-2c76c91dde45/manager/0.log" Jun 02 20:40:49.080594 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.080567 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b_4ba364c6-c3d6-43e4-83cf-f970456284f1/util/0.log" Jun 02 20:40:49.088041 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.088023 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b_4ba364c6-c3d6-43e4-83cf-f970456284f1/pull/0.log" Jun 02 20:40:49.095896 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.095849 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b_4ba364c6-c3d6-43e4-83cf-f970456284f1/extract/0.log" Jun 02 20:40:49.217453 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.217424 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6_d5be48cc-8436-47c6-bfbc-7709893656f5/util/0.log" Jun 02 20:40:49.227833 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.227812 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6_d5be48cc-8436-47c6-bfbc-7709893656f5/pull/0.log" Jun 02 20:40:49.238219 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.238199 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6_d5be48cc-8436-47c6-bfbc-7709893656f5/extract/0.log" Jun 02 20:40:49.357717 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.357643 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb_545706f1-c651-439a-998c-c842c933cb1f/util/0.log" Jun 02 20:40:49.365178 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.365160 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb_545706f1-c651-439a-998c-c842c933cb1f/pull/0.log" Jun 02 20:40:49.371918 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.371898 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb_545706f1-c651-439a-998c-c842c933cb1f/extract/0.log" Jun 02 20:40:49.489790 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.489765 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w_577e9d4a-21ac-4bd4-9dcb-4c177906bcb4/util/0.log" Jun 02 20:40:49.497010 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.496992 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w_577e9d4a-21ac-4bd4-9dcb-4c177906bcb4/pull/0.log" Jun 02 20:40:49.503208 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.503175 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w_577e9d4a-21ac-4bd4-9dcb-4c177906bcb4/extract/0.log" Jun 02 20:40:49.626151 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.626070 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-647456b445-d97b6_a80ddac0-4e92-432d-8789-b1f30a3e3859/authorino/0.log" Jun 02 20:40:49.864499 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:49.864462 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-jjgjr_8c23d293-4942-49ba-b641-b794113f3a24/manager/0.log" Jun 02 20:40:50.097499 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:50.097469 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cz6pz_11368cf3-b80e-4d82-9ed2-f813a0d4941f/registry-server/0.log" Jun 02 20:40:50.223325 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:50.223296 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-lskz4_58650207-6b58-4684-927a-e52ee2a603b4/manager/0.log" Jun 02 20:40:50.351908 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:50.351804 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-qjqlh_c07681f4-7b98-4508-9826-c70f26462b19/limitador/0.log" Jun 02 20:40:50.837567 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:50.837540 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws_e63ff767-54a9-4ead-8031-f5c6068ddd63/istio-proxy/0.log" Jun 02 20:40:51.340635 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:51.340593 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-qqdpk_8c739841-a2e0-4f16-b9fa-0c20ac4f2463/istio-proxy/0.log" Jun 02 20:40:51.582595 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:51.582567 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-77c68fbff5-vzz4q_60fcb7c0-c38a-492f-96c6-590a843de920/router/0.log" Jun 02 20:40:52.070512 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:52.070486 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-k77pd_ca88a12b-39a1-4e3b-a13b-664f5d6778ea/storage-initializer/0.log" Jun 02 20:40:52.083431 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:52.083368 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-k77pd_ca88a12b-39a1-4e3b-a13b-664f5d6778ea/main/0.log" Jun 02 20:40:52.325002 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:52.324923 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj_10cedd26-1c15-44c5-87d5-0df13aa10bdf/storage-initializer/0.log" Jun 02 20:40:52.333107 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:52.333084 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9gk2bj_10cedd26-1c15-44c5-87d5-0df13aa10bdf/main/0.log" Jun 02 20:40:52.452004 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:52.451971 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7_704e16d5-9f73-472b-bc98-b9e28d91eb37/storage-initializer/0.log" Jun 02 20:40:52.460106 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:52.460076 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-8b5j7_704e16d5-9f73-472b-bc98-b9e28d91eb37/main/0.log" Jun 02 20:40:56.585333 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.585237 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fl6xc/must-gather-kj8qh"] Jun 02 20:40:56.589318 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.589297 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6xc/must-gather-kj8qh" Jun 02 20:40:56.592460 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.592442 2544 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fl6xc\"/\"default-dockercfg-4c8mf\"" Jun 02 20:40:56.593627 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.593608 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6xc\"/\"kube-root-ca.crt\"" Jun 02 20:40:56.593725 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.593635 2544 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6xc\"/\"openshift-service-ca.crt\"" Jun 02 20:40:56.611774 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.611746 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6xc/must-gather-kj8qh"] Jun 02 20:40:56.731911 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.731879 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmgc5\" (UniqueName: \"kubernetes.io/projected/a1cc16ce-c186-4f9c-8453-31f518059dc7-kube-api-access-zmgc5\") pod \"must-gather-kj8qh\" (UID: \"a1cc16ce-c186-4f9c-8453-31f518059dc7\") " pod="openshift-must-gather-fl6xc/must-gather-kj8qh" Jun 02 20:40:56.732059 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.731950 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a1cc16ce-c186-4f9c-8453-31f518059dc7-must-gather-output\") pod \"must-gather-kj8qh\" (UID: \"a1cc16ce-c186-4f9c-8453-31f518059dc7\") " pod="openshift-must-gather-fl6xc/must-gather-kj8qh" Jun 02 20:40:56.833299 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.833268 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a1cc16ce-c186-4f9c-8453-31f518059dc7-must-gather-output\") pod \"must-gather-kj8qh\" (UID: \"a1cc16ce-c186-4f9c-8453-31f518059dc7\") " pod="openshift-must-gather-fl6xc/must-gather-kj8qh" Jun 02 20:40:56.833524 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.833348 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmgc5\" (UniqueName: \"kubernetes.io/projected/a1cc16ce-c186-4f9c-8453-31f518059dc7-kube-api-access-zmgc5\") pod \"must-gather-kj8qh\" (UID: \"a1cc16ce-c186-4f9c-8453-31f518059dc7\") " pod="openshift-must-gather-fl6xc/must-gather-kj8qh" Jun 02 20:40:56.833624 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.833604 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a1cc16ce-c186-4f9c-8453-31f518059dc7-must-gather-output\") pod \"must-gather-kj8qh\" (UID: \"a1cc16ce-c186-4f9c-8453-31f518059dc7\") " pod="openshift-must-gather-fl6xc/must-gather-kj8qh" Jun 02 20:40:56.843491 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.843432 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmgc5\" (UniqueName: \"kubernetes.io/projected/a1cc16ce-c186-4f9c-8453-31f518059dc7-kube-api-access-zmgc5\") pod \"must-gather-kj8qh\" (UID: \"a1cc16ce-c186-4f9c-8453-31f518059dc7\") " pod="openshift-must-gather-fl6xc/must-gather-kj8qh" Jun 02 20:40:56.898452 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:56.898422 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6xc/must-gather-kj8qh" Jun 02 20:40:57.035952 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:57.035924 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6xc/must-gather-kj8qh"] Jun 02 20:40:57.037771 ip-10-0-137-123 kubenswrapper[2544]: W0602 20:40:57.037739 2544 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1cc16ce_c186_4f9c_8453_31f518059dc7.slice/crio-9dda0cc230b9039b756149d179dc82b62863cc42aad4048d96bc6e6c6e6cab27 WatchSource:0}: Error finding container 9dda0cc230b9039b756149d179dc82b62863cc42aad4048d96bc6e6c6e6cab27: Status 404 returned error can't find the container with id 9dda0cc230b9039b756149d179dc82b62863cc42aad4048d96bc6e6c6e6cab27 Jun 02 20:40:57.039450 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:57.039432 2544 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 20:40:57.812121 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:57.812082 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6xc/must-gather-kj8qh" event={"ID":"a1cc16ce-c186-4f9c-8453-31f518059dc7","Type":"ContainerStarted","Data":"9dda0cc230b9039b756149d179dc82b62863cc42aad4048d96bc6e6c6e6cab27"} Jun 02 20:40:58.817662 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:58.817624 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6xc/must-gather-kj8qh" event={"ID":"a1cc16ce-c186-4f9c-8453-31f518059dc7","Type":"ContainerStarted","Data":"cb739f07f5d1d592f0b8bf9af2e7edb7e4063b665518fd9c9e5f2609d1ed5ce7"} Jun 02 20:40:58.817662 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:58.817666 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6xc/must-gather-kj8qh" event={"ID":"a1cc16ce-c186-4f9c-8453-31f518059dc7","Type":"ContainerStarted","Data":"6ac8184d7357bd872bf597051f459cbd03a724e5c2123d028146afbb5cc2eeb7"} Jun 02 20:40:58.839572 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:58.839512 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fl6xc/must-gather-kj8qh" podStartSLOduration=1.949922836 podStartE2EDuration="2.839492817s" podCreationTimestamp="2026-06-02 20:40:56 +0000 UTC" firstStartedPulling="2026-06-02 20:40:57.039564427 +0000 UTC m=+2328.786347075" lastFinishedPulling="2026-06-02 20:40:57.92913442 +0000 UTC m=+2329.675917056" observedRunningTime="2026-06-02 20:40:58.836163462 +0000 UTC m=+2330.582946120" watchObservedRunningTime="2026-06-02 20:40:58.839492817 +0000 UTC m=+2330.586275475" Jun 02 20:40:59.899609 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:59.899576 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lqh67_072e5ffc-7196-49e7-b4c9-9ec8878c986d/global-pull-secret-syncer/0.log" Jun 02 20:40:59.951166 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:40:59.951120 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5wx8b_3fb61da0-26a0-4da3-84d9-3bc8dc3edaf5/konnectivity-agent/0.log" Jun 02 20:41:00.080598 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:00.080560 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-123.ec2.internal_791f919f437f144cbf47c92868e52a9c/haproxy/0.log" Jun 02 20:41:04.327211 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.327102 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b_4ba364c6-c3d6-43e4-83cf-f970456284f1/extract/0.log" Jun 02 20:41:04.355893 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.355860 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b_4ba364c6-c3d6-43e4-83cf-f970456284f1/util/0.log" Jun 02 20:41:04.389363 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.389311 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t7r9b_4ba364c6-c3d6-43e4-83cf-f970456284f1/pull/0.log" Jun 02 20:41:04.418573 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.418512 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6_d5be48cc-8436-47c6-bfbc-7709893656f5/extract/0.log" Jun 02 20:41:04.442464 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.442433 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6_d5be48cc-8436-47c6-bfbc-7709893656f5/util/0.log" Jun 02 20:41:04.467543 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.467506 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02mqx6_d5be48cc-8436-47c6-bfbc-7709893656f5/pull/0.log" Jun 02 20:41:04.500933 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.500906 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb_545706f1-c651-439a-998c-c842c933cb1f/extract/0.log" Jun 02 20:41:04.525763 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.525737 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb_545706f1-c651-439a-998c-c842c933cb1f/util/0.log" Jun 02 20:41:04.550179 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.550137 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736z5kb_545706f1-c651-439a-998c-c842c933cb1f/pull/0.log" Jun 02 20:41:04.593095 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.592999 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w_577e9d4a-21ac-4bd4-9dcb-4c177906bcb4/extract/0.log" Jun 02 20:41:04.632854 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.632819 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w_577e9d4a-21ac-4bd4-9dcb-4c177906bcb4/util/0.log" Jun 02 20:41:04.686080 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:04.686051 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xz97w_577e9d4a-21ac-4bd4-9dcb-4c177906bcb4/pull/0.log" Jun 02 20:41:05.016409 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:05.016362 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-647456b445-d97b6_a80ddac0-4e92-432d-8789-b1f30a3e3859/authorino/0.log" Jun 02 20:41:05.095846 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:05.095818 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-jjgjr_8c23d293-4942-49ba-b641-b794113f3a24/manager/0.log" Jun 02 20:41:05.166941 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:05.166895 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cz6pz_11368cf3-b80e-4d82-9ed2-f813a0d4941f/registry-server/0.log" Jun 02 20:41:05.238600 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:05.238557 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-lskz4_58650207-6b58-4684-927a-e52ee2a603b4/manager/0.log" Jun 02 20:41:05.262786 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:05.262755 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-qjqlh_c07681f4-7b98-4508-9826-c70f26462b19/limitador/0.log" Jun 02 20:41:06.933071 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:06.933040 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5c08ecb-c002-4680-941a-92e0c6429a0c/alertmanager/0.log" Jun 02 20:41:06.957113 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:06.957086 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5c08ecb-c002-4680-941a-92e0c6429a0c/config-reloader/0.log" Jun 02 20:41:06.990462 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:06.990351 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5c08ecb-c002-4680-941a-92e0c6429a0c/kube-rbac-proxy-web/0.log" Jun 02 20:41:07.021001 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.020964 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5c08ecb-c002-4680-941a-92e0c6429a0c/kube-rbac-proxy/0.log" Jun 02 20:41:07.047979 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.047941 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5c08ecb-c002-4680-941a-92e0c6429a0c/kube-rbac-proxy-metric/0.log" Jun 02 20:41:07.071548 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.071516 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5c08ecb-c002-4680-941a-92e0c6429a0c/prom-label-proxy/0.log" Jun 02 20:41:07.107273 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.107237 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a5c08ecb-c002-4680-941a-92e0c6429a0c/init-config-reloader/0.log" Jun 02 20:41:07.163516 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.163483 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-mbfqd_ec0ebcd4-9a62-4f3c-904d-e8127b8bb97b/cluster-monitoring-operator/0.log" Jun 02 20:41:07.201453 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.201358 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-2n8rt_a510d05b-ad3e-4b3a-a78e-546fbb860d92/kube-state-metrics/0.log" Jun 02 20:41:07.225076 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.225046 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-2n8rt_a510d05b-ad3e-4b3a-a78e-546fbb860d92/kube-rbac-proxy-main/0.log" Jun 02 20:41:07.253872 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.253834 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-2n8rt_a510d05b-ad3e-4b3a-a78e-546fbb860d92/kube-rbac-proxy-self/0.log" Jun 02 20:41:07.314024 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.313996 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-rg2n7_805fd5ab-a364-4045-a1e9-34500f965e26/monitoring-plugin/0.log" Jun 02 20:41:07.360447 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.360418 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qq9h_94316b4f-d751-464c-b1c1-522c396961ea/node-exporter/0.log" Jun 02 20:41:07.386571 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.386544 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qq9h_94316b4f-d751-464c-b1c1-522c396961ea/kube-rbac-proxy/0.log" Jun 02 20:41:07.411857 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.411819 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4qq9h_94316b4f-d751-464c-b1c1-522c396961ea/init-textfile/0.log" Jun 02 20:41:07.974346 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:07.974309 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8599f68b46-nmghx_b05a5386-d374-40a9-8f5b-b89039768dfa/telemeter-client/0.log" Jun 02 20:41:08.000728 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:08.000700 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8599f68b46-nmghx_b05a5386-d374-40a9-8f5b-b89039768dfa/reload/0.log" Jun 02 20:41:08.023094 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:08.023066 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8599f68b46-nmghx_b05a5386-d374-40a9-8f5b-b89039768dfa/kube-rbac-proxy/0.log" Jun 02 20:41:08.055669 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:08.055639 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68955fcbdf-c9zgd_6e6ef9f2-e46a-4538-9891-ce636e2581ef/thanos-query/0.log" Jun 02 20:41:08.079005 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:08.078935 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68955fcbdf-c9zgd_6e6ef9f2-e46a-4538-9891-ce636e2581ef/kube-rbac-proxy-web/0.log" Jun 02 20:41:08.106117 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:08.106090 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68955fcbdf-c9zgd_6e6ef9f2-e46a-4538-9891-ce636e2581ef/kube-rbac-proxy/0.log" Jun 02 20:41:08.131739 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:08.131713 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68955fcbdf-c9zgd_6e6ef9f2-e46a-4538-9891-ce636e2581ef/prom-label-proxy/0.log" Jun 02 20:41:08.153235 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:08.153202 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68955fcbdf-c9zgd_6e6ef9f2-e46a-4538-9891-ce636e2581ef/kube-rbac-proxy-rules/0.log" Jun 02 20:41:08.178364 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:08.178335 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68955fcbdf-c9zgd_6e6ef9f2-e46a-4538-9891-ce636e2581ef/kube-rbac-proxy-metrics/0.log" Jun 02 20:41:10.350166 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.350134 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7546bff6fd-jdwsb_8374b69f-02ec-4333-b608-b2abd54b8e97/console/0.log" Jun 02 20:41:10.382095 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.382063 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-4cw5q_f30db05c-08a5-4abd-b2b5-2a8d4725737f/download-server/0.log" Jun 02 20:41:10.663722 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.663680 2544 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg"] Jun 02 20:41:10.671421 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.671375 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.674863 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.674832 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg"] Jun 02 20:41:10.797632 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.797594 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-podres\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.797632 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.797640 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6grhd\" (UniqueName: \"kubernetes.io/projected/ac71146c-bee9-4ac7-9090-ac05cfefe152-kube-api-access-6grhd\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.797883 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.797710 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-sys\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.797883 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.797789 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-lib-modules\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.797883 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.797868 2544 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-proc\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.884178 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.884145 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-2tqpn_896caa5c-6065-4494-974c-76f28db23a6a/volume-data-source-validator/0.log" Jun 02 20:41:10.898582 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.898551 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-sys\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.898808 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.898788 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-sys\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.898997 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.898965 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-lib-modules\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.899068 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.899038 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-proc\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.899143 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.899122 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-proc\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.899200 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.899139 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-lib-modules\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.899257 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.899198 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-podres\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.899257 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.899231 2544 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6grhd\" (UniqueName: \"kubernetes.io/projected/ac71146c-bee9-4ac7-9090-ac05cfefe152-kube-api-access-6grhd\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.899371 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.899347 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac71146c-bee9-4ac7-9090-ac05cfefe152-podres\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.909534 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.909484 2544 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6grhd\" (UniqueName: \"kubernetes.io/projected/ac71146c-bee9-4ac7-9090-ac05cfefe152-kube-api-access-6grhd\") pod \"perf-node-gather-daemonset-xztpg\" (UID: \"ac71146c-bee9-4ac7-9090-ac05cfefe152\") " pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:10.984247 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:10.984139 2544 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:11.149705 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:11.149362 2544 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg"] Jun 02 20:41:11.857063 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:11.857029 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6mgpm_cb902210-6e13-46bf-bc36-c3462adaffba/dns/0.log" Jun 02 20:41:11.877805 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:11.877781 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6mgpm_cb902210-6e13-46bf-bc36-c3462adaffba/kube-rbac-proxy/0.log" Jun 02 20:41:11.885452 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:11.885421 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" event={"ID":"ac71146c-bee9-4ac7-9090-ac05cfefe152","Type":"ContainerStarted","Data":"6db1d109458eae7ed45194f85d9afe9a8ba166c72d5fca39a679463712f43fee"} Jun 02 20:41:11.885614 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:11.885462 2544 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" event={"ID":"ac71146c-bee9-4ac7-9090-ac05cfefe152","Type":"ContainerStarted","Data":"e3fd568caac4c32934cbb911961c4043787bf68b444ffb094c3460b68bf127b9"} Jun 02 20:41:11.885614 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:11.885558 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:11.904585 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:11.904537 2544 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" podStartSLOduration=1.904522834 podStartE2EDuration="1.904522834s" podCreationTimestamp="2026-06-02 20:41:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 20:41:11.902609705 +0000 UTC m=+2343.649392369" watchObservedRunningTime="2026-06-02 20:41:11.904522834 +0000 UTC m=+2343.651305490" Jun 02 20:41:11.991308 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:11.991274 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fcpd_6b123b60-d330-48ca-8f2c-1967abd41ce7/dns-node-resolver/0.log" Jun 02 20:41:12.515877 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:12.515846 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f4987f89d-hsksw_713333d3-6a0d-48a3-942f-2ccebc555589/registry/0.log" Jun 02 20:41:12.580565 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:12.580531 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqbfc_ba40bfef-d03e-40f1-8c51-58c0a44374f7/node-ca/0.log" Jun 02 20:41:13.435518 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:13.435481 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bmk2ws_e63ff767-54a9-4ead-8031-f5c6068ddd63/istio-proxy/0.log" Jun 02 20:41:13.631633 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:13.631599 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-qqdpk_8c739841-a2e0-4f16-b9fa-0c20ac4f2463/istio-proxy/0.log" Jun 02 20:41:13.721152 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:13.721072 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-77c68fbff5-vzz4q_60fcb7c0-c38a-492f-96c6-590a843de920/router/0.log" Jun 02 20:41:14.317257 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:14.317229 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2qn84_b8f74370-b367-4258-9da0-f00e35a438d9/serve-healthcheck-canary/0.log" Jun 02 20:41:14.838245 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:14.838213 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-2dsqx_7adfe181-c23f-4d0b-bb13-d20112279078/insights-operator/0.log" Jun 02 20:41:14.840290 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:14.840257 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-2dsqx_7adfe181-c23f-4d0b-bb13-d20112279078/insights-operator/1.log" Jun 02 20:41:14.866035 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:14.866013 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4gvw_bf750d6b-c435-4198-851f-743a9f664a30/kube-rbac-proxy/0.log" Jun 02 20:41:14.890354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:14.890320 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4gvw_bf750d6b-c435-4198-851f-743a9f664a30/exporter/0.log" Jun 02 20:41:14.912270 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:14.912249 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4gvw_bf750d6b-c435-4198-851f-743a9f664a30/extractor/0.log" Jun 02 20:41:17.230660 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:17.230618 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64d74bb8cd-xnfhg_e54639c4-e4da-42ea-8fdf-507210a96608/nginx/0.log" Jun 02 20:41:17.741987 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:17.741955 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b87b6c86-k7725_ab05963d-f959-406b-90fd-2c76c91dde45/manager/0.log" Jun 02 20:41:17.762908 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:17.762883 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58b87b6c86-k7725_ab05963d-f959-406b-90fd-2c76c91dde45/copy-manifests/0.log" Jun 02 20:41:17.903371 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:17.903344 2544 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fl6xc/perf-node-gather-daemonset-xztpg" Jun 02 20:41:19.211891 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:19.211856 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f89f75957-77sd2_4b904a22-a03b-4b21-a8be-8068005c9a84/manager/0.log" Jun 02 20:41:19.271354 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:19.271324 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-g7269_eb2b4330-5c5e-487d-a41d-df0085665dad/openshift-lws-operator/0.log" Jun 02 20:41:25.970111 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:25.970077 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5t9zk_c0a783bc-ea3b-43c8-b1c8-ed182108d5e7/kube-multus-additional-cni-plugins/0.log" Jun 02 20:41:25.998358 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:25.998326 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5t9zk_c0a783bc-ea3b-43c8-b1c8-ed182108d5e7/egress-router-binary-copy/0.log" Jun 02 20:41:26.021343 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:26.021303 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5t9zk_c0a783bc-ea3b-43c8-b1c8-ed182108d5e7/cni-plugins/0.log" Jun 02 20:41:26.045399 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:26.045354 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5t9zk_c0a783bc-ea3b-43c8-b1c8-ed182108d5e7/bond-cni-plugin/0.log" Jun 02 20:41:26.067818 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:26.067794 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5t9zk_c0a783bc-ea3b-43c8-b1c8-ed182108d5e7/routeoverride-cni/0.log" Jun 02 20:41:26.091937 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:26.091914 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5t9zk_c0a783bc-ea3b-43c8-b1c8-ed182108d5e7/whereabouts-cni-bincopy/0.log" Jun 02 20:41:26.116676 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:26.116647 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5t9zk_c0a783bc-ea3b-43c8-b1c8-ed182108d5e7/whereabouts-cni/0.log" Jun 02 20:41:26.639097 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:26.639066 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j2j2l_fe9034d3-2233-42a4-8b9a-774a3338f17e/kube-multus/0.log" Jun 02 20:41:26.738621 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:26.738595 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jscwj_c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0/network-metrics-daemon/0.log" Jun 02 20:41:26.758547 ip-10-0-137-123 kubenswrapper[2544]: I0602 20:41:26.758522 2544 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jscwj_c8f8f571-d7ea-40ac-b14b-5fda6b6d95a0/kube-rbac-proxy/0.log"