Jun 02 18:39:47.227144 ip-10-0-130-211 systemd[1]: Starting Kubernetes Kubelet... Jun 02 18:39:47.630949 ip-10-0-130-211 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:47.630949 ip-10-0-130-211 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 18:39:47.630949 ip-10-0-130-211 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:47.630949 ip-10-0-130-211 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 18:39:47.630949 ip-10-0-130-211 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:47.632410 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.632322 2561 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 18:39:47.636955 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636930 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:47.636955 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636951 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:47.636955 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636954 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:47.636955 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636957 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:47.636955 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636960 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636964 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636967 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636970 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636972 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636975 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636978 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636981 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636983 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636986 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636988 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636991 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636994 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636996 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.636999 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637001 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637003 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637006 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637009 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637012 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:47.637152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637014 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637017 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637020 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637022 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637025 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637027 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637030 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637032 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637035 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637038 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637040 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637043 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637045 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637048 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637052 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637055 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637057 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637059 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637062 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637065 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:47.637626 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637067 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637070 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637073 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637076 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637078 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637080 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637083 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637087 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637092 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637095 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637098 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637100 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637103 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637106 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637109 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637112 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637114 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637124 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637127 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:47.638127 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637129 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637132 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637134 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637137 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637140 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637142 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637145 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637148 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637151 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637155 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637158 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637161 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637164 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637166 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637169 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637173 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637176 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637178 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637181 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:47.638587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637184 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637186 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637190 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637194 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637624 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637631 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637635 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637639 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637642 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637645 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637648 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637650 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637654 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637656 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637659 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637661 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637664 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637666 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637669 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637671 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:47.639114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637675 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637678 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637681 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637683 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637686 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637689 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637692 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637694 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637698 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637700 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637702 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637706 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637708 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637712 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637716 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637718 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637721 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637723 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637726 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:47.639601 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637729 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637732 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637735 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637737 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637740 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637743 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637745 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637748 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637750 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637753 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637756 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637758 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637761 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637763 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637766 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637768 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637771 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637774 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637776 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637778 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:47.640184 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637781 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637784 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637787 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637790 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637792 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637795 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637798 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637800 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637803 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637805 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637808 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637810 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637816 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637818 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637821 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637823 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637840 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637843 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637845 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637848 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:47.640674 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637850 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637853 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637855 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637858 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637861 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637864 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637866 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637869 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637871 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637874 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.637876 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638484 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638495 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638502 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638507 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638512 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638516 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638520 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638524 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638527 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638530 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 18:39:47.641186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638534 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638537 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638540 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638545 2561 flags.go:64] FLAG: --cgroup-root="" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638547 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638550 2561 flags.go:64] FLAG: --client-ca-file="" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638553 2561 flags.go:64] FLAG: --cloud-config="" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638556 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638559 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638563 2561 flags.go:64] FLAG: --cluster-domain="" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638566 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638569 2561 flags.go:64] FLAG: --config-dir="" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638571 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638574 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638578 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638581 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638585 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638588 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638591 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638594 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638598 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638601 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638605 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638609 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638612 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 18:39:47.641710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638614 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638617 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638621 2561 flags.go:64] FLAG: --enable-server="true" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638624 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638629 2561 flags.go:64] FLAG: --event-burst="100" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638631 2561 flags.go:64] FLAG: --event-qps="50" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638634 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638637 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638640 2561 flags.go:64] FLAG: --eviction-hard="" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638643 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638648 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638650 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638654 2561 flags.go:64] FLAG: --eviction-soft="" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638657 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638660 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638663 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638666 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638669 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638671 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638674 2561 flags.go:64] FLAG: --feature-gates="" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638678 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638681 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638684 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638687 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638689 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 02 18:39:47.642315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638692 2561 flags.go:64] FLAG: --help="false" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638695 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-130-211.ec2.internal" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638698 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638701 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638704 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638707 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638710 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638713 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638716 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638718 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638722 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638725 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638728 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638731 2561 flags.go:64] FLAG: --kube-reserved="" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638734 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638736 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638740 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638744 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638746 2561 flags.go:64] FLAG: --lock-file="" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638749 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638753 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638756 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638761 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 18:39:47.642937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638764 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638767 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638769 2561 flags.go:64] FLAG: --logging-format="text" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638772 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638775 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638778 2561 flags.go:64] FLAG: --manifest-url="" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638781 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638785 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638788 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638792 2561 flags.go:64] FLAG: --max-pods="110" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638794 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638797 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638800 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638803 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638806 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638808 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638812 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638819 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638822 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638840 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638844 2561 flags.go:64] FLAG: --pod-cidr="" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638847 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638852 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638855 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 18:39:47.643487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638858 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638861 2561 flags.go:64] FLAG: --port="10250" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638864 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638868 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cbf5a953abe0093d" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638871 2561 flags.go:64] FLAG: --qos-reserved="" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638874 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638877 2561 flags.go:64] FLAG: --register-node="true" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638880 2561 flags.go:64] FLAG: --register-schedulable="true" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638884 2561 flags.go:64] FLAG: --register-with-taints="" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638888 2561 flags.go:64] FLAG: --registry-burst="10" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638891 2561 flags.go:64] FLAG: --registry-qps="5" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638894 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638896 2561 flags.go:64] FLAG: --reserved-memory="" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638900 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638903 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638906 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638909 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638911 2561 flags.go:64] FLAG: --runonce="false" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638914 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638917 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638920 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638923 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638926 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638929 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638932 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638935 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 18:39:47.644104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638938 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638941 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638943 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638947 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638950 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638952 2561 flags.go:64] FLAG: --system-cgroups="" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638955 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638961 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638964 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638968 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638972 2561 flags.go:64] FLAG: --tls-min-version="" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638975 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638977 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638980 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638984 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638987 2561 flags.go:64] FLAG: --v="2" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638991 2561 flags.go:64] FLAG: --version="false" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.638995 2561 flags.go:64] FLAG: --vmodule="" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.639000 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.639003 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639099 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639103 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639107 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639110 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:47.644734 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639112 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639115 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639118 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639121 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639123 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639126 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639128 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639131 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639134 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639136 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639139 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639142 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639145 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639147 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639150 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639152 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639154 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639157 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639160 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639162 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:47.645346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639164 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639167 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639171 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639173 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639176 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639178 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639181 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639183 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639185 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639188 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639190 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639194 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639197 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639200 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639203 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639207 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639210 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639212 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639215 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:47.645950 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639218 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639220 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639223 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639226 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639229 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639231 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639234 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639237 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639240 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639242 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639245 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639247 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639250 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639252 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639255 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639260 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639262 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639265 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639267 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639270 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:47.646420 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639272 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639275 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639277 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639280 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639282 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639285 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639287 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639290 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639292 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639294 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639297 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639299 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639302 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639304 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639307 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639309 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639312 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639314 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639316 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:47.646970 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639320 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639322 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639325 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.639327 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.639336 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.646011 2561 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.646033 2561 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646084 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646090 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646093 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646096 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646099 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646102 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646120 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646124 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646128 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:47.647433 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646131 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646134 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646137 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646140 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646144 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646146 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646149 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646152 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646155 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646157 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646160 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646162 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646165 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646168 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646170 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646173 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646177 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646180 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646183 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646185 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:47.647857 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646188 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646191 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646194 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646197 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646200 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646202 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646207 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646210 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646214 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646217 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646222 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646225 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646228 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646232 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646234 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646237 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646240 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646242 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646245 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:47.648346 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646248 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646250 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646253 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646255 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646258 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646260 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646263 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646265 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646268 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646271 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646274 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646276 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646279 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646281 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646285 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646288 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646291 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646293 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646296 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646298 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:47.648805 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646301 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646303 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646306 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646309 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646312 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646314 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646317 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646319 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646322 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646324 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646327 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646330 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646332 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646335 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646337 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646340 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646343 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:47.649332 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646345 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.646350 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646464 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646469 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646472 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646475 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646478 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646481 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646484 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646487 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646489 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646492 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646495 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646497 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646500 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646502 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:47.649744 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646504 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646507 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646509 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646512 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646514 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646516 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646519 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646521 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646524 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646527 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646529 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646532 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646535 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646537 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646539 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646542 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646544 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646547 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646549 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:47.650197 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646552 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646555 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646557 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646559 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646564 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646567 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646570 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646573 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646575 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646577 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646580 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646582 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646585 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646587 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646589 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646592 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646594 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646596 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646599 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:47.650659 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646601 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646604 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646606 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646609 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646611 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646613 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646616 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646618 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646621 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646624 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646627 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646630 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646632 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646635 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646637 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646640 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646642 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646644 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646648 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646650 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:47.651170 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646653 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646655 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646658 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646660 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646663 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646665 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646668 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646670 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646673 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646675 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646677 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646680 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646682 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:47.646684 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.646689 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:47.651645 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.647550 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 18:39:47.652034 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.649684 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 18:39:47.652034 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.650603 2561 server.go:1019] "Starting client certificate rotation" Jun 02 18:39:47.652034 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.650706 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 18:39:47.652034 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.650735 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 18:39:47.673508 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.673483 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 18:39:47.675600 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.675565 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 18:39:47.696578 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.696553 2561 log.go:25] "Validated CRI v1 runtime API" Jun 02 18:39:47.702408 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.702387 2561 log.go:25] "Validated CRI v1 image API" Jun 02 18:39:47.703766 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.703746 2561 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 18:39:47.708099 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.708078 2561 fs.go:135] Filesystem UUIDs: map[3eaef91e-df6f-4bca-9024-95e3d71599e1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cb7c5c98-1926-49b4-a657-6ff2f9174d52:/dev/nvme0n1p4] Jun 02 18:39:47.708163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.708101 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 18:39:47.709409 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.709386 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 18:39:47.712761 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.712633 2561 manager.go:217] Machine: {Timestamp:2026-06-02 18:39:47.712112221 +0000 UTC m=+0.375950354 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100303 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb09fb594f54bf75fb18a9bb5912e SystemUUID:ec2fb09f-b594-f54b-f75f-b18a9bb5912e BootID:ffe4468a-4729-40e5-8075-90b2d2928cc0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:07:07:54:c4:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:07:07:54:c4:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:01:e3:90:da:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 18:39:47.713375 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.713363 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 18:39:47.713472 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.713459 2561 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 18:39:47.716440 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.716402 2561 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 18:39:47.716590 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.716444 2561 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-211.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 18:39:47.716637 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.716597 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 18:39:47.716637 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.716605 2561 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 18:39:47.716637 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.716612 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 18:39:47.718135 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.718123 2561 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 18:39:47.719065 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.719055 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 02 18:39:47.719174 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.719165 2561 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 18:39:47.721235 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.721225 2561 kubelet.go:491] "Attempting to sync node with API server" Jun 02 18:39:47.721267 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.721240 2561 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 18:39:47.721267 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.721256 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 18:39:47.721267 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.721265 2561 kubelet.go:397] "Adding apiserver pod source" Jun 02 18:39:47.721361 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.721279 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 18:39:47.722340 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.722328 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 18:39:47.722376 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.722349 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.725244 2561 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.727229 2561 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729416 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729432 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729439 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729449 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729460 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729465 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729471 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729477 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729485 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729490 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729508 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 18:39:47.729650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.729514 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 18:39:47.730242 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.730231 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 18:39:47.730242 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.730243 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 18:39:47.733564 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.733551 2561 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 18:39:47.733644 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.733588 2561 server.go:1295] "Started kubelet" Jun 02 18:39:47.733692 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.733655 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 18:39:47.733736 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.733679 2561 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 18:39:47.733781 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.733749 2561 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 18:39:47.734643 ip-10-0-130-211 systemd[1]: Started Kubernetes Kubelet. Jun 02 18:39:47.735303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.735219 2561 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 18:39:47.735720 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.735667 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 18:39:47.735720 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.735669 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 18:39:47.735809 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.735786 2561 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-211.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 18:39:47.735880 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.735869 2561 server.go:317] "Adding debug handlers to kubelet server" Jun 02 18:39:47.744635 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.744611 2561 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 18:39:47.745578 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.741481 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-211.ec2.internal.18b557a391e00774 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-211.ec2.internal,UID:ip-10-0-130-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-211.ec2.internal,},FirstTimestamp:2026-06-02 18:39:47.733563252 +0000 UTC m=+0.397401385,LastTimestamp:2026-06-02 18:39:47.733563252 +0000 UTC m=+0.397401385,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-211.ec2.internal,}" Jun 02 18:39:47.746425 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.746404 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 18:39:47.746425 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.746421 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 18:39:47.746577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.746469 2561 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 18:39:47.746577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.746482 2561 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 18:39:47.746577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.746575 2561 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 18:39:47.747391 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747348 2561 factory.go:55] Registering systemd factory Jun 02 18:39:47.747391 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747366 2561 factory.go:223] Registration of the systemd container factory successfully Jun 02 18:39:47.747495 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.747410 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:47.747575 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747500 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 02 18:39:47.747575 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747515 2561 reconciler.go:26] "Reconciler: start to sync state" Jun 02 18:39:47.747729 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747714 2561 factory.go:153] Registering CRI-O factory Jun 02 18:39:47.747867 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747854 2561 factory.go:223] Registration of the crio container factory successfully Jun 02 18:39:47.747950 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747918 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 18:39:47.747950 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747941 2561 factory.go:103] Registering Raw factory Jun 02 18:39:47.748037 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.747956 2561 manager.go:1196] Started watching for new ooms in manager Jun 02 18:39:47.748316 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.748284 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 18:39:47.748387 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.748317 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 18:39:47.748387 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.748350 2561 manager.go:319] Starting recovery of all containers Jun 02 18:39:47.758956 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.758765 2561 manager.go:324] Recovery completed Jun 02 18:39:47.763574 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.763556 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:47.765508 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.765483 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:47.765570 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.765525 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:47.765570 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.765537 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:47.766172 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.766153 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 18:39:47.766172 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.766171 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 18:39:47.766272 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.766188 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 02 18:39:47.768702 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.768685 2561 policy_none.go:49] "None policy: Start" Jun 02 18:39:47.768775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.768715 2561 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 18:39:47.768775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.768730 2561 state_mem.go:35] "Initializing new in-memory state store" Jun 02 18:39:47.768878 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.768781 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gvn7d" Jun 02 18:39:47.773840 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.773703 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-211.ec2.internal.18b557a393c7809e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-211.ec2.internal,UID:ip-10-0-130-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-211.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-211.ec2.internal,},FirstTimestamp:2026-06-02 18:39:47.765510302 +0000 UTC m=+0.429348435,LastTimestamp:2026-06-02 18:39:47.765510302 +0000 UTC m=+0.429348435,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-211.ec2.internal,}" Jun 02 18:39:47.779340 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.779316 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gvn7d" Jun 02 18:39:47.810515 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.810494 2561 manager.go:341] "Starting Device Plugin manager" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.810536 2561 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.810549 2561 server.go:85] "Starting device plugin registration server" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.810874 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.810885 2561 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.810960 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.811037 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.811043 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.812319 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 18:39:47.812971 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.812368 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:47.868168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.868129 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 18:39:47.869537 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.869517 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 18:39:47.869598 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.869554 2561 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 18:39:47.869598 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.869579 2561 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 18:39:47.869598 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.869589 2561 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 18:39:47.869737 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.869636 2561 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 18:39:47.873803 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.873785 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:47.911084 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.911015 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:47.912073 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.912046 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:47.912183 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.912081 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:47.912183 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.912092 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:47.912183 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.912117 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-211.ec2.internal" Jun 02 18:39:47.921957 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.921931 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-211.ec2.internal" Jun 02 18:39:47.922098 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.921963 2561 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-211.ec2.internal\": node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:47.941869 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:47.941844 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:47.970762 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.970715 2561 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal"] Jun 02 18:39:47.970920 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.970805 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:47.971749 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.971730 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:47.971867 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.971766 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:47.971867 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.971780 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:47.973003 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.972989 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:47.973136 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.973120 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:47.973190 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.973152 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:47.973681 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.973657 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:47.973761 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.973682 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:47.973761 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.973703 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:47.973761 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.973713 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:47.973761 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.973687 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:47.973918 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.973773 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:47.974823 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.974808 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" Jun 02 18:39:47.974916 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.974851 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:47.975458 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.975441 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:47.975540 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.975468 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:47.975540 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:47.975479 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:48.002646 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.002611 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-211.ec2.internal\" not found" node="ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.007011 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.006982 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-211.ec2.internal\" not found" node="ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.042936 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.042906 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.049819 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.049796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e51767af88ced8ac3e390d7f7fc88ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal\" (UID: \"3e51767af88ced8ac3e390d7f7fc88ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.049896 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.049843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51767af88ced8ac3e390d7f7fc88ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal\" (UID: \"3e51767af88ced8ac3e390d7f7fc88ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.049896 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.049881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb6c1697b89e1de2aeda12f919933a09-config\") pod \"kube-apiserver-proxy-ip-10-0-130-211.ec2.internal\" (UID: \"cb6c1697b89e1de2aeda12f919933a09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.143179 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.143140 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.150495 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.150471 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e51767af88ced8ac3e390d7f7fc88ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal\" (UID: \"3e51767af88ced8ac3e390d7f7fc88ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.150563 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.150502 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51767af88ced8ac3e390d7f7fc88ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal\" (UID: \"3e51767af88ced8ac3e390d7f7fc88ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.150563 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.150520 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb6c1697b89e1de2aeda12f919933a09-config\") pod \"kube-apiserver-proxy-ip-10-0-130-211.ec2.internal\" (UID: \"cb6c1697b89e1de2aeda12f919933a09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.150652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.150567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cb6c1697b89e1de2aeda12f919933a09-config\") pod \"kube-apiserver-proxy-ip-10-0-130-211.ec2.internal\" (UID: \"cb6c1697b89e1de2aeda12f919933a09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.150652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.150592 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e51767af88ced8ac3e390d7f7fc88ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal\" (UID: \"3e51767af88ced8ac3e390d7f7fc88ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.150652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.150598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e51767af88ced8ac3e390d7f7fc88ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal\" (UID: \"3e51767af88ced8ac3e390d7f7fc88ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.243884 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.243824 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.305313 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.305286 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.310927 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.310905 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" Jun 02 18:39:48.344655 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.344621 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.445183 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.445140 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.545684 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.545616 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.574189 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.574162 2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:48.646424 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.646391 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.651632 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.651613 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 18:39:48.651794 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.651775 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 18:39:48.651862 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.651790 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 18:39:48.746963 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.746930 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.746963 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.746961 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 18:39:48.756083 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.756059 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 18:39:48.778313 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.778286 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hjd4c" Jun 02 18:39:48.781350 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.781324 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 18:34:47 +0000 UTC" deadline="2027-11-17 02:57:32.554831127 +0000 UTC" Jun 02 18:39:48.781412 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.781351 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12776h17m43.773483169s" Jun 02 18:39:48.785858 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.785819 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hjd4c" Jun 02 18:39:48.795349 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:48.795326 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e51767af88ced8ac3e390d7f7fc88ae.slice/crio-5d9d6ccc4027ce312e4ff81b3af0e3a1b34f6174535e25a4587d671a2fee53b2 WatchSource:0}: Error finding container 5d9d6ccc4027ce312e4ff81b3af0e3a1b34f6174535e25a4587d671a2fee53b2: Status 404 returned error can't find the container with id 5d9d6ccc4027ce312e4ff81b3af0e3a1b34f6174535e25a4587d671a2fee53b2 Jun 02 18:39:48.795548 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:48.795529 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6c1697b89e1de2aeda12f919933a09.slice/crio-a83b8c206489a14c3e1f4654bc2f1a7b268e666398f0ac70317b0878e2f964eb WatchSource:0}: Error finding container a83b8c206489a14c3e1f4654bc2f1a7b268e666398f0ac70317b0878e2f964eb: Status 404 returned error can't find the container with id a83b8c206489a14c3e1f4654bc2f1a7b268e666398f0ac70317b0878e2f964eb Jun 02 18:39:48.799756 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.799741 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:39:48.847567 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.847531 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:48.873879 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.873807 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" event={"ID":"cb6c1697b89e1de2aeda12f919933a09","Type":"ContainerStarted","Data":"a83b8c206489a14c3e1f4654bc2f1a7b268e666398f0ac70317b0878e2f964eb"} Jun 02 18:39:48.874651 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:48.874629 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" event={"ID":"3e51767af88ced8ac3e390d7f7fc88ae","Type":"ContainerStarted","Data":"5d9d6ccc4027ce312e4ff81b3af0e3a1b34f6174535e25a4587d671a2fee53b2"} Jun 02 18:39:48.948022 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:48.947989 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:49.048513 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.048442 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:49.149002 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.148965 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-211.ec2.internal\" not found" Jun 02 18:39:49.167352 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.167322 2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:49.235201 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.235163 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:49.247561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.247529 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" Jun 02 18:39:49.266343 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.266309 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 18:39:49.267268 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.267246 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" Jun 02 18:39:49.275732 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.275704 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 18:39:49.723280 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.723245 2561 apiserver.go:52] "Watching apiserver" Jun 02 18:39:49.729743 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.729720 2561 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 18:39:49.730158 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.730137 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-b9m7z","openshift-network-diagnostics/network-check-target-hr2qg","openshift-network-operator/iptables-alerter-jkb4t","openshift-ovn-kubernetes/ovnkube-node-sftvp","kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f","openshift-cluster-node-tuning-operator/tuned-fhztz","openshift-dns/node-resolver-gb49h","openshift-image-registry/node-ca-pb92x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal","openshift-multus/multus-additional-cni-plugins-6lvfw","openshift-multus/multus-j6tg9","kube-system/global-pull-secret-syncer-7lcdg","kube-system/konnectivity-agent-rfmlk"] Jun 02 18:39:49.732487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.732458 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.732608 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.732559 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.734004 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.733983 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.734895 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.734875 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9l96b\"" Jun 02 18:39:49.735049 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.735024 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.736197 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.735467 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.736662 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.736637 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.737278 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.737250 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 18:39:49.737358 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.737292 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cs5xf\"" Jun 02 18:39:49.737415 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.736647 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 18:39:49.737490 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.737473 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 18:39:49.737536 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.737507 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.737652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.737634 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 18:39:49.737810 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.737793 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-phwbv\"" Jun 02 18:39:49.738177 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.738155 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 18:39:49.738177 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.738167 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.738338 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.738219 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.738410 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.738337 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.738738 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.738721 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.738851 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.738737 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.738851 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.738779 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-84vkv\"" Jun 02 18:39:49.738851 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.738720 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 18:39:49.739170 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.739151 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.742189 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.742170 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 18:39:49.742278 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.742178 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-frbnd\"" Jun 02 18:39:49.742487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.742467 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.742598 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.742563 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.742786 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.742772 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:39:49.742931 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.742908 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.744798 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.744777 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.744930 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.744896 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.744930 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.744912 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m28xb\"" Jun 02 18:39:49.745325 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.744932 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 18:39:49.745325 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.745000 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b5jjj\"" Jun 02 18:39:49.745325 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.744912 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 18:39:49.745325 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.745187 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.747054 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.746267 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.747054 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.746970 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rkz6\"" Jun 02 18:39:49.747054 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.746977 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 18:39:49.747348 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.747325 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 18:39:49.747488 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.747471 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:49.747566 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.747543 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:39:49.748047 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.748028 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 18:39:49.748281 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.748266 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 18:39:49.748458 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.748444 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 18:39:49.748866 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.748846 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 18:39:49.749744 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.749728 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d4cdr\"" Jun 02 18:39:49.750143 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.750126 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.750234 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.750176 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:39:49.750234 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.750134 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:49.750321 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.750234 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:39:49.759052 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysctl-conf\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.759168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759062 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-run\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.759168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36e2f841-f27d-47d4-a4e9-ad3de78797bc-iptables-alerter-script\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.759168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-lib-modules\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.759168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13b77e1e-c560-4797-b0cd-359d71f7cc39-tmp\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.759300 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed06e64-fde1-40e3-b574-f7b61df73947-tmp-dir\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.759300 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzs64\" (UniqueName: \"kubernetes.io/projected/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-kube-api-access-gzs64\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.759300 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759232 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/952fbca6-9a28-487e-a267-3c6ee61f4597-konnectivity-ca\") pod \"konnectivity-agent-rfmlk\" (UID: \"952fbca6-9a28-487e-a267-3c6ee61f4597\") " pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:39:49.759300 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-cni-multus\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.759300 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-socket-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.759467 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-sys-fs\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.759467 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-cnibin\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.759467 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-ovn\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.759467 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-cni-netd\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.759467 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.759612 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f2qp\" (UniqueName: \"kubernetes.io/projected/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-kube-api-access-4f2qp\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.759612 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/952fbca6-9a28-487e-a267-3c6ee61f4597-agent-certs\") pod \"konnectivity-agent-rfmlk\" (UID: \"952fbca6-9a28-487e-a267-3c6ee61f4597\") " pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:39:49.759612 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-systemd\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.759612 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-host\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.759724 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-system-cni-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.759724 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-os-release\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.759724 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-socket-dir-parent\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.759724 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-etc-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.759861 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-run-ovn-kubernetes\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.759861 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.759861 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:49.759962 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-serviceca\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.759962 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ed06e64-fde1-40e3-b574-f7b61df73947-hosts-file\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.759962 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.760044 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759970 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-multus-certs\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.760044 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.759998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-log-socket\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760044 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-etc-kubernetes\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.760044 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-systemd-units\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760056 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-slash\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760075 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-registration-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.760152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-device-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.760152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wdfl\" (UniqueName: \"kubernetes.io/projected/16f8406c-d799-4759-9860-fd9fb129b8a2-kube-api-access-2wdfl\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:49.760152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysconfig\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.760335 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-kubernetes\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.760335 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b250934f-ca67-4400-87df-aec0dc6db304-cni-binary-copy\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.760335 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8zww\" (UniqueName: \"kubernetes.io/projected/3ed06e64-fde1-40e3-b574-f7b61df73947-kube-api-access-k8zww\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.760335 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.760335 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovnkube-config\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760335 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-env-overrides\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760335 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovnkube-script-lib\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnjwb\" (UniqueName: \"kubernetes.io/projected/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-kube-api-access-lnjwb\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-var-lib-kubelet\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-system-cni-dir\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-os-release\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760432 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36e2f841-f27d-47d4-a4e9-ad3de78797bc-host-slash\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-node-log\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-cni-bin\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovn-node-metrics-cert\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm6tl\" (UniqueName: \"kubernetes.io/projected/13b77e1e-c560-4797-b0cd-359d71f7cc39-kube-api-access-hm6tl\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-k8s-cni-cncf-io\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-hostroot\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-var-lib-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysctl-d\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-netns\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.760795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b250934f-ca67-4400-87df-aec0dc6db304-multus-daemon-config\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760739 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-host\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-kubelet\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-run-netns\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-modprobe-d\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-sys\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-tuned\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760943 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl9tz\" (UniqueName: \"kubernetes.io/projected/5fb7747a-366d-4c39-a1ca-9af3670ba925-kube-api-access-jl9tz\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.760987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdb8t\" (UniqueName: \"kubernetes.io/projected/36e2f841-f27d-47d4-a4e9-ad3de78797bc-kube-api-access-vdb8t\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.761009 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-systemd\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.761032 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-cnibin\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.761055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-cni-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.761080 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-cni-bin\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.761551 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.761102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-kubelet\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.762288 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.761152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-conf-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.762288 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.761175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hch6r\" (UniqueName: \"kubernetes.io/projected/b250934f-ca67-4400-87df-aec0dc6db304-kube-api-access-hch6r\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.786579 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.786422 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:34:48 +0000 UTC" deadline="2027-11-25 05:24:22.889172267 +0000 UTC" Jun 02 18:39:49.786579 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.786445 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12970h44m33.102730005s" Jun 02 18:39:49.848024 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.847991 2561 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 18:39:49.861880 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.861820 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-systemd\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.861880 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.861886 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-cnibin\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.861907 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-systemd\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.861912 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-cni-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.861979 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-cni-bin\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.861987 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-cni-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862005 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-kubelet\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-cnibin\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862027 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-conf-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862053 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hch6r\" (UniqueName: \"kubernetes.io/projected/b250934f-ca67-4400-87df-aec0dc6db304-kube-api-access-hch6r\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-conf-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862073 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysctl-conf\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862097 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-run\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23815455-f102-4734-9bf4-1ed7356ef1f8-dbus\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-kubelet\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862134 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36e2f841-f27d-47d4-a4e9-ad3de78797bc-iptables-alerter-script\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862149 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-lib-modules\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862153 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-run\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862165 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13b77e1e-c560-4797-b0cd-359d71f7cc39-tmp\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862180 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed06e64-fde1-40e3-b574-f7b61df73947-tmp-dir\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862196 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzs64\" (UniqueName: \"kubernetes.io/projected/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-kube-api-access-gzs64\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862211 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/952fbca6-9a28-487e-a267-3c6ee61f4597-konnectivity-ca\") pod \"konnectivity-agent-rfmlk\" (UID: \"952fbca6-9a28-487e-a267-3c6ee61f4597\") " pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862229 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-cni-multus\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23815455-f102-4734-9bf4-1ed7356ef1f8-kubelet-config\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862281 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-socket-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862296 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-sys-fs\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862309 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-cnibin\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.862456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862345 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-ovn\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862360 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-cni-netd\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862391 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862411 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4f2qp\" (UniqueName: \"kubernetes.io/projected/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-kube-api-access-4f2qp\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862426 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/952fbca6-9a28-487e-a267-3c6ee61f4597-agent-certs\") pod \"konnectivity-agent-rfmlk\" (UID: \"952fbca6-9a28-487e-a267-3c6ee61f4597\") " pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862443 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-systemd\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysctl-conf\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862457 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-host\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862095 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-cni-bin\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862474 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-system-cni-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862490 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-os-release\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862504 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-socket-dir-parent\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862519 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-etc-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862562 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-run-ovn-kubernetes\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862578 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862595 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:49.863008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862610 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-serviceca\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862632 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ed06e64-fde1-40e3-b574-f7b61df73947-hosts-file\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862647 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862663 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-multus-certs\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862679 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-log-socket\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862698 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-etc-kubernetes\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862714 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-systemd-units\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862733 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-slash\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862749 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-registration-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862777 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-device-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862793 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wdfl\" (UniqueName: \"kubernetes.io/projected/16f8406c-d799-4759-9860-fd9fb129b8a2-kube-api-access-2wdfl\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862809 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysconfig\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862842 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-kubernetes\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862871 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b250934f-ca67-4400-87df-aec0dc6db304-cni-binary-copy\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862892 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zww\" (UniqueName: \"kubernetes.io/projected/3ed06e64-fde1-40e3-b574-f7b61df73947-kube-api-access-k8zww\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36e2f841-f27d-47d4-a4e9-ad3de78797bc-iptables-alerter-script\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862908 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.863741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862924 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovnkube-config\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862939 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-env-overrides\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862955 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovnkube-script-lib\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862970 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnjwb\" (UniqueName: \"kubernetes.io/projected/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-kube-api-access-lnjwb\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.862986 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-var-lib-kubelet\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863009 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-system-cni-dir\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863042 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-os-release\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-lib-modules\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863072 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36e2f841-f27d-47d4-a4e9-ad3de78797bc-host-slash\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863096 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-node-log\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863125 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-cni-bin\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863153 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovn-node-metrics-cert\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863178 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm6tl\" (UniqueName: \"kubernetes.io/projected/13b77e1e-c560-4797-b0cd-359d71f7cc39-kube-api-access-hm6tl\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863205 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863254 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-k8s-cni-cncf-io\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863278 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-hostroot\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863299 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-var-lib-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.864303 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863329 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysctl-d\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863346 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-netns\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863366 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b250934f-ca67-4400-87df-aec0dc6db304-multus-daemon-config\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863362 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863412 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-var-lib-cni-multus\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863450 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863482 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-host\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863511 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-kubelet\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863539 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-run-netns\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/952fbca6-9a28-487e-a267-3c6ee61f4597-konnectivity-ca\") pod \"konnectivity-agent-rfmlk\" (UID: \"952fbca6-9a28-487e-a267-3c6ee61f4597\") " pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863566 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863591 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-modprobe-d\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863617 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-sys\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863645 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-tuned\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863672 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863709 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl9tz\" (UniqueName: \"kubernetes.io/projected/5fb7747a-366d-4c39-a1ca-9af3670ba925-kube-api-access-jl9tz\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863737 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdb8t\" (UniqueName: \"kubernetes.io/projected/36e2f841-f27d-47d4-a4e9-ad3de78797bc-kube-api-access-vdb8t\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed06e64-fde1-40e3-b574-f7b61df73947-tmp-dir\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.865147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.863983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864042 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-socket-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864052 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-host\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864096 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-sys-fs\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864089 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-kubelet\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864132 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-cnibin\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864135 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-run-netns\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864174 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-cni-netd\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864186 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864202 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864225 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-run-ovn\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.864335 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.864403 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs podName:16f8406c-d799-4759-9860-fd9fb129b8a2 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:50.364375828 +0000 UTC m=+3.028213971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs") pod "network-metrics-daemon-b9m7z" (UID: "16f8406c-d799-4759-9860-fd9fb129b8a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864519 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-modprobe-d\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-host\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864603 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-device-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.866007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ed06e64-fde1-40e3-b574-f7b61df73947-hosts-file\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864693 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-registration-dir\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.864767 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-serviceca\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865097 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovnkube-script-lib\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865137 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-var-lib-kubelet\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865149 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865293 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-system-cni-dir\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865353 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-os-release\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865369 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-multus-socket-dir-parent\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865385 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-multus-certs\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865394 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-var-lib-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865433 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-os-release\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-node-log\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36e2f841-f27d-47d4-a4e9-ad3de78797bc-host-slash\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865476 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-slash\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865513 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-hostroot\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865589 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-env-overrides\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.866796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865693 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-log-socket\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fb7747a-366d-4c39-a1ca-9af3670ba925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-etc-openvswitch\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865770 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovnkube-config\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-k8s-cni-cncf-io\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-host-run-netns\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-sys\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865896 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-etc-kubernetes\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865928 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-cni-bin\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.865964 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b250934f-ca67-4400-87df-aec0dc6db304-multus-daemon-config\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-kubernetes\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fb7747a-366d-4c39-a1ca-9af3670ba925-cni-binary-copy\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866100 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysctl-d\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866122 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-sysconfig\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866116 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b250934f-ca67-4400-87df-aec0dc6db304-system-cni-dir\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866182 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-systemd-units\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-systemd\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866307 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-host-run-ovn-kubernetes\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.867577 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866821 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b250934f-ca67-4400-87df-aec0dc6db304-cni-binary-copy\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.868484 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.866968 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13b77e1e-c560-4797-b0cd-359d71f7cc39-tmp\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.869058 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.869035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-ovn-node-metrics-cert\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.869167 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.869037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/952fbca6-9a28-487e-a267-3c6ee61f4597-agent-certs\") pod \"konnectivity-agent-rfmlk\" (UID: \"952fbca6-9a28-487e-a267-3c6ee61f4597\") " pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:39:49.876524 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.876493 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hch6r\" (UniqueName: \"kubernetes.io/projected/b250934f-ca67-4400-87df-aec0dc6db304-kube-api-access-hch6r\") pod \"multus-j6tg9\" (UID: \"b250934f-ca67-4400-87df-aec0dc6db304\") " pod="openshift-multus/multus-j6tg9" Jun 02 18:39:49.877029 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.877002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13b77e1e-c560-4797-b0cd-359d71f7cc39-etc-tuned\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.878575 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.878554 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzs64\" (UniqueName: \"kubernetes.io/projected/911f6497-ef1a-47e9-b935-84e5c6b8eaf7-kube-api-access-gzs64\") pod \"aws-ebs-csi-driver-node-qvs6f\" (UID: \"911f6497-ef1a-47e9-b935-84e5c6b8eaf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:49.878771 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.878732 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8zww\" (UniqueName: \"kubernetes.io/projected/3ed06e64-fde1-40e3-b574-f7b61df73947-kube-api-access-k8zww\") pod \"node-resolver-gb49h\" (UID: \"3ed06e64-fde1-40e3-b574-f7b61df73947\") " pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:49.879507 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.879428 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f2qp\" (UniqueName: \"kubernetes.io/projected/f8d846e1-b9ad-4bdf-b7d1-087d08220a80-kube-api-access-4f2qp\") pod \"node-ca-pb92x\" (UID: \"f8d846e1-b9ad-4bdf-b7d1-087d08220a80\") " pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:49.879507 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.879432 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdb8t\" (UniqueName: \"kubernetes.io/projected/36e2f841-f27d-47d4-a4e9-ad3de78797bc-kube-api-access-vdb8t\") pod \"iptables-alerter-jkb4t\" (UID: \"36e2f841-f27d-47d4-a4e9-ad3de78797bc\") " pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:49.880307 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.879743 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnjwb\" (UniqueName: \"kubernetes.io/projected/ee95d5c1-acea-42fb-907b-6c41b37b0cd5-kube-api-access-lnjwb\") pod \"ovnkube-node-sftvp\" (UID: \"ee95d5c1-acea-42fb-907b-6c41b37b0cd5\") " pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:49.880307 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.880211 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wdfl\" (UniqueName: \"kubernetes.io/projected/16f8406c-d799-4759-9860-fd9fb129b8a2-kube-api-access-2wdfl\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:49.880923 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.880889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm6tl\" (UniqueName: \"kubernetes.io/projected/13b77e1e-c560-4797-b0cd-359d71f7cc39-kube-api-access-hm6tl\") pod \"tuned-fhztz\" (UID: \"13b77e1e-c560-4797-b0cd-359d71f7cc39\") " pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:49.881320 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.881291 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl9tz\" (UniqueName: \"kubernetes.io/projected/5fb7747a-366d-4c39-a1ca-9af3670ba925-kube-api-access-jl9tz\") pod \"multus-additional-cni-plugins-6lvfw\" (UID: \"5fb7747a-366d-4c39-a1ca-9af3670ba925\") " pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:49.964863 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.964807 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23815455-f102-4734-9bf4-1ed7356ef1f8-dbus\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.965045 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.964884 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23815455-f102-4734-9bf4-1ed7356ef1f8-kubelet-config\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.965045 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.964911 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.965045 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.964936 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:49.965045 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.964986 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23815455-f102-4734-9bf4-1ed7356ef1f8-dbus\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.965045 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:49.965015 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23815455-f102-4734-9bf4-1ed7356ef1f8-kubelet-config\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:49.965320 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.965055 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:49.965320 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.965116 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret podName:23815455-f102-4734-9bf4-1ed7356ef1f8 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:50.465099307 +0000 UTC m=+3.128937427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret") pod "global-pull-secret-syncer-7lcdg" (UID: "23815455-f102-4734-9bf4-1ed7356ef1f8") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:49.978762 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.978679 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:49.978762 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.978710 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:49.978762 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.978723 2561 projected.go:194] Error preparing data for projected volume kube-api-access-btl7j for pod openshift-network-diagnostics/network-check-target-hr2qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:49.979023 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:49.978807 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j podName:e4a88604-4499-41a9-832c-4dc04478bf7a nodeName:}" failed. No retries permitted until 2026-06-02 18:39:50.478786399 +0000 UTC m=+3.142624541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-btl7j" (UniqueName: "kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j") pod "network-check-target-hr2qg" (UID: "e4a88604-4499-41a9-832c-4dc04478bf7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.050068 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.050030 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fhztz" Jun 02 18:39:50.056899 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.056871 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jkb4t" Jun 02 18:39:50.064711 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.064685 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:39:50.070203 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.070180 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" Jun 02 18:39:50.075766 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.075742 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pb92x" Jun 02 18:39:50.083428 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.083405 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:39:50.089994 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.089963 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gb49h" Jun 02 18:39:50.096635 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.096613 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" Jun 02 18:39:50.102301 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.102282 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j6tg9" Jun 02 18:39:50.147222 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.147188 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:50.368152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.368116 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:50.368279 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:50.368228 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:50.368321 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:50.368293 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs podName:16f8406c-d799-4759-9860-fd9fb129b8a2 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:51.36827972 +0000 UTC m=+4.032117845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs") pod "network-metrics-daemon-b9m7z" (UID: "16f8406c-d799-4759-9860-fd9fb129b8a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:50.384092 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.384063 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee95d5c1_acea_42fb_907b_6c41b37b0cd5.slice/crio-419da7520fbf9e38afad507d3f1e2e69610486e250d3f12f30ba91de6f0c4fda WatchSource:0}: Error finding container 419da7520fbf9e38afad507d3f1e2e69610486e250d3f12f30ba91de6f0c4fda: Status 404 returned error can't find the container with id 419da7520fbf9e38afad507d3f1e2e69610486e250d3f12f30ba91de6f0c4fda Jun 02 18:39:50.385236 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.385211 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d846e1_b9ad_4bdf_b7d1_087d08220a80.slice/crio-3ac32fdbfb3c6eb4fb0ac58fd374b7fff427a211a8a901785ab78bf969dc956b WatchSource:0}: Error finding container 3ac32fdbfb3c6eb4fb0ac58fd374b7fff427a211a8a901785ab78bf969dc956b: Status 404 returned error can't find the container with id 3ac32fdbfb3c6eb4fb0ac58fd374b7fff427a211a8a901785ab78bf969dc956b Jun 02 18:39:50.385974 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.385947 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod952fbca6_9a28_487e_a267_3c6ee61f4597.slice/crio-9a6ba3ef4f7b24d910c3af294964a2b766c37391924ea48e001ca73ef8884cc6 WatchSource:0}: Error finding container 9a6ba3ef4f7b24d910c3af294964a2b766c37391924ea48e001ca73ef8884cc6: Status 404 returned error can't find the container with id 9a6ba3ef4f7b24d910c3af294964a2b766c37391924ea48e001ca73ef8884cc6 Jun 02 18:39:50.387362 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.386886 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed06e64_fde1_40e3_b574_f7b61df73947.slice/crio-b8dcde7b3d5516324642d64fc4dc8ab414c2dd7f6d0cf2115453039ac1e336cc WatchSource:0}: Error finding container b8dcde7b3d5516324642d64fc4dc8ab414c2dd7f6d0cf2115453039ac1e336cc: Status 404 returned error can't find the container with id b8dcde7b3d5516324642d64fc4dc8ab414c2dd7f6d0cf2115453039ac1e336cc Jun 02 18:39:50.389985 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.389964 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911f6497_ef1a_47e9_b935_84e5c6b8eaf7.slice/crio-85b3e4f3d2c07f939cd31c6114e16aaa328bbb50b6fef06d42dbd0c1c7de7db2 WatchSource:0}: Error finding container 85b3e4f3d2c07f939cd31c6114e16aaa328bbb50b6fef06d42dbd0c1c7de7db2: Status 404 returned error can't find the container with id 85b3e4f3d2c07f939cd31c6114e16aaa328bbb50b6fef06d42dbd0c1c7de7db2 Jun 02 18:39:50.391853 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.391186 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb250934f_ca67_4400_87df_aec0dc6db304.slice/crio-aa20fc9456c06945052a74d78d0e3932dcac9c9b9c683a5eb8a56a45e1f60546 WatchSource:0}: Error finding container aa20fc9456c06945052a74d78d0e3932dcac9c9b9c683a5eb8a56a45e1f60546: Status 404 returned error can't find the container with id aa20fc9456c06945052a74d78d0e3932dcac9c9b9c683a5eb8a56a45e1f60546 Jun 02 18:39:50.392604 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.392583 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb7747a_366d_4c39_a1ca_9af3670ba925.slice/crio-63950c3b558be63a6e36f6e5c0db892b31de6eae05b25c24346f795eb066a08a WatchSource:0}: Error finding container 63950c3b558be63a6e36f6e5c0db892b31de6eae05b25c24346f795eb066a08a: Status 404 returned error can't find the container with id 63950c3b558be63a6e36f6e5c0db892b31de6eae05b25c24346f795eb066a08a Jun 02 18:39:50.394259 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.393717 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e2f841_f27d_47d4_a4e9_ad3de78797bc.slice/crio-2cbb47d6e2cb61861f0638fab2b938789590a66008b977e7d46343c4cb97f8fe WatchSource:0}: Error finding container 2cbb47d6e2cb61861f0638fab2b938789590a66008b977e7d46343c4cb97f8fe: Status 404 returned error can't find the container with id 2cbb47d6e2cb61861f0638fab2b938789590a66008b977e7d46343c4cb97f8fe Jun 02 18:39:50.395210 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:39:50.395189 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b77e1e_c560_4797_b0cd_359d71f7cc39.slice/crio-4fbb312c19780023af6e47538bddcb02ead7ba126af01c236003c9ad96399a93 WatchSource:0}: Error finding container 4fbb312c19780023af6e47538bddcb02ead7ba126af01c236003c9ad96399a93: Status 404 returned error can't find the container with id 4fbb312c19780023af6e47538bddcb02ead7ba126af01c236003c9ad96399a93 Jun 02 18:39:50.468871 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.468664 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:50.468994 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:50.468815 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:50.469038 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:50.469013 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret podName:23815455-f102-4734-9bf4-1ed7356ef1f8 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:51.46899497 +0000 UTC m=+4.132833104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret") pod "global-pull-secret-syncer-7lcdg" (UID: "23815455-f102-4734-9bf4-1ed7356ef1f8") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:50.569957 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.569919 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:50.570135 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:50.570113 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:50.570195 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:50.570144 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:50.570195 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:50.570158 2561 projected.go:194] Error preparing data for projected volume kube-api-access-btl7j for pod openshift-network-diagnostics/network-check-target-hr2qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.570302 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:50.570251 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j podName:e4a88604-4499-41a9-832c-4dc04478bf7a nodeName:}" failed. No retries permitted until 2026-06-02 18:39:51.570229575 +0000 UTC m=+4.234067708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-btl7j" (UniqueName: "kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j") pod "network-check-target-hr2qg" (UID: "e4a88604-4499-41a9-832c-4dc04478bf7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.788364 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.788287 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:34:48 +0000 UTC" deadline="2028-01-03 04:01:58.475644726 +0000 UTC" Jun 02 18:39:50.788364 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.788328 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13905h22m7.68732054s" Jun 02 18:39:50.886161 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.886101 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerStarted","Data":"63950c3b558be63a6e36f6e5c0db892b31de6eae05b25c24346f795eb066a08a"} Jun 02 18:39:50.904338 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.904251 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jkb4t" event={"ID":"36e2f841-f27d-47d4-a4e9-ad3de78797bc","Type":"ContainerStarted","Data":"2cbb47d6e2cb61861f0638fab2b938789590a66008b977e7d46343c4cb97f8fe"} Jun 02 18:39:50.908011 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.907964 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" event={"ID":"911f6497-ef1a-47e9-b935-84e5c6b8eaf7","Type":"ContainerStarted","Data":"85b3e4f3d2c07f939cd31c6114e16aaa328bbb50b6fef06d42dbd0c1c7de7db2"} Jun 02 18:39:50.912994 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.912963 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gb49h" event={"ID":"3ed06e64-fde1-40e3-b574-f7b61df73947","Type":"ContainerStarted","Data":"b8dcde7b3d5516324642d64fc4dc8ab414c2dd7f6d0cf2115453039ac1e336cc"} Jun 02 18:39:50.939141 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.939098 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rfmlk" event={"ID":"952fbca6-9a28-487e-a267-3c6ee61f4597","Type":"ContainerStarted","Data":"9a6ba3ef4f7b24d910c3af294964a2b766c37391924ea48e001ca73ef8884cc6"} Jun 02 18:39:50.945642 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.945602 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" event={"ID":"cb6c1697b89e1de2aeda12f919933a09","Type":"ContainerStarted","Data":"f5a4efbef4b06c5f4ccc68f94a9a5f6841627e8e5c05d6b5f21a0a2c3db4abda"} Jun 02 18:39:50.955695 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.955649 2561 generic.go:358] "Generic (PLEG): container finished" podID="3e51767af88ced8ac3e390d7f7fc88ae" containerID="0c3eebb27e7624259fab224b828f4f6f9a9156a558c89edb1962fb9c29d3485f" exitCode=0 Jun 02 18:39:50.955893 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.955724 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" event={"ID":"3e51767af88ced8ac3e390d7f7fc88ae","Type":"ContainerDied","Data":"0c3eebb27e7624259fab224b828f4f6f9a9156a558c89edb1962fb9c29d3485f"} Jun 02 18:39:50.958226 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.958178 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-211.ec2.internal" podStartSLOduration=1.958163152 podStartE2EDuration="1.958163152s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:39:50.95790728 +0000 UTC m=+3.621745423" watchObservedRunningTime="2026-06-02 18:39:50.958163152 +0000 UTC m=+3.622001296" Jun 02 18:39:50.974094 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.974064 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j6tg9" event={"ID":"b250934f-ca67-4400-87df-aec0dc6db304","Type":"ContainerStarted","Data":"aa20fc9456c06945052a74d78d0e3932dcac9c9b9c683a5eb8a56a45e1f60546"} Jun 02 18:39:50.987462 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.987415 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pb92x" event={"ID":"f8d846e1-b9ad-4bdf-b7d1-087d08220a80","Type":"ContainerStarted","Data":"3ac32fdbfb3c6eb4fb0ac58fd374b7fff427a211a8a901785ab78bf969dc956b"} Jun 02 18:39:50.990742 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.990712 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"419da7520fbf9e38afad507d3f1e2e69610486e250d3f12f30ba91de6f0c4fda"} Jun 02 18:39:50.993895 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:50.993803 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fhztz" event={"ID":"13b77e1e-c560-4797-b0cd-359d71f7cc39","Type":"ContainerStarted","Data":"4fbb312c19780023af6e47538bddcb02ead7ba126af01c236003c9ad96399a93"} Jun 02 18:39:51.378741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:51.378082 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:51.378741 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.378306 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:51.378741 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.378378 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs podName:16f8406c-d799-4759-9860-fd9fb129b8a2 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:53.378357063 +0000 UTC m=+6.042195188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs") pod "network-metrics-daemon-b9m7z" (UID: "16f8406c-d799-4759-9860-fd9fb129b8a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:51.479606 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:51.478999 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:51.479606 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.479203 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:51.479606 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.479268 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret podName:23815455-f102-4734-9bf4-1ed7356ef1f8 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:53.47924855 +0000 UTC m=+6.143086674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret") pod "global-pull-secret-syncer-7lcdg" (UID: "23815455-f102-4734-9bf4-1ed7356ef1f8") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:51.547047 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:51.546854 2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:51.580345 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:51.580204 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:51.580517 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.580399 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:51.580517 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.580423 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:51.580517 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.580437 2561 projected.go:194] Error preparing data for projected volume kube-api-access-btl7j for pod openshift-network-diagnostics/network-check-target-hr2qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:51.580517 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.580498 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j podName:e4a88604-4499-41a9-832c-4dc04478bf7a nodeName:}" failed. No retries permitted until 2026-06-02 18:39:53.580479264 +0000 UTC m=+6.244317389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-btl7j" (UniqueName: "kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j") pod "network-check-target-hr2qg" (UID: "e4a88604-4499-41a9-832c-4dc04478bf7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:51.873048 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:51.872037 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:51.873048 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:51.872092 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:51.873048 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.872324 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:39:51.873048 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:51.872883 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:51.873048 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.872961 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:39:51.873788 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:51.873700 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:39:52.022950 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:52.022907 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" event={"ID":"3e51767af88ced8ac3e390d7f7fc88ae","Type":"ContainerStarted","Data":"e1274454b126fb736e2b881f4b65415bd843de20e4d6c9a6fd9e8109735a84e5"} Jun 02 18:39:52.036476 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:52.036329 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-211.ec2.internal" podStartSLOduration=3.036308292 podStartE2EDuration="3.036308292s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:39:52.035428683 +0000 UTC m=+4.699266828" watchObservedRunningTime="2026-06-02 18:39:52.036308292 +0000 UTC m=+4.700146437" Jun 02 18:39:53.397357 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:53.397318 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:53.397850 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.397510 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:53.398022 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.398004 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs podName:16f8406c-d799-4759-9860-fd9fb129b8a2 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:57.397977548 +0000 UTC m=+10.061815682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs") pod "network-metrics-daemon-b9m7z" (UID: "16f8406c-d799-4759-9860-fd9fb129b8a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:53.498480 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:53.498430 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:53.498631 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.498581 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:53.498694 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.498653 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret podName:23815455-f102-4734-9bf4-1ed7356ef1f8 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:57.498637417 +0000 UTC m=+10.162475541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret") pod "global-pull-secret-syncer-7lcdg" (UID: "23815455-f102-4734-9bf4-1ed7356ef1f8") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:53.600249 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:53.599715 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:53.600249 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.599855 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:53.600249 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.599875 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:53.600249 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.599889 2561 projected.go:194] Error preparing data for projected volume kube-api-access-btl7j for pod openshift-network-diagnostics/network-check-target-hr2qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:53.600249 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.599945 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j podName:e4a88604-4499-41a9-832c-4dc04478bf7a nodeName:}" failed. No retries permitted until 2026-06-02 18:39:57.599928531 +0000 UTC m=+10.263766653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-btl7j" (UniqueName: "kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j") pod "network-check-target-hr2qg" (UID: "e4a88604-4499-41a9-832c-4dc04478bf7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:53.872344 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:53.872313 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:53.872522 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.872429 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:39:53.872881 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:53.872853 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:53.872977 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.872948 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:39:53.873044 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:53.873025 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:53.873184 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:53.873105 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:39:55.871221 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:55.870632 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:55.871221 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:55.870774 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:39:55.871221 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:55.871115 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:55.871221 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:55.871181 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:39:55.871699 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:55.871319 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:55.871699 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:55.871427 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:39:57.435394 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:57.435355 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:57.435964 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.435546 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:57.435964 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.435626 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs podName:16f8406c-d799-4759-9860-fd9fb129b8a2 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:05.435606157 +0000 UTC m=+18.099444292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs") pod "network-metrics-daemon-b9m7z" (UID: "16f8406c-d799-4759-9860-fd9fb129b8a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:57.536337 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:57.536275 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:57.536522 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.536454 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:57.536594 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.536575 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret podName:23815455-f102-4734-9bf4-1ed7356ef1f8 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:05.536554638 +0000 UTC m=+18.200392781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret") pod "global-pull-secret-syncer-7lcdg" (UID: "23815455-f102-4734-9bf4-1ed7356ef1f8") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:57.637402 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:57.636693 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:57.637402 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.636910 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:57.637402 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.636932 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:57.637402 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.636946 2561 projected.go:194] Error preparing data for projected volume kube-api-access-btl7j for pod openshift-network-diagnostics/network-check-target-hr2qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:57.637402 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.637011 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j podName:e4a88604-4499-41a9-832c-4dc04478bf7a nodeName:}" failed. No retries permitted until 2026-06-02 18:40:05.636990618 +0000 UTC m=+18.300828740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-btl7j" (UniqueName: "kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j") pod "network-check-target-hr2qg" (UID: "e4a88604-4499-41a9-832c-4dc04478bf7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:57.871781 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:57.871742 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:57.871953 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.871910 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:39:57.872345 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:57.872325 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:57.872446 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.872414 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:39:57.872603 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:57.872586 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:57.872715 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:57.872675 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:39:59.871576 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:59.870746 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:39:59.871576 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:59.870880 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:39:59.871576 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:59.871308 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:39:59.871576 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:59.871443 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:39:59.871576 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:39:59.871475 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:39:59.871576 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:39:59.871541 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:01.870017 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:01.869981 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:01.870480 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:01.869992 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:01.870480 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:01.870120 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:01.870480 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:01.869992 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:01.870480 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:01.870210 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:01.870480 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:01.870242 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:03.870378 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:03.870347 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:03.870808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:03.870345 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:03.870808 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:03.870470 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:03.870808 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:03.870573 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:03.870808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:03.870348 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:03.870808 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:03.870666 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:05.494186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:05.494144 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:05.494677 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.494275 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:05.494677 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.494336 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs podName:16f8406c-d799-4759-9860-fd9fb129b8a2 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:21.494320273 +0000 UTC m=+34.158158393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs") pod "network-metrics-daemon-b9m7z" (UID: "16f8406c-d799-4759-9860-fd9fb129b8a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:05.595144 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:05.595101 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:05.595319 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.595280 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:40:05.595378 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.595365 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret podName:23815455-f102-4734-9bf4-1ed7356ef1f8 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:21.595343794 +0000 UTC m=+34.259181915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret") pod "global-pull-secret-syncer-7lcdg" (UID: "23815455-f102-4734-9bf4-1ed7356ef1f8") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:40:05.696163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:05.696126 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:05.696341 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.696322 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:40:05.696389 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.696348 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:40:05.696389 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.696362 2561 projected.go:194] Error preparing data for projected volume kube-api-access-btl7j for pod openshift-network-diagnostics/network-check-target-hr2qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:05.696467 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.696432 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j podName:e4a88604-4499-41a9-832c-4dc04478bf7a nodeName:}" failed. No retries permitted until 2026-06-02 18:40:21.696413602 +0000 UTC m=+34.360251738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-btl7j" (UniqueName: "kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j") pod "network-check-target-hr2qg" (UID: "e4a88604-4499-41a9-832c-4dc04478bf7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:05.870104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:05.870020 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:05.870104 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:05.870068 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:05.870317 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:05.870021 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:05.870317 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.870158 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:05.870317 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.870242 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:05.870317 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:05.870303 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:07.871325 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:07.871288 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:07.871861 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:07.871384 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:07.871861 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:07.871421 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:07.871861 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:07.871444 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:07.871861 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:07.871516 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:07.871861 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:07.871585 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:09.058115 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.057728 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pb92x" event={"ID":"f8d846e1-b9ad-4bdf-b7d1-087d08220a80","Type":"ContainerStarted","Data":"9d28482bef102672bc39ae0b74885fbb55835ac91e9cf59d2f8123c1c19d1072"} Jun 02 18:40:09.064789 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.064427 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerStarted","Data":"1b188e8196d4b12db8507154f15124946e8b1520f905fd455c95dc928e2053ca"} Jun 02 18:40:09.066624 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.066602 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" event={"ID":"911f6497-ef1a-47e9-b935-84e5c6b8eaf7","Type":"ContainerStarted","Data":"fce0453f76561dd028a07326cf5514539bb11876427ecf034a0593740d4cb1f1"} Jun 02 18:40:09.067663 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.067645 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gb49h" event={"ID":"3ed06e64-fde1-40e3-b574-f7b61df73947","Type":"ContainerStarted","Data":"39a57ca6363860cedaaacf54eb20a3473a35655fad873270dbbc232726b10221"} Jun 02 18:40:09.075085 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.075051 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pb92x" podStartSLOduration=7.343141812 podStartE2EDuration="22.075039191s" podCreationTimestamp="2026-06-02 18:39:47 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.387042251 +0000 UTC m=+3.050880386" lastFinishedPulling="2026-06-02 18:40:05.11893963 +0000 UTC m=+17.782777765" observedRunningTime="2026-06-02 18:40:09.075021497 +0000 UTC m=+21.738859638" watchObservedRunningTime="2026-06-02 18:40:09.075039191 +0000 UTC m=+21.738877332" Jun 02 18:40:09.089498 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.089458 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rfmlk" podStartSLOduration=3.8267241 podStartE2EDuration="22.089446913s" podCreationTimestamp="2026-06-02 18:39:47 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.388165276 +0000 UTC m=+3.052003410" lastFinishedPulling="2026-06-02 18:40:08.650888088 +0000 UTC m=+21.314726223" observedRunningTime="2026-06-02 18:40:09.089091213 +0000 UTC m=+21.752929356" watchObservedRunningTime="2026-06-02 18:40:09.089446913 +0000 UTC m=+21.753285055" Jun 02 18:40:09.103430 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.103395 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-gb49h" podStartSLOduration=3.841559338 podStartE2EDuration="22.103383916s" podCreationTimestamp="2026-06-02 18:39:47 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.389072196 +0000 UTC m=+3.052910320" lastFinishedPulling="2026-06-02 18:40:08.650896773 +0000 UTC m=+21.314734898" observedRunningTime="2026-06-02 18:40:09.102992192 +0000 UTC m=+21.766830335" watchObservedRunningTime="2026-06-02 18:40:09.103383916 +0000 UTC m=+21.767222058" Jun 02 18:40:09.443930 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.443711 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:40:09.444341 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.444322 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:40:09.639973 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.639909 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:40:09.640432 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.640409 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rfmlk" Jun 02 18:40:09.870648 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.870624 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:09.870868 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:09.870722 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:09.870868 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.870743 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:09.870959 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:09.870869 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:09.870959 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:09.870920 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:09.871026 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:09.871008 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:10.072092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.072073 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:40:10.072512 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.072303 2561 generic.go:358] "Generic (PLEG): container finished" podID="ee95d5c1-acea-42fb-907b-6c41b37b0cd5" containerID="3d76b03730a1dc0b96e45632c9137776afa421fea3173daf539f4841260a588a" exitCode=1 Jun 02 18:40:10.072512 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.072354 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"24cfe32fb7512364e4abebc38339b678e27e36db140dbdb84e6d04ce3858e9c1"} Jun 02 18:40:10.072512 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.072372 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"30306ac1298ece4120140e51ee27b6e925e070c233a5e0ca6278d701bbfb35ab"} Jun 02 18:40:10.072512 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.072380 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"003cbb59adb6ca23335b73f3b3df48d403c3b2c8b731e246b5763d1daef2f79d"} Jun 02 18:40:10.072512 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.072388 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"fb8b0fc6981013f07eae0b46c205d57f35a205bb4d81d127f66c98af9bd6a37e"} Jun 02 18:40:10.072512 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.072396 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"5ef4fefa79e64cfc8d1ff98e7c4ed2e2b6dbd5710a685e53a12822cd223a6550"} Jun 02 18:40:10.072512 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.072405 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerDied","Data":"3d76b03730a1dc0b96e45632c9137776afa421fea3173daf539f4841260a588a"} Jun 02 18:40:10.073488 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.073469 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fhztz" event={"ID":"13b77e1e-c560-4797-b0cd-359d71f7cc39","Type":"ContainerStarted","Data":"0631042b321e8c7d7df2cbf6c89469291b8dd24dab33a4d3b63fb8c7b82a6f34"} Jun 02 18:40:10.074556 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.074534 2561 generic.go:358] "Generic (PLEG): container finished" podID="5fb7747a-366d-4c39-a1ca-9af3670ba925" containerID="1b188e8196d4b12db8507154f15124946e8b1520f905fd455c95dc928e2053ca" exitCode=0 Jun 02 18:40:10.074618 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.074605 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerDied","Data":"1b188e8196d4b12db8507154f15124946e8b1520f905fd455c95dc928e2053ca"} Jun 02 18:40:10.075859 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.075750 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rfmlk" event={"ID":"952fbca6-9a28-487e-a267-3c6ee61f4597","Type":"ContainerStarted","Data":"ac44626641675a5393280e534334173d3746429a7eed59d37e20308e945072ec"} Jun 02 18:40:10.076955 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.076870 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j6tg9" event={"ID":"b250934f-ca67-4400-87df-aec0dc6db304","Type":"ContainerStarted","Data":"64cc5a5653e11b2b9e6abb42b60b7e0f899d70f46a7f907a9e4a935afdd1b68d"} Jun 02 18:40:10.122325 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.122288 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fhztz" podStartSLOduration=4.867244746 podStartE2EDuration="23.122274165s" podCreationTimestamp="2026-06-02 18:39:47 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.397586873 +0000 UTC m=+3.061424992" lastFinishedPulling="2026-06-02 18:40:08.652616279 +0000 UTC m=+21.316454411" observedRunningTime="2026-06-02 18:40:10.122262592 +0000 UTC m=+22.786100735" watchObservedRunningTime="2026-06-02 18:40:10.122274165 +0000 UTC m=+22.786112308" Jun 02 18:40:10.122634 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.122602 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-j6tg9" podStartSLOduration=3.47747174 podStartE2EDuration="22.122593913s" podCreationTimestamp="2026-06-02 18:39:48 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.394154006 +0000 UTC m=+3.057992126" lastFinishedPulling="2026-06-02 18:40:09.039276172 +0000 UTC m=+21.703114299" observedRunningTime="2026-06-02 18:40:10.107509188 +0000 UTC m=+22.771347331" watchObservedRunningTime="2026-06-02 18:40:10.122593913 +0000 UTC m=+22.786432059" Jun 02 18:40:10.199645 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.199607 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 18:40:10.824658 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.824547 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T18:40:10.199625254Z","UUID":"3a201f0b-6531-40c5-83a8-e0d99fd6cab7","Handler":null,"Name":"","Endpoint":""} Jun 02 18:40:10.826469 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.826447 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 18:40:10.826469 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:10.826475 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 18:40:11.080060 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:11.079795 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jkb4t" event={"ID":"36e2f841-f27d-47d4-a4e9-ad3de78797bc","Type":"ContainerStarted","Data":"f63416cf1d46f52ee82f505efdd542a0995bcbd6e910e4381789f5c59df8a4dc"} Jun 02 18:40:11.081874 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:11.081848 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" event={"ID":"911f6497-ef1a-47e9-b935-84e5c6b8eaf7","Type":"ContainerStarted","Data":"25fd80bda2c44c8c9d260a2e0661dadf409ac4934718fa9548b59a82a3cbd031"} Jun 02 18:40:11.094475 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:11.094424 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jkb4t" podStartSLOduration=5.834171012 podStartE2EDuration="24.094408604s" podCreationTimestamp="2026-06-02 18:39:47 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.396076278 +0000 UTC m=+3.059914398" lastFinishedPulling="2026-06-02 18:40:08.656313859 +0000 UTC m=+21.320151990" observedRunningTime="2026-06-02 18:40:11.094202137 +0000 UTC m=+23.758040280" watchObservedRunningTime="2026-06-02 18:40:11.094408604 +0000 UTC m=+23.758246747" Jun 02 18:40:11.870374 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:11.870289 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:11.870527 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:11.870447 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:11.870766 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:11.870747 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:11.870886 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:11.870865 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:11.870959 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:11.870902 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:11.871022 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:11.871007 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:12.086720 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:12.086693 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:40:12.087247 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:12.087222 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"4d59807619363e0f6fc2de56f8dcfa00ba8f16e834d9ec7e0e878cc39a287201"} Jun 02 18:40:12.089451 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:12.089420 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" event={"ID":"911f6497-ef1a-47e9-b935-84e5c6b8eaf7","Type":"ContainerStarted","Data":"3fe5c25d4f62cbcc289795a30f411032d3234cfc10151e6f9289dc1939fcc637"} Jun 02 18:40:12.106287 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:12.106250 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qvs6f" podStartSLOduration=4.446124558 podStartE2EDuration="25.106236527s" podCreationTimestamp="2026-06-02 18:39:47 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.392803887 +0000 UTC m=+3.056642009" lastFinishedPulling="2026-06-02 18:40:11.052915853 +0000 UTC m=+23.716753978" observedRunningTime="2026-06-02 18:40:12.106167726 +0000 UTC m=+24.770005869" watchObservedRunningTime="2026-06-02 18:40:12.106236527 +0000 UTC m=+24.770074668" Jun 02 18:40:13.870789 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:13.870756 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:13.871530 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:13.870893 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:13.871530 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:13.870921 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:13.871530 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:13.870893 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:13.871530 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:13.871021 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:13.871530 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:13.871108 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:15.098532 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.098364 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:40:15.099051 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.098849 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"4efba47f1c7c1b33cf0c973977ebe76cb1c22660b5bb8ae28e94a326a265c4d2"} Jun 02 18:40:15.099176 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.099151 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:40:15.099327 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.099185 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:40:15.099327 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.099198 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:40:15.099456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.099436 2561 scope.go:117] "RemoveContainer" containerID="3d76b03730a1dc0b96e45632c9137776afa421fea3173daf539f4841260a588a" Jun 02 18:40:15.101149 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.101122 2561 generic.go:358] "Generic (PLEG): container finished" podID="5fb7747a-366d-4c39-a1ca-9af3670ba925" containerID="1a9580ce896727fe3b6e0cbde5e6d7cfc4dba51a64c6b20474456af899d896b7" exitCode=0 Jun 02 18:40:15.101257 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.101186 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerDied","Data":"1a9580ce896727fe3b6e0cbde5e6d7cfc4dba51a64c6b20474456af899d896b7"} Jun 02 18:40:15.117575 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.117554 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:40:15.118612 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.118593 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:40:15.870121 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.869935 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:15.870218 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.869961 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:15.870269 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:15.870238 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:15.870312 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:15.869990 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:15.870348 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:15.870329 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:15.870403 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:15.870380 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:16.048311 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.048234 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7lcdg"] Jun 02 18:40:16.051182 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.051154 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hr2qg"] Jun 02 18:40:16.051678 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.051657 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9m7z"] Jun 02 18:40:16.104589 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.104560 2561 generic.go:358] "Generic (PLEG): container finished" podID="5fb7747a-366d-4c39-a1ca-9af3670ba925" containerID="62146f2f2b400f8f4153949536c52abe9b5166615f425e0e021c185fab33262f" exitCode=0 Jun 02 18:40:16.105012 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.104646 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerDied","Data":"62146f2f2b400f8f4153949536c52abe9b5166615f425e0e021c185fab33262f"} Jun 02 18:40:16.107899 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.107869 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:40:16.108232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.108211 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" event={"ID":"ee95d5c1-acea-42fb-907b-6c41b37b0cd5","Type":"ContainerStarted","Data":"341ecfd97da5d11689b936b43ea22c164064e1ff4de38ce565b3286a2cb1543e"} Jun 02 18:40:16.108341 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.108255 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:16.108401 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.108374 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:16.108401 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:16.108382 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:16.108503 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:16.108483 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:16.108543 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.108535 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:16.108625 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:16.108607 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:16.149017 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:16.148978 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" podStartSLOduration=10.870427379 podStartE2EDuration="29.148965804s" podCreationTimestamp="2026-06-02 18:39:47 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.386067494 +0000 UTC m=+3.049905614" lastFinishedPulling="2026-06-02 18:40:08.664605918 +0000 UTC m=+21.328444039" observedRunningTime="2026-06-02 18:40:16.148741464 +0000 UTC m=+28.812579605" watchObservedRunningTime="2026-06-02 18:40:16.148965804 +0000 UTC m=+28.812803947" Jun 02 18:40:17.112139 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:17.112105 2561 generic.go:358] "Generic (PLEG): container finished" podID="5fb7747a-366d-4c39-a1ca-9af3670ba925" containerID="f37f1c215865fbde2ebaa203bcd33cc929c9aea829658acab6261211e9f49230" exitCode=0 Jun 02 18:40:17.112521 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:17.112195 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerDied","Data":"f37f1c215865fbde2ebaa203bcd33cc929c9aea829658acab6261211e9f49230"} Jun 02 18:40:17.871319 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:17.871287 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:17.871441 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:17.871395 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:17.871747 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:17.871720 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:17.871895 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:17.871866 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:17.871895 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:17.871880 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:17.872072 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:17.871981 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:19.870454 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:19.870418 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:19.871190 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:19.870530 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:19.871190 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:19.870541 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7lcdg" podUID="23815455-f102-4734-9bf4-1ed7356ef1f8" Jun 02 18:40:19.871190 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:19.870559 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:19.871190 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:19.870649 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b9m7z" podUID="16f8406c-d799-4759-9860-fd9fb129b8a2" Jun 02 18:40:19.871190 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:19.870731 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hr2qg" podUID="e4a88604-4499-41a9-832c-4dc04478bf7a" Jun 02 18:40:21.525375 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.525340 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:21.525927 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:21.525502 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:21.525927 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:21.525584 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs podName:16f8406c-d799-4759-9860-fd9fb129b8a2 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:53.525564353 +0000 UTC m=+66.189402478 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs") pod "network-metrics-daemon-b9m7z" (UID: "16f8406c-d799-4759-9860-fd9fb129b8a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:21.626410 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.626367 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:21.626583 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:21.626513 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:40:21.626651 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:21.626589 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret podName:23815455-f102-4734-9bf4-1ed7356ef1f8 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:53.626570213 +0000 UTC m=+66.290408333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret") pod "global-pull-secret-syncer-7lcdg" (UID: "23815455-f102-4734-9bf4-1ed7356ef1f8") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:40:21.672333 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.672306 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-211.ec2.internal" event="NodeReady" Jun 02 18:40:21.672499 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.672438 2561 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 18:40:21.712881 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.712792 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9tvm7"] Jun 02 18:40:21.728453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.727886 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:21.728453 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:21.728042 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:40:21.728453 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:21.728063 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:40:21.728453 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:21.728075 2561 projected.go:194] Error preparing data for projected volume kube-api-access-btl7j for pod openshift-network-diagnostics/network-check-target-hr2qg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:21.728453 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:21.728129 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j podName:e4a88604-4499-41a9-832c-4dc04478bf7a nodeName:}" failed. No retries permitted until 2026-06-02 18:40:53.728113067 +0000 UTC m=+66.391951204 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-btl7j" (UniqueName: "kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j") pod "network-check-target-hr2qg" (UID: "e4a88604-4499-41a9-832c-4dc04478bf7a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:21.748999 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.748971 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rlbvb"] Jun 02 18:40:21.749133 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.749116 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:21.752029 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.751820 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 18:40:21.752029 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.751907 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h76xf\"" Jun 02 18:40:21.752029 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.751848 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 18:40:21.764763 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.764742 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9tvm7"] Jun 02 18:40:21.764763 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.764765 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rlbvb"] Jun 02 18:40:21.764946 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.764862 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:21.768193 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.768002 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 18:40:21.768299 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.768272 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vdj79\"" Jun 02 18:40:21.768299 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.768287 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 18:40:21.768511 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.768496 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 18:40:21.870334 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.870312 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:21.871939 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.871919 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:21.872319 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.872302 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:21.873066 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.873040 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgbvm\"" Jun 02 18:40:21.873066 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.873052 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 18:40:21.874267 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.874246 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 18:40:21.874379 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.874275 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6lfr\"" Jun 02 18:40:21.874535 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.874491 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 18:40:21.874654 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.874638 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 18:40:21.929746 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.929716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:21.929885 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.929756 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khkb8\" (UniqueName: \"kubernetes.io/projected/a7123799-65fa-4a33-84fe-d00ff80098d9-kube-api-access-khkb8\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:21.929885 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.929853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7123799-65fa-4a33-84fe-d00ff80098d9-tmp-dir\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:21.930002 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.929896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgvlp\" (UniqueName: \"kubernetes.io/projected/55d18e74-ad37-4eae-ade7-44fc72b9c248-kube-api-access-lgvlp\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:21.930002 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.929924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7123799-65fa-4a33-84fe-d00ff80098d9-config-volume\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:21.930002 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:21.929967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.031270 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.031198 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7123799-65fa-4a33-84fe-d00ff80098d9-tmp-dir\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.031270 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.031247 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgvlp\" (UniqueName: \"kubernetes.io/projected/55d18e74-ad37-4eae-ade7-44fc72b9c248-kube-api-access-lgvlp\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:22.031453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.031277 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7123799-65fa-4a33-84fe-d00ff80098d9-config-volume\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.031453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.031297 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.031453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.031365 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:22.031453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.031391 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khkb8\" (UniqueName: \"kubernetes.io/projected/a7123799-65fa-4a33-84fe-d00ff80098d9-kube-api-access-khkb8\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.031453 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:22.031421 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:22.031700 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:22.031487 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls podName:a7123799-65fa-4a33-84fe-d00ff80098d9 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:22.531466348 +0000 UTC m=+35.195304470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls") pod "dns-default-9tvm7" (UID: "a7123799-65fa-4a33-84fe-d00ff80098d9") : secret "dns-default-metrics-tls" not found Jun 02 18:40:22.031700 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:22.031511 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:22.031700 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.031540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7123799-65fa-4a33-84fe-d00ff80098d9-tmp-dir\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.031700 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:22.031560 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert podName:55d18e74-ad37-4eae-ade7-44fc72b9c248 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:22.531546865 +0000 UTC m=+35.195384985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert") pod "ingress-canary-rlbvb" (UID: "55d18e74-ad37-4eae-ade7-44fc72b9c248") : secret "canary-serving-cert" not found Jun 02 18:40:22.031942 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.031891 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7123799-65fa-4a33-84fe-d00ff80098d9-config-volume\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.043178 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.043160 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgvlp\" (UniqueName: \"kubernetes.io/projected/55d18e74-ad37-4eae-ade7-44fc72b9c248-kube-api-access-lgvlp\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:22.043634 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.043614 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khkb8\" (UniqueName: \"kubernetes.io/projected/a7123799-65fa-4a33-84fe-d00ff80098d9-kube-api-access-khkb8\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.535967 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.535924 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:22.536404 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:22.536036 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:22.536404 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:22.536100 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:22.536404 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:22.536161 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:22.536404 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:22.536198 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert podName:55d18e74-ad37-4eae-ade7-44fc72b9c248 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:23.536176344 +0000 UTC m=+36.200014464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert") pod "ingress-canary-rlbvb" (UID: "55d18e74-ad37-4eae-ade7-44fc72b9c248") : secret "canary-serving-cert" not found Jun 02 18:40:22.536404 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:22.536221 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls podName:a7123799-65fa-4a33-84fe-d00ff80098d9 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:23.536210928 +0000 UTC m=+36.200049052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls") pod "dns-default-9tvm7" (UID: "a7123799-65fa-4a33-84fe-d00ff80098d9") : secret "dns-default-metrics-tls" not found Jun 02 18:40:23.542781 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:23.542741 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:23.543181 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:23.542851 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:23.543181 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:23.542912 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:23.543181 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:23.542969 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:23.543181 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:23.542994 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert podName:55d18e74-ad37-4eae-ade7-44fc72b9c248 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:25.54297086 +0000 UTC m=+38.206808986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert") pod "ingress-canary-rlbvb" (UID: "55d18e74-ad37-4eae-ade7-44fc72b9c248") : secret "canary-serving-cert" not found Jun 02 18:40:23.543181 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:23.543011 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls podName:a7123799-65fa-4a33-84fe-d00ff80098d9 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:25.543000553 +0000 UTC m=+38.206838672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls") pod "dns-default-9tvm7" (UID: "a7123799-65fa-4a33-84fe-d00ff80098d9") : secret "dns-default-metrics-tls" not found Jun 02 18:40:24.128847 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:24.128789 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerStarted","Data":"5a7de176ccb9fceed46c10cc92a3f6f303eb83380cebc27c6de44be389f0aac1"} Jun 02 18:40:25.133490 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:25.133455 2561 generic.go:358] "Generic (PLEG): container finished" podID="5fb7747a-366d-4c39-a1ca-9af3670ba925" containerID="5a7de176ccb9fceed46c10cc92a3f6f303eb83380cebc27c6de44be389f0aac1" exitCode=0 Jun 02 18:40:25.134008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:25.133508 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerDied","Data":"5a7de176ccb9fceed46c10cc92a3f6f303eb83380cebc27c6de44be389f0aac1"} Jun 02 18:40:25.555062 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:25.555026 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:25.555230 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:25.555098 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:25.555230 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:25.555151 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:25.555230 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:25.555213 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls podName:a7123799-65fa-4a33-84fe-d00ff80098d9 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:29.555198018 +0000 UTC m=+42.219036138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls") pod "dns-default-9tvm7" (UID: "a7123799-65fa-4a33-84fe-d00ff80098d9") : secret "dns-default-metrics-tls" not found Jun 02 18:40:25.555363 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:25.555234 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:25.555363 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:25.555287 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert podName:55d18e74-ad37-4eae-ade7-44fc72b9c248 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:29.555270918 +0000 UTC m=+42.219109054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert") pod "ingress-canary-rlbvb" (UID: "55d18e74-ad37-4eae-ade7-44fc72b9c248") : secret "canary-serving-cert" not found Jun 02 18:40:26.137671 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:26.137637 2561 generic.go:358] "Generic (PLEG): container finished" podID="5fb7747a-366d-4c39-a1ca-9af3670ba925" containerID="77106646789ee4483f1b91404277016c1d5a1a20231befb71bbd69fbbb1ffe0d" exitCode=0 Jun 02 18:40:26.138065 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:26.137701 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerDied","Data":"77106646789ee4483f1b91404277016c1d5a1a20231befb71bbd69fbbb1ffe0d"} Jun 02 18:40:27.142917 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:27.142886 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" event={"ID":"5fb7747a-366d-4c39-a1ca-9af3670ba925","Type":"ContainerStarted","Data":"a10e24fad3e4701264db4b70fb26c119819cf489bcebccd68b64041b285c2f82"} Jun 02 18:40:27.165418 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:27.165362 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6lvfw" podStartSLOduration=6.61430793 podStartE2EDuration="40.165345086s" podCreationTimestamp="2026-06-02 18:39:47 +0000 UTC" firstStartedPulling="2026-06-02 18:39:50.394155238 +0000 UTC m=+3.057993373" lastFinishedPulling="2026-06-02 18:40:23.945192405 +0000 UTC m=+36.609030529" observedRunningTime="2026-06-02 18:40:27.163426329 +0000 UTC m=+39.827264471" watchObservedRunningTime="2026-06-02 18:40:27.165345086 +0000 UTC m=+39.829183232" Jun 02 18:40:29.583815 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:29.583774 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:29.584224 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:29.583863 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:29.584224 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:29.583939 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:29.584224 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:29.583963 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:29.584224 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:29.584008 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert podName:55d18e74-ad37-4eae-ade7-44fc72b9c248 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:37.583993781 +0000 UTC m=+50.247831913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert") pod "ingress-canary-rlbvb" (UID: "55d18e74-ad37-4eae-ade7-44fc72b9c248") : secret "canary-serving-cert" not found Jun 02 18:40:29.584224 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:29.584021 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls podName:a7123799-65fa-4a33-84fe-d00ff80098d9 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:37.58401507 +0000 UTC m=+50.247853189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls") pod "dns-default-9tvm7" (UID: "a7123799-65fa-4a33-84fe-d00ff80098d9") : secret "dns-default-metrics-tls" not found Jun 02 18:40:37.632941 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:37.632898 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:37.633403 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:37.632973 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:37.633403 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:37.633050 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:37.633403 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:37.633073 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:37.633403 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:37.633118 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert podName:55d18e74-ad37-4eae-ade7-44fc72b9c248 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:53.633102106 +0000 UTC m=+66.296940226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert") pod "ingress-canary-rlbvb" (UID: "55d18e74-ad37-4eae-ade7-44fc72b9c248") : secret "canary-serving-cert" not found Jun 02 18:40:37.633403 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:37.633133 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls podName:a7123799-65fa-4a33-84fe-d00ff80098d9 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:53.633126596 +0000 UTC m=+66.296964716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls") pod "dns-default-9tvm7" (UID: "a7123799-65fa-4a33-84fe-d00ff80098d9") : secret "dns-default-metrics-tls" not found Jun 02 18:40:47.123774 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:47.123744 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sftvp" Jun 02 18:40:53.544072 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.544028 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:40:53.546675 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.546656 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 18:40:53.554625 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:53.554598 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 18:40:53.554696 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:53.554672 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs podName:16f8406c-d799-4759-9860-fd9fb129b8a2 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:57.554656273 +0000 UTC m=+130.218494393 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs") pod "network-metrics-daemon-b9m7z" (UID: "16f8406c-d799-4759-9860-fd9fb129b8a2") : secret "metrics-daemon-secret" not found Jun 02 18:40:53.644981 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.644952 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:53.645092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.644997 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:40:53.645092 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:53.645082 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:53.645188 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.645107 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:40:53.645188 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:53.645128 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls podName:a7123799-65fa-4a33-84fe-d00ff80098d9 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:25.645115886 +0000 UTC m=+98.308954007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls") pod "dns-default-9tvm7" (UID: "a7123799-65fa-4a33-84fe-d00ff80098d9") : secret "dns-default-metrics-tls" not found Jun 02 18:40:53.645188 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:53.645176 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:53.645337 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:40:53.645238 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert podName:55d18e74-ad37-4eae-ade7-44fc72b9c248 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:25.645227105 +0000 UTC m=+98.309065232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert") pod "ingress-canary-rlbvb" (UID: "55d18e74-ad37-4eae-ade7-44fc72b9c248") : secret "canary-serving-cert" not found Jun 02 18:40:53.648050 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.648031 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 18:40:53.658491 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.658468 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23815455-f102-4734-9bf4-1ed7356ef1f8-original-pull-secret\") pod \"global-pull-secret-syncer-7lcdg\" (UID: \"23815455-f102-4734-9bf4-1ed7356ef1f8\") " pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:53.697912 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.697889 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7lcdg" Jun 02 18:40:53.746040 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.746007 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:53.748642 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.748624 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 18:40:53.758759 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.758731 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 18:40:53.769725 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.769663 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btl7j\" (UniqueName: \"kubernetes.io/projected/e4a88604-4499-41a9-832c-4dc04478bf7a-kube-api-access-btl7j\") pod \"network-check-target-hr2qg\" (UID: \"e4a88604-4499-41a9-832c-4dc04478bf7a\") " pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:53.834874 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.834786 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7lcdg"] Jun 02 18:40:53.838271 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:40:53.838244 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23815455_f102_4734_9bf4_1ed7356ef1f8.slice/crio-620058e7e3b9439721fdb29ec94bdea5dfb8f0ead82000d4eb851d99e1240d9e WatchSource:0}: Error finding container 620058e7e3b9439721fdb29ec94bdea5dfb8f0ead82000d4eb851d99e1240d9e: Status 404 returned error can't find the container with id 620058e7e3b9439721fdb29ec94bdea5dfb8f0ead82000d4eb851d99e1240d9e Jun 02 18:40:53.993678 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:53.993646 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6lfr\"" Jun 02 18:40:54.001697 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:54.001669 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:54.118503 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:54.118430 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hr2qg"] Jun 02 18:40:54.121846 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:40:54.121802 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a88604_4499_41a9_832c_4dc04478bf7a.slice/crio-bd0b280c561e333021ce198d04c7592c5719b2fc8ec0d64170c1d9cdfd2aea39 WatchSource:0}: Error finding container bd0b280c561e333021ce198d04c7592c5719b2fc8ec0d64170c1d9cdfd2aea39: Status 404 returned error can't find the container with id bd0b280c561e333021ce198d04c7592c5719b2fc8ec0d64170c1d9cdfd2aea39 Jun 02 18:40:54.194241 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:54.194202 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7lcdg" event={"ID":"23815455-f102-4734-9bf4-1ed7356ef1f8","Type":"ContainerStarted","Data":"620058e7e3b9439721fdb29ec94bdea5dfb8f0ead82000d4eb851d99e1240d9e"} Jun 02 18:40:54.195119 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:54.195099 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hr2qg" event={"ID":"e4a88604-4499-41a9-832c-4dc04478bf7a","Type":"ContainerStarted","Data":"bd0b280c561e333021ce198d04c7592c5719b2fc8ec0d64170c1d9cdfd2aea39"} Jun 02 18:40:59.209398 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:59.209358 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hr2qg" event={"ID":"e4a88604-4499-41a9-832c-4dc04478bf7a","Type":"ContainerStarted","Data":"1209b9244f7267a03a9fdfc4942ed3277974cb68e7299226ac67e8f39171955c"} Jun 02 18:40:59.209959 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:59.209465 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:40:59.210580 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:59.210557 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7lcdg" event={"ID":"23815455-f102-4734-9bf4-1ed7356ef1f8","Type":"ContainerStarted","Data":"21532b602d960687de3c4a285643ef6722312686d62297f0c6f3a44fec8deec8"} Jun 02 18:40:59.223603 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:59.223556 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hr2qg" podStartSLOduration=66.825216852 podStartE2EDuration="1m11.223541944s" podCreationTimestamp="2026-06-02 18:39:48 +0000 UTC" firstStartedPulling="2026-06-02 18:40:54.12387631 +0000 UTC m=+66.787714429" lastFinishedPulling="2026-06-02 18:40:58.522201399 +0000 UTC m=+71.186039521" observedRunningTime="2026-06-02 18:40:59.222876624 +0000 UTC m=+71.886714766" watchObservedRunningTime="2026-06-02 18:40:59.223541944 +0000 UTC m=+71.887380083" Jun 02 18:40:59.238068 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:40:59.238009 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7lcdg" podStartSLOduration=65.552427727 podStartE2EDuration="1m10.237991738s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:40:53.840031576 +0000 UTC m=+66.503869696" lastFinishedPulling="2026-06-02 18:40:58.525595583 +0000 UTC m=+71.189433707" observedRunningTime="2026-06-02 18:40:59.236534859 +0000 UTC m=+71.900373003" watchObservedRunningTime="2026-06-02 18:40:59.237991738 +0000 UTC m=+71.901829881" Jun 02 18:41:01.235939 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.235906 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522"] Jun 02 18:41:01.238799 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.238780 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.241167 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.241146 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 18:41:01.241278 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.241143 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 18:41:01.242117 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.242097 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 18:41:01.242182 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.242118 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 18:41:01.245272 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.245013 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522"] Jun 02 18:41:01.309849 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.309791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb1b358f-27a9-415d-90f7-0ac716829d22-tmp\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.309849 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.309846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g26f\" (UniqueName: \"kubernetes.io/projected/fb1b358f-27a9-415d-90f7-0ac716829d22-kube-api-access-6g26f\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.310056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.309874 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb1b358f-27a9-415d-90f7-0ac716829d22-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.410848 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.410795 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb1b358f-27a9-415d-90f7-0ac716829d22-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.410969 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.410900 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb1b358f-27a9-415d-90f7-0ac716829d22-tmp\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.410969 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.410917 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6g26f\" (UniqueName: \"kubernetes.io/projected/fb1b358f-27a9-415d-90f7-0ac716829d22-kube-api-access-6g26f\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.411323 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.411296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb1b358f-27a9-415d-90f7-0ac716829d22-tmp\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.413371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.413344 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb1b358f-27a9-415d-90f7-0ac716829d22-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.419597 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.419576 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g26f\" (UniqueName: \"kubernetes.io/projected/fb1b358f-27a9-415d-90f7-0ac716829d22-kube-api-access-6g26f\") pod \"klusterlet-addon-workmgr-7fc7555f86-92522\" (UID: \"fb1b358f-27a9-415d-90f7-0ac716829d22\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.547633 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.547559 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:01.665256 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:01.665223 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522"] Jun 02 18:41:01.668773 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:01.668744 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1b358f_27a9_415d_90f7_0ac716829d22.slice/crio-23a490d0054631ec4482d0ba37c7d0d64751bbbcf93135ea266079f366a47f96 WatchSource:0}: Error finding container 23a490d0054631ec4482d0ba37c7d0d64751bbbcf93135ea266079f366a47f96: Status 404 returned error can't find the container with id 23a490d0054631ec4482d0ba37c7d0d64751bbbcf93135ea266079f366a47f96 Jun 02 18:41:02.218068 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:02.218032 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" event={"ID":"fb1b358f-27a9-415d-90f7-0ac716829d22","Type":"ContainerStarted","Data":"23a490d0054631ec4482d0ba37c7d0d64751bbbcf93135ea266079f366a47f96"} Jun 02 18:41:11.239031 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:11.238989 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" event={"ID":"fb1b358f-27a9-415d-90f7-0ac716829d22","Type":"ContainerStarted","Data":"384a1f5e5df5c00878e210a46f700c36bc4ed8cc4bea875bc2f6310cd858d67d"} Jun 02 18:41:11.239435 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:11.239234 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:11.240678 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:11.240658 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" Jun 02 18:41:11.253741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:11.253702 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fc7555f86-92522" podStartSLOduration=1.493978759 podStartE2EDuration="10.253691318s" podCreationTimestamp="2026-06-02 18:41:01 +0000 UTC" firstStartedPulling="2026-06-02 18:41:01.670475776 +0000 UTC m=+74.334313898" lastFinishedPulling="2026-06-02 18:41:10.430188324 +0000 UTC m=+83.094026457" observedRunningTime="2026-06-02 18:41:11.252971467 +0000 UTC m=+83.916809608" watchObservedRunningTime="2026-06-02 18:41:11.253691318 +0000 UTC m=+83.917529459" Jun 02 18:41:25.682796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:25.682755 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:41:25.683129 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:25.682813 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:41:25.683129 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:25.682920 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:41:25.683129 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:25.682994 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert podName:55d18e74-ad37-4eae-ade7-44fc72b9c248 nodeName:}" failed. No retries permitted until 2026-06-02 18:42:29.682978427 +0000 UTC m=+162.346816547 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert") pod "ingress-canary-rlbvb" (UID: "55d18e74-ad37-4eae-ade7-44fc72b9c248") : secret "canary-serving-cert" not found Jun 02 18:41:25.683129 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:25.682924 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:41:25.683129 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:25.683070 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls podName:a7123799-65fa-4a33-84fe-d00ff80098d9 nodeName:}" failed. No retries permitted until 2026-06-02 18:42:29.683054334 +0000 UTC m=+162.346892475 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls") pod "dns-default-9tvm7" (UID: "a7123799-65fa-4a33-84fe-d00ff80098d9") : secret "dns-default-metrics-tls" not found Jun 02 18:41:30.215075 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:30.215040 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hr2qg" Jun 02 18:41:36.902569 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.902535 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69"] Jun 02 18:41:36.910594 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.910570 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7566b7bbc6-lhsdh"] Jun 02 18:41:36.910758 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.910737 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69" Jun 02 18:41:36.914645 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.914529 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 18:41:36.914793 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.914772 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7b7nf\"" Jun 02 18:41:36.915051 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.915031 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:41:36.915740 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.915714 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:36.916388 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.916365 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69"] Jun 02 18:41:36.918171 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.918153 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 18:41:36.918406 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.918390 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 18:41:36.918705 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.918690 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 18:41:36.918912 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.918895 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htf9l\"" Jun 02 18:41:36.923364 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.923339 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 18:41:36.926755 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:36.926733 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7566b7bbc6-lhsdh"] Jun 02 18:41:37.002241 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.002212 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt"] Jun 02 18:41:37.005642 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.005618 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n"] Jun 02 18:41:37.005786 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.005752 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt" Jun 02 18:41:37.008443 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.008416 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hq8hb\"" Jun 02 18:41:37.008806 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.008788 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-fxd84"] Jun 02 18:41:37.008923 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.008910 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.012019 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.011999 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-n9nc2"] Jun 02 18:41:37.012127 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.012091 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 18:41:37.012293 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.012204 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.012903 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.012882 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 18:41:37.013022 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.013001 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vgkpt\"" Jun 02 18:41:37.013089 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.013026 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:41:37.013280 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.013266 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 18:41:37.014702 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.014677 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 18:41:37.014808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.014696 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 18:41:37.014808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.014697 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:41:37.014956 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.014937 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nlldd\"" Jun 02 18:41:37.015022 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.015008 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 18:41:37.015314 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.015298 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt"] Jun 02 18:41:37.015425 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.015414 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.018230 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.018212 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 18:41:37.018819 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.018798 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fnzxw\"" Jun 02 18:41:37.019089 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.019071 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 18:41:37.019224 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.019204 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 18:41:37.019617 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.019496 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 18:41:37.019907 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.019812 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n"] Jun 02 18:41:37.021974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.021956 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-n9nc2"] Jun 02 18:41:37.023220 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.023203 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 18:41:37.033718 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.033696 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-fxd84"] Jun 02 18:41:37.062054 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dd1df6e-089d-4cb8-a466-79c41dd49842-ca-trust-extracted\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.062054 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-certificates\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.062259 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-installation-pull-secrets\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.062259 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-bound-sa-token\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.062259 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlwj\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-kube-api-access-hrlwj\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.062386 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-image-registry-private-configuration\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.062386 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-trusted-ca\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.062386 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062373 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn9q2\" (UniqueName: \"kubernetes.io/projected/1b9bea92-8313-40f3-954e-4e638eeaead9-kube-api-access-hn9q2\") pod \"volume-data-source-validator-7598fd5bd-q8x69\" (UID: \"1b9bea92-8313-40f3-954e-4e638eeaead9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69" Jun 02 18:41:37.062479 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.062401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.163714 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163617 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-trusted-ca\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.163714 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163659 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a39c406c-09fe-4dcc-9e79-76b82302919f-snapshots\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.163714 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnlds\" (UniqueName: \"kubernetes.io/projected/a39c406c-09fe-4dcc-9e79-76b82302919f-kube-api-access-mnlds\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db80cc7f-a28e-470f-8de1-0d87fdc5f062-serving-cert\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163761 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-certificates\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163783 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-installation-pull-secrets\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmbs9\" (UniqueName: \"kubernetes.io/projected/db80cc7f-a28e-470f-8de1-0d87fdc5f062-kube-api-access-pmbs9\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163817 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a4541d6-1ce2-4bed-b745-bd9967e91458-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a39c406c-09fe-4dcc-9e79-76b82302919f-tmp\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a39c406c-09fe-4dcc-9e79-76b82302919f-serving-cert\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163952 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlwj\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-kube-api-access-hrlwj\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.163981 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-bound-sa-token\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:37.163987 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:41:37.164007 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:37.164011 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7566b7bbc6-lhsdh: secret "image-registry-tls" not found Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:37.164088 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls podName:4dd1df6e-089d-4cb8-a466-79c41dd49842 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:37.664065294 +0000 UTC m=+110.327903414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls") pod "image-registry-7566b7bbc6-lhsdh" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842") : secret "image-registry-tls" not found Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164157 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbxb\" (UniqueName: \"kubernetes.io/projected/9a4541d6-1ce2-4bed-b745-bd9967e91458-kube-api-access-qnbxb\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlxqk\" (UniqueName: \"kubernetes.io/projected/3dc7e6dd-ca4d-45a7-9e2c-d86661dbaf82-kube-api-access-mlxqk\") pod \"network-check-source-56d84b9f44-t65zt\" (UID: \"3dc7e6dd-ca4d-45a7-9e2c-d86661dbaf82\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt" Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164256 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-image-registry-private-configuration\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a4541d6-1ce2-4bed-b745-bd9967e91458-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39c406c-09fe-4dcc-9e79-76b82302919f-service-ca-bundle\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164426 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-certificates\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164470 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dd1df6e-089d-4cb8-a466-79c41dd49842-ca-trust-extracted\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db80cc7f-a28e-470f-8de1-0d87fdc5f062-config\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.164561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164526 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hn9q2\" (UniqueName: \"kubernetes.io/projected/1b9bea92-8313-40f3-954e-4e638eeaead9-kube-api-access-hn9q2\") pod \"volume-data-source-validator-7598fd5bd-q8x69\" (UID: \"1b9bea92-8313-40f3-954e-4e638eeaead9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69" Jun 02 18:41:37.165018 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39c406c-09fe-4dcc-9e79-76b82302919f-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.165018 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164844 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-trusted-ca\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.165018 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.164820 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dd1df6e-089d-4cb8-a466-79c41dd49842-ca-trust-extracted\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.166395 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.166376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-installation-pull-secrets\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.166687 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.166665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-image-registry-private-configuration\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.173073 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.173044 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlwj\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-kube-api-access-hrlwj\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.173402 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.173382 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-bound-sa-token\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.173737 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.173716 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn9q2\" (UniqueName: \"kubernetes.io/projected/1b9bea92-8313-40f3-954e-4e638eeaead9-kube-api-access-hn9q2\") pod \"volume-data-source-validator-7598fd5bd-q8x69\" (UID: \"1b9bea92-8313-40f3-954e-4e638eeaead9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69" Jun 02 18:41:37.224796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.224763 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69" Jun 02 18:41:37.265924 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.265881 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbxb\" (UniqueName: \"kubernetes.io/projected/9a4541d6-1ce2-4bed-b745-bd9967e91458-kube-api-access-qnbxb\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.265924 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.265930 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mlxqk\" (UniqueName: \"kubernetes.io/projected/3dc7e6dd-ca4d-45a7-9e2c-d86661dbaf82-kube-api-access-mlxqk\") pod \"network-check-source-56d84b9f44-t65zt\" (UID: \"3dc7e6dd-ca4d-45a7-9e2c-d86661dbaf82\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt" Jun 02 18:41:37.266163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.265957 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a4541d6-1ce2-4bed-b745-bd9967e91458-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.266163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.265998 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39c406c-09fe-4dcc-9e79-76b82302919f-service-ca-bundle\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.266163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266028 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db80cc7f-a28e-470f-8de1-0d87fdc5f062-config\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.266163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266102 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39c406c-09fe-4dcc-9e79-76b82302919f-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.266163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266131 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a39c406c-09fe-4dcc-9e79-76b82302919f-snapshots\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.266163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266158 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnlds\" (UniqueName: \"kubernetes.io/projected/a39c406c-09fe-4dcc-9e79-76b82302919f-kube-api-access-mnlds\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.266453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266191 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db80cc7f-a28e-470f-8de1-0d87fdc5f062-serving-cert\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.266453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266226 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmbs9\" (UniqueName: \"kubernetes.io/projected/db80cc7f-a28e-470f-8de1-0d87fdc5f062-kube-api-access-pmbs9\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.266453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266263 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a4541d6-1ce2-4bed-b745-bd9967e91458-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.266453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266288 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a39c406c-09fe-4dcc-9e79-76b82302919f-tmp\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.266453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266319 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a39c406c-09fe-4dcc-9e79-76b82302919f-serving-cert\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.266682 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db80cc7f-a28e-470f-8de1-0d87fdc5f062-config\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.266893 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266868 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39c406c-09fe-4dcc-9e79-76b82302919f-service-ca-bundle\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.266989 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.266975 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9a4541d6-1ce2-4bed-b745-bd9967e91458-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.268451 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.268422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a39c406c-09fe-4dcc-9e79-76b82302919f-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.268558 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.268485 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a39c406c-09fe-4dcc-9e79-76b82302919f-tmp\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.268655 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.268635 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a39c406c-09fe-4dcc-9e79-76b82302919f-snapshots\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.268655 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.268642 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a4541d6-1ce2-4bed-b745-bd9967e91458-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.269025 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.269000 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db80cc7f-a28e-470f-8de1-0d87fdc5f062-serving-cert\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.269683 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.269661 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a39c406c-09fe-4dcc-9e79-76b82302919f-serving-cert\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.275616 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.275583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmbs9\" (UniqueName: \"kubernetes.io/projected/db80cc7f-a28e-470f-8de1-0d87fdc5f062-kube-api-access-pmbs9\") pod \"service-ca-operator-69877444c-fxd84\" (UID: \"db80cc7f-a28e-470f-8de1-0d87fdc5f062\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.276252 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.276204 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnlds\" (UniqueName: \"kubernetes.io/projected/a39c406c-09fe-4dcc-9e79-76b82302919f-kube-api-access-mnlds\") pod \"insights-operator-788bf58df5-n9nc2\" (UID: \"a39c406c-09fe-4dcc-9e79-76b82302919f\") " pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.276628 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.276604 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlxqk\" (UniqueName: \"kubernetes.io/projected/3dc7e6dd-ca4d-45a7-9e2c-d86661dbaf82-kube-api-access-mlxqk\") pod \"network-check-source-56d84b9f44-t65zt\" (UID: \"3dc7e6dd-ca4d-45a7-9e2c-d86661dbaf82\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt" Jun 02 18:41:37.276756 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.276736 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbxb\" (UniqueName: \"kubernetes.io/projected/9a4541d6-1ce2-4bed-b745-bd9967e91458-kube-api-access-qnbxb\") pod \"kube-storage-version-migrator-operator-96ddc787c-zcx5n\" (UID: \"9a4541d6-1ce2-4bed-b745-bd9967e91458\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.316181 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.316145 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt" Jun 02 18:41:37.323392 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.323366 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" Jun 02 18:41:37.335092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.335064 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" Jun 02 18:41:37.339862 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.339808 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-n9nc2" Jun 02 18:41:37.346877 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.346847 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69"] Jun 02 18:41:37.354638 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:37.354602 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9bea92_8313_40f3_954e_4e638eeaead9.slice/crio-bb9f41ad92ed0cb08b7f9b5e3136bc66d8b99e5947e6640650366f52d230277a WatchSource:0}: Error finding container bb9f41ad92ed0cb08b7f9b5e3136bc66d8b99e5947e6640650366f52d230277a: Status 404 returned error can't find the container with id bb9f41ad92ed0cb08b7f9b5e3136bc66d8b99e5947e6640650366f52d230277a Jun 02 18:41:37.466661 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.466622 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt"] Jun 02 18:41:37.478861 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:37.478816 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dc7e6dd_ca4d_45a7_9e2c_d86661dbaf82.slice/crio-ebb4f397e2b316336f52422163bfbe33febb589e5c212784dee752c216bed0ad WatchSource:0}: Error finding container ebb4f397e2b316336f52422163bfbe33febb589e5c212784dee752c216bed0ad: Status 404 returned error can't find the container with id ebb4f397e2b316336f52422163bfbe33febb589e5c212784dee752c216bed0ad Jun 02 18:41:37.503480 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.503457 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n"] Jun 02 18:41:37.506373 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.506353 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-n9nc2"] Jun 02 18:41:37.508883 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:37.508855 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a4541d6_1ce2_4bed_b745_bd9967e91458.slice/crio-49143b8f5b932453f970a1cd589e3c25d01722f269b7e7ba3239c3cdccf7a022 WatchSource:0}: Error finding container 49143b8f5b932453f970a1cd589e3c25d01722f269b7e7ba3239c3cdccf7a022: Status 404 returned error can't find the container with id 49143b8f5b932453f970a1cd589e3c25d01722f269b7e7ba3239c3cdccf7a022 Jun 02 18:41:37.509770 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:37.509752 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda39c406c_09fe_4dcc_9e79_76b82302919f.slice/crio-ff3aa506a219ff42881da230eed6af489a9b6fdb66629182b2a039fa581c9702 WatchSource:0}: Error finding container ff3aa506a219ff42881da230eed6af489a9b6fdb66629182b2a039fa581c9702: Status 404 returned error can't find the container with id ff3aa506a219ff42881da230eed6af489a9b6fdb66629182b2a039fa581c9702 Jun 02 18:41:37.522661 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.522638 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-fxd84"] Jun 02 18:41:37.525794 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:37.525774 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb80cc7f_a28e_470f_8de1_0d87fdc5f062.slice/crio-ef4e7be42dbfd914ca4830a9ae5b1bdc1d38eeee732e8f6bf2aa655185a885a1 WatchSource:0}: Error finding container ef4e7be42dbfd914ca4830a9ae5b1bdc1d38eeee732e8f6bf2aa655185a885a1: Status 404 returned error can't find the container with id ef4e7be42dbfd914ca4830a9ae5b1bdc1d38eeee732e8f6bf2aa655185a885a1 Jun 02 18:41:37.670198 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:37.670168 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:37.670357 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:37.670325 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:41:37.670357 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:37.670346 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7566b7bbc6-lhsdh: secret "image-registry-tls" not found Jun 02 18:41:37.670433 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:37.670400 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls podName:4dd1df6e-089d-4cb8-a466-79c41dd49842 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:38.670385747 +0000 UTC m=+111.334223867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls") pod "image-registry-7566b7bbc6-lhsdh" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842") : secret "image-registry-tls" not found Jun 02 18:41:38.289103 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:38.289034 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69" event={"ID":"1b9bea92-8313-40f3-954e-4e638eeaead9","Type":"ContainerStarted","Data":"bb9f41ad92ed0cb08b7f9b5e3136bc66d8b99e5947e6640650366f52d230277a"} Jun 02 18:41:38.291077 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:38.291013 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" event={"ID":"db80cc7f-a28e-470f-8de1-0d87fdc5f062","Type":"ContainerStarted","Data":"ef4e7be42dbfd914ca4830a9ae5b1bdc1d38eeee732e8f6bf2aa655185a885a1"} Jun 02 18:41:38.292235 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:38.292196 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-n9nc2" event={"ID":"a39c406c-09fe-4dcc-9e79-76b82302919f","Type":"ContainerStarted","Data":"ff3aa506a219ff42881da230eed6af489a9b6fdb66629182b2a039fa581c9702"} Jun 02 18:41:38.293676 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:38.293650 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" event={"ID":"9a4541d6-1ce2-4bed-b745-bd9967e91458","Type":"ContainerStarted","Data":"49143b8f5b932453f970a1cd589e3c25d01722f269b7e7ba3239c3cdccf7a022"} Jun 02 18:41:38.296866 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:38.296840 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt" event={"ID":"3dc7e6dd-ca4d-45a7-9e2c-d86661dbaf82","Type":"ContainerStarted","Data":"d353f3404878fc25be6002d1de5e9e01fca86cc1c32e347ac75f2d657325bb52"} Jun 02 18:41:38.296954 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:38.296872 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt" event={"ID":"3dc7e6dd-ca4d-45a7-9e2c-d86661dbaf82","Type":"ContainerStarted","Data":"ebb4f397e2b316336f52422163bfbe33febb589e5c212784dee752c216bed0ad"} Jun 02 18:41:38.314222 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:38.314174 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-t65zt" podStartSLOduration=2.314156792 podStartE2EDuration="2.314156792s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:41:38.314028757 +0000 UTC m=+110.977866899" watchObservedRunningTime="2026-06-02 18:41:38.314156792 +0000 UTC m=+110.977994936" Jun 02 18:41:38.678998 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:38.678909 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:38.679174 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:38.679093 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:41:38.679174 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:38.679116 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7566b7bbc6-lhsdh: secret "image-registry-tls" not found Jun 02 18:41:38.679275 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:38.679182 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls podName:4dd1df6e-089d-4cb8-a466-79c41dd49842 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:40.67916124 +0000 UTC m=+113.342999363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls") pod "image-registry-7566b7bbc6-lhsdh" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842") : secret "image-registry-tls" not found Jun 02 18:41:39.301911 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:39.301868 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69" event={"ID":"1b9bea92-8313-40f3-954e-4e638eeaead9","Type":"ContainerStarted","Data":"d62cc0d594ffa64bca5c05fe9f99ae424ba4c15a7e223fb41b064b7c692d7076"} Jun 02 18:41:39.317885 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:39.317822 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-q8x69" podStartSLOduration=1.744143422 podStartE2EDuration="3.317808039s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="2026-06-02 18:41:37.357915253 +0000 UTC m=+110.021753373" lastFinishedPulling="2026-06-02 18:41:38.931579854 +0000 UTC m=+111.595417990" observedRunningTime="2026-06-02 18:41:39.317210925 +0000 UTC m=+111.981049070" watchObservedRunningTime="2026-06-02 18:41:39.317808039 +0000 UTC m=+111.981646188" Jun 02 18:41:40.698030 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:40.698007 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:40.698738 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:40.698584 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:41:40.698738 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:40.698613 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7566b7bbc6-lhsdh: secret "image-registry-tls" not found Jun 02 18:41:40.698738 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:40.698706 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls podName:4dd1df6e-089d-4cb8-a466-79c41dd49842 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:44.698683426 +0000 UTC m=+117.362521549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls") pod "image-registry-7566b7bbc6-lhsdh" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842") : secret "image-registry-tls" not found Jun 02 18:41:41.309582 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:41.309534 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" event={"ID":"db80cc7f-a28e-470f-8de1-0d87fdc5f062","Type":"ContainerStarted","Data":"1af631208e744d9babf85acd004d96fa1b16a37848d5e5d2559c7a31ab8ceee5"} Jun 02 18:41:41.310873 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:41.310822 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-n9nc2" event={"ID":"a39c406c-09fe-4dcc-9e79-76b82302919f","Type":"ContainerStarted","Data":"efc5bf9cd59eb43e1e49a0e40185a559f55a4d22420794a05b1aafe95b699b70"} Jun 02 18:41:41.312295 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:41.312268 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" event={"ID":"9a4541d6-1ce2-4bed-b745-bd9967e91458","Type":"ContainerStarted","Data":"7bdd0b440579d1fc569965d3ac9dd6673b3e242b894a11e7015b3a7b9be889b8"} Jun 02 18:41:41.324520 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:41.324452 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" podStartSLOduration=2.16490375 podStartE2EDuration="5.324439388s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="2026-06-02 18:41:37.528214029 +0000 UTC m=+110.192052150" lastFinishedPulling="2026-06-02 18:41:40.687749661 +0000 UTC m=+113.351587788" observedRunningTime="2026-06-02 18:41:41.32394609 +0000 UTC m=+113.987784233" watchObservedRunningTime="2026-06-02 18:41:41.324439388 +0000 UTC m=+113.988277531" Jun 02 18:41:41.338761 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:41.338714 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-n9nc2" podStartSLOduration=2.167824749 podStartE2EDuration="5.338698128s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="2026-06-02 18:41:37.514002834 +0000 UTC m=+110.177840967" lastFinishedPulling="2026-06-02 18:41:40.684876211 +0000 UTC m=+113.348714346" observedRunningTime="2026-06-02 18:41:41.338168715 +0000 UTC m=+114.002006859" watchObservedRunningTime="2026-06-02 18:41:41.338698128 +0000 UTC m=+114.002536272" Jun 02 18:41:41.354745 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:41.354692 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" podStartSLOduration=2.175821867 podStartE2EDuration="5.354679697s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="2026-06-02 18:41:37.511388871 +0000 UTC m=+110.175226996" lastFinishedPulling="2026-06-02 18:41:40.690246695 +0000 UTC m=+113.354084826" observedRunningTime="2026-06-02 18:41:41.35342506 +0000 UTC m=+114.017263204" watchObservedRunningTime="2026-06-02 18:41:41.354679697 +0000 UTC m=+114.018517841" Jun 02 18:41:43.588688 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:43.588651 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gb49h_3ed06e64-fde1-40e3-b574-f7b61df73947/dns-node-resolver/0.log" Jun 02 18:41:44.049370 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.049332 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-svpb6"] Jun 02 18:41:44.052588 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.052566 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.054990 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.054967 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 18:41:44.055093 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.055016 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 18:41:44.055799 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.055783 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4pb4g\"" Jun 02 18:41:44.055875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.055784 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 18:41:44.055875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.055863 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 18:41:44.060003 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.059983 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-svpb6"] Jun 02 18:41:44.124228 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.124194 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2ae3421-1984-4b71-82cd-17351e3fdc8b-signing-cabundle\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.124382 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.124240 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2ae3421-1984-4b71-82cd-17351e3fdc8b-signing-key\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.124382 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.124331 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4wtn\" (UniqueName: \"kubernetes.io/projected/a2ae3421-1984-4b71-82cd-17351e3fdc8b-kube-api-access-v4wtn\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.224779 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.224746 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4wtn\" (UniqueName: \"kubernetes.io/projected/a2ae3421-1984-4b71-82cd-17351e3fdc8b-kube-api-access-v4wtn\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.224966 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.224810 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2ae3421-1984-4b71-82cd-17351e3fdc8b-signing-cabundle\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.224966 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.224875 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2ae3421-1984-4b71-82cd-17351e3fdc8b-signing-key\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.225478 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.225456 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a2ae3421-1984-4b71-82cd-17351e3fdc8b-signing-cabundle\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.227458 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.227440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a2ae3421-1984-4b71-82cd-17351e3fdc8b-signing-key\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.233073 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.233052 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4wtn\" (UniqueName: \"kubernetes.io/projected/a2ae3421-1984-4b71-82cd-17351e3fdc8b-kube-api-access-v4wtn\") pod \"service-ca-685df94d57-svpb6\" (UID: \"a2ae3421-1984-4b71-82cd-17351e3fdc8b\") " pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.362120 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.362037 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-svpb6" Jun 02 18:41:44.489496 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.489463 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-svpb6"] Jun 02 18:41:44.492681 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:44.492656 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ae3421_1984_4b71_82cd_17351e3fdc8b.slice/crio-dbd15231e21e95a0c1f9bc515a1d07af3ffdf8fc08d77514d500d8ff259b1777 WatchSource:0}: Error finding container dbd15231e21e95a0c1f9bc515a1d07af3ffdf8fc08d77514d500d8ff259b1777: Status 404 returned error can't find the container with id dbd15231e21e95a0c1f9bc515a1d07af3ffdf8fc08d77514d500d8ff259b1777 Jun 02 18:41:44.728888 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.728820 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:44.729262 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:44.728977 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:41:44.729262 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:44.728997 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7566b7bbc6-lhsdh: secret "image-registry-tls" not found Jun 02 18:41:44.729262 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:41:44.729056 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls podName:4dd1df6e-089d-4cb8-a466-79c41dd49842 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:52.729038143 +0000 UTC m=+125.392876263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls") pod "image-registry-7566b7bbc6-lhsdh" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842") : secret "image-registry-tls" not found Jun 02 18:41:44.988703 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:44.988635 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pb92x_f8d846e1-b9ad-4bdf-b7d1-087d08220a80/node-ca/0.log" Jun 02 18:41:45.324471 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:45.324389 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-svpb6" event={"ID":"a2ae3421-1984-4b71-82cd-17351e3fdc8b","Type":"ContainerStarted","Data":"25b3860a15907297fb694f0d928456afb0f3adb7a0099f42217b58c00baeee37"} Jun 02 18:41:45.324471 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:45.324426 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-svpb6" event={"ID":"a2ae3421-1984-4b71-82cd-17351e3fdc8b","Type":"ContainerStarted","Data":"dbd15231e21e95a0c1f9bc515a1d07af3ffdf8fc08d77514d500d8ff259b1777"} Jun 02 18:41:45.341483 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:45.341444 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-svpb6" podStartSLOduration=1.341430641 podStartE2EDuration="1.341430641s" podCreationTimestamp="2026-06-02 18:41:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:41:45.340039549 +0000 UTC m=+118.003877693" watchObservedRunningTime="2026-06-02 18:41:45.341430641 +0000 UTC m=+118.005268783" Jun 02 18:41:52.794396 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:52.794359 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:52.797083 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:52.797058 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"image-registry-7566b7bbc6-lhsdh\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:52.833214 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:52.833188 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htf9l\"" Jun 02 18:41:52.841258 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:52.841222 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:52.968147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:52.968117 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7566b7bbc6-lhsdh"] Jun 02 18:41:52.971114 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:52.971089 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd1df6e_089d_4cb8_a466_79c41dd49842.slice/crio-2ee7066c2f6266e409432110d9002259d39c8c939402453fef5e45126554ae8f WatchSource:0}: Error finding container 2ee7066c2f6266e409432110d9002259d39c8c939402453fef5e45126554ae8f: Status 404 returned error can't find the container with id 2ee7066c2f6266e409432110d9002259d39c8c939402453fef5e45126554ae8f Jun 02 18:41:53.349504 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:53.349424 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" event={"ID":"4dd1df6e-089d-4cb8-a466-79c41dd49842","Type":"ContainerStarted","Data":"c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca"} Jun 02 18:41:53.349504 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:53.349461 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" event={"ID":"4dd1df6e-089d-4cb8-a466-79c41dd49842","Type":"ContainerStarted","Data":"2ee7066c2f6266e409432110d9002259d39c8c939402453fef5e45126554ae8f"} Jun 02 18:41:53.349722 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:53.349569 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:41:53.367934 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:53.367884 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" podStartSLOduration=17.367867797 podStartE2EDuration="17.367867797s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:41:53.367116839 +0000 UTC m=+126.030954984" watchObservedRunningTime="2026-06-02 18:41:53.367867797 +0000 UTC m=+126.031705938" Jun 02 18:41:57.633106 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:57.633071 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:41:57.635395 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:57.635378 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16f8406c-d799-4759-9860-fd9fb129b8a2-metrics-certs\") pod \"network-metrics-daemon-b9m7z\" (UID: \"16f8406c-d799-4759-9860-fd9fb129b8a2\") " pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:41:57.888197 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:57.888120 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgbvm\"" Jun 02 18:41:57.896010 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:57.895989 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b9m7z" Jun 02 18:41:58.013752 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:58.013719 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b9m7z"] Jun 02 18:41:58.016886 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:41:58.016859 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f8406c_d799_4759_9860_fd9fb129b8a2.slice/crio-eebdfa000d98b8ffe3fd0e094e2f35ad9de73c1c40c5588427dac882ea8b0392 WatchSource:0}: Error finding container eebdfa000d98b8ffe3fd0e094e2f35ad9de73c1c40c5588427dac882ea8b0392: Status 404 returned error can't find the container with id eebdfa000d98b8ffe3fd0e094e2f35ad9de73c1c40c5588427dac882ea8b0392 Jun 02 18:41:58.361498 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:58.361465 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9m7z" event={"ID":"16f8406c-d799-4759-9860-fd9fb129b8a2","Type":"ContainerStarted","Data":"eebdfa000d98b8ffe3fd0e094e2f35ad9de73c1c40c5588427dac882ea8b0392"} Jun 02 18:41:59.365786 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:59.365696 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9m7z" event={"ID":"16f8406c-d799-4759-9860-fd9fb129b8a2","Type":"ContainerStarted","Data":"3062f6c4e6b7a2abf9263777c49bcee06fca11ca1a93e1930ee305bf5184a961"} Jun 02 18:41:59.365786 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:59.365731 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b9m7z" event={"ID":"16f8406c-d799-4759-9860-fd9fb129b8a2","Type":"ContainerStarted","Data":"e841487b3a85591999d40cfb1c5ae0975505659024a17b01eb0d7180300372f2"} Jun 02 18:41:59.380997 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:41:59.380949 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b9m7z" podStartSLOduration=130.330237421 podStartE2EDuration="2m11.380936393s" podCreationTimestamp="2026-06-02 18:39:48 +0000 UTC" firstStartedPulling="2026-06-02 18:41:58.018771295 +0000 UTC m=+130.682609418" lastFinishedPulling="2026-06-02 18:41:59.069470268 +0000 UTC m=+131.733308390" observedRunningTime="2026-06-02 18:41:59.380292272 +0000 UTC m=+132.044130421" watchObservedRunningTime="2026-06-02 18:41:59.380936393 +0000 UTC m=+132.044774535" Jun 02 18:42:07.521930 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.521891 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7566b7bbc6-lhsdh"] Jun 02 18:42:07.629147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.629116 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c8b788444-8qtnf"] Jun 02 18:42:07.631147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.631132 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.641666 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.641638 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-27kp4"] Jun 02 18:42:07.643582 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.643564 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.646340 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.646319 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wpbjj\"" Jun 02 18:42:07.646340 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.646325 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 18:42:07.646641 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.646622 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 18:42:07.646806 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.646786 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c8b788444-8qtnf"] Jun 02 18:42:07.663117 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.663094 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27kp4"] Jun 02 18:42:07.704186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-registry-tls\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.704186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704188 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ee72458-9ab4-43c3-b0be-806ed6a9746a-ca-trust-extracted\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.704387 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ee72458-9ab4-43c3-b0be-806ed6a9746a-installation-pull-secrets\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.704387 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ee72458-9ab4-43c3-b0be-806ed6a9746a-registry-certificates\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.704387 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmw4m\" (UniqueName: \"kubernetes.io/projected/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-kube-api-access-wmw4m\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.704387 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-bound-sa-token\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.704387 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-data-volume\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.704557 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.704557 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ee72458-9ab4-43c3-b0be-806ed6a9746a-trusted-ca\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.704557 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704449 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ee72458-9ab4-43c3-b0be-806ed6a9746a-image-registry-private-configuration\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.704557 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704499 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-crio-socket\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.704557 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfgzc\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-kube-api-access-bfgzc\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.704557 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.704551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.805477 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805383 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-registry-tls\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.805477 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805420 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ee72458-9ab4-43c3-b0be-806ed6a9746a-ca-trust-extracted\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.805477 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805439 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ee72458-9ab4-43c3-b0be-806ed6a9746a-installation-pull-secrets\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.805746 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805571 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ee72458-9ab4-43c3-b0be-806ed6a9746a-registry-certificates\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.805746 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805643 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmw4m\" (UniqueName: \"kubernetes.io/projected/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-kube-api-access-wmw4m\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.805746 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805678 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-bound-sa-token\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.805746 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805711 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-data-volume\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.805974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805739 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.805974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805782 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ee72458-9ab4-43c3-b0be-806ed6a9746a-trusted-ca\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.805974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805810 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ee72458-9ab4-43c3-b0be-806ed6a9746a-image-registry-private-configuration\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.805974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.805874 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ee72458-9ab4-43c3-b0be-806ed6a9746a-ca-trust-extracted\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.806481 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.806197 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-data-volume\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.806481 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.806289 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-crio-socket\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.806481 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.806359 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfgzc\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-kube-api-access-bfgzc\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.806481 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.806430 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.806481 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.806443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-crio-socket\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.806481 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.806475 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ee72458-9ab4-43c3-b0be-806ed6a9746a-registry-certificates\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.806900 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.806804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ee72458-9ab4-43c3-b0be-806ed6a9746a-trusted-ca\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.806960 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.806949 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.808660 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.808636 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.808769 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.808743 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ee72458-9ab4-43c3-b0be-806ed6a9746a-installation-pull-secrets\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.808928 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.808900 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ee72458-9ab4-43c3-b0be-806ed6a9746a-image-registry-private-configuration\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.809130 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.809113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-registry-tls\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.814525 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.814502 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmw4m\" (UniqueName: \"kubernetes.io/projected/1dd7a622-33dd-4597-8e7b-83fdc82c73b1-kube-api-access-wmw4m\") pod \"insights-runtime-extractor-27kp4\" (UID: \"1dd7a622-33dd-4597-8e7b-83fdc82c73b1\") " pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:07.814793 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.814776 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfgzc\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-kube-api-access-bfgzc\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.814868 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.814848 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ee72458-9ab4-43c3-b0be-806ed6a9746a-bound-sa-token\") pod \"image-registry-6c8b788444-8qtnf\" (UID: \"4ee72458-9ab4-43c3-b0be-806ed6a9746a\") " pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.940212 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.940182 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:07.954006 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:07.953978 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27kp4" Jun 02 18:42:08.084685 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:08.084614 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c8b788444-8qtnf"] Jun 02 18:42:08.087806 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:08.087685 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee72458_9ab4_43c3_b0be_806ed6a9746a.slice/crio-b27d146222c639912d3f375c0342dbc473698de2b576fd1ab501c73482707ea2 WatchSource:0}: Error finding container b27d146222c639912d3f375c0342dbc473698de2b576fd1ab501c73482707ea2: Status 404 returned error can't find the container with id b27d146222c639912d3f375c0342dbc473698de2b576fd1ab501c73482707ea2 Jun 02 18:42:08.101266 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:08.101237 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27kp4"] Jun 02 18:42:08.104587 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:08.104564 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd7a622_33dd_4597_8e7b_83fdc82c73b1.slice/crio-430e0fe035f3c5bbc0ba213385dae55254ca3b0402af2b253e97616dcc38f83a WatchSource:0}: Error finding container 430e0fe035f3c5bbc0ba213385dae55254ca3b0402af2b253e97616dcc38f83a: Status 404 returned error can't find the container with id 430e0fe035f3c5bbc0ba213385dae55254ca3b0402af2b253e97616dcc38f83a Jun 02 18:42:08.389515 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:08.389427 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" event={"ID":"4ee72458-9ab4-43c3-b0be-806ed6a9746a","Type":"ContainerStarted","Data":"7ee834851de42e8b3f0ac9cb3b6a6cf082d12ce5a2ab629c01b9eac5a8b4d8b2"} Jun 02 18:42:08.389515 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:08.389471 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" event={"ID":"4ee72458-9ab4-43c3-b0be-806ed6a9746a","Type":"ContainerStarted","Data":"b27d146222c639912d3f375c0342dbc473698de2b576fd1ab501c73482707ea2"} Jun 02 18:42:08.389719 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:08.389656 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:08.390864 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:08.390817 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27kp4" event={"ID":"1dd7a622-33dd-4597-8e7b-83fdc82c73b1","Type":"ContainerStarted","Data":"2e4fbb92ddc4f9e6fd9ec942956810bb1cf3f6decaa9aff5979fc6029d2d5987"} Jun 02 18:42:08.390864 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:08.390865 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27kp4" event={"ID":"1dd7a622-33dd-4597-8e7b-83fdc82c73b1","Type":"ContainerStarted","Data":"430e0fe035f3c5bbc0ba213385dae55254ca3b0402af2b253e97616dcc38f83a"} Jun 02 18:42:08.409576 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:08.409519 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" podStartSLOduration=1.409502305 podStartE2EDuration="1.409502305s" podCreationTimestamp="2026-06-02 18:42:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:42:08.407508063 +0000 UTC m=+141.071346205" watchObservedRunningTime="2026-06-02 18:42:08.409502305 +0000 UTC m=+141.073340449" Jun 02 18:42:09.394552 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:09.394513 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27kp4" event={"ID":"1dd7a622-33dd-4597-8e7b-83fdc82c73b1","Type":"ContainerStarted","Data":"58b4851c8ac714bd2b27a03bf7ce73de356c60279258c33444339fbeebc80e6f"} Jun 02 18:42:11.401468 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:11.401392 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27kp4" event={"ID":"1dd7a622-33dd-4597-8e7b-83fdc82c73b1","Type":"ContainerStarted","Data":"b8ba0018df2283e705c6926ef7590704817ff2573743a24cc45ffbee2090a507"} Jun 02 18:42:11.420937 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:11.420896 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-27kp4" podStartSLOduration=1.499863043 podStartE2EDuration="4.420882867s" podCreationTimestamp="2026-06-02 18:42:07 +0000 UTC" firstStartedPulling="2026-06-02 18:42:08.146360294 +0000 UTC m=+140.810198419" lastFinishedPulling="2026-06-02 18:42:11.067380123 +0000 UTC m=+143.731218243" observedRunningTime="2026-06-02 18:42:11.420164002 +0000 UTC m=+144.084002145" watchObservedRunningTime="2026-06-02 18:42:11.420882867 +0000 UTC m=+144.084721010" Jun 02 18:42:17.527036 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:17.526989 2561 patch_prober.go:28] interesting pod/image-registry-7566b7bbc6-lhsdh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 18:42:17.527493 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:17.527055 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" podUID="4dd1df6e-089d-4cb8-a466-79c41dd49842" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:42:18.538987 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.538955 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-9c8f969cd-7b4hm"] Jun 02 18:42:18.543311 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.543288 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.545589 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.545565 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 18:42:18.546458 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.546432 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 18:42:18.546458 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.546451 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tnkn5\"" Jun 02 18:42:18.546635 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.546598 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 18:42:18.546733 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.546647 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 18:42:18.546733 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.546702 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 18:42:18.546855 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.546745 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 18:42:18.546916 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.546905 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 18:42:18.550210 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.550130 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 18:42:18.552362 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.552342 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c8f969cd-7b4hm"] Jun 02 18:42:18.692037 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.692008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-config\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.692163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.692042 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnk86\" (UniqueName: \"kubernetes.io/projected/e4a0eb1d-78fa-4c34-b289-86d73df3f548-kube-api-access-qnk86\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.692163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.692071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-oauth-config\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.692163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.692148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-oauth-serving-cert\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.692311 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.692202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-trusted-ca-bundle\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.692311 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.692247 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-service-ca\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.692311 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.692267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-serving-cert\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.792796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.792728 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-config\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.792796 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.792777 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnk86\" (UniqueName: \"kubernetes.io/projected/e4a0eb1d-78fa-4c34-b289-86d73df3f548-kube-api-access-qnk86\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.792995 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.792811 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-oauth-config\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.792995 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.792897 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-oauth-serving-cert\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.792995 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.792927 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-trusted-ca-bundle\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.792995 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.792965 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-service-ca\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.792995 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.792992 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-serving-cert\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.793537 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.793514 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-config\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.793692 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.793669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-oauth-serving-cert\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.793996 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.793971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-trusted-ca-bundle\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.794107 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.794084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-service-ca\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.795449 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.795428 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-oauth-config\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.795604 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.795588 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-serving-cert\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.800193 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.800175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnk86\" (UniqueName: \"kubernetes.io/projected/e4a0eb1d-78fa-4c34-b289-86d73df3f548-kube-api-access-qnk86\") pod \"console-9c8f969cd-7b4hm\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.853220 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.853190 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:18.975283 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:18.975252 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c8f969cd-7b4hm"] Jun 02 18:42:18.978363 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:18.978332 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a0eb1d_78fa_4c34_b289_86d73df3f548.slice/crio-7071930f11f1d95fa97aac93ab1a12af43b492d5f638306d18b76c567dae60b7 WatchSource:0}: Error finding container 7071930f11f1d95fa97aac93ab1a12af43b492d5f638306d18b76c567dae60b7: Status 404 returned error can't find the container with id 7071930f11f1d95fa97aac93ab1a12af43b492d5f638306d18b76c567dae60b7 Jun 02 18:42:19.422901 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:19.422869 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c8f969cd-7b4hm" event={"ID":"e4a0eb1d-78fa-4c34-b289-86d73df3f548","Type":"ContainerStarted","Data":"7071930f11f1d95fa97aac93ab1a12af43b492d5f638306d18b76c567dae60b7"} Jun 02 18:42:20.652671 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.652637 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rd29n"] Jun 02 18:42:20.656294 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.656271 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.659349 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.659325 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 18:42:20.659491 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.659472 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 18:42:20.660326 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.660301 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 18:42:20.660540 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.660517 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-68kzm\"" Jun 02 18:42:20.660955 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.660616 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 18:42:20.660955 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.660745 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 18:42:20.660955 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.660808 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 18:42:20.808297 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-tls\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.808470 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c0070db-1f73-489b-8006-77143b9144c4-metrics-client-ca\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.808470 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-sys\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.808470 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.808470 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-textfile\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.808470 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808468 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.808741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808507 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-root\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.808741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtsrg\" (UniqueName: \"kubernetes.io/projected/5c0070db-1f73-489b-8006-77143b9144c4-kube-api-access-rtsrg\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.808741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.808564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-wtmp\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909170 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909098 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-tls\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909170 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909135 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c0070db-1f73-489b-8006-77143b9144c4-metrics-client-ca\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909379 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909192 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-sys\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909379 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909219 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909379 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909267 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-textfile\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909379 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909300 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909379 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909340 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-root\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909379 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909368 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rtsrg\" (UniqueName: \"kubernetes.io/projected/5c0070db-1f73-489b-8006-77143b9144c4-kube-api-access-rtsrg\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909659 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909395 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-wtmp\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909659 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909543 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-wtmp\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909659 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-root\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.909946 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.909884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c0070db-1f73-489b-8006-77143b9144c4-sys\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.910107 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.910083 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c0070db-1f73-489b-8006-77143b9144c4-metrics-client-ca\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.910179 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.910083 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.910179 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.910143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-textfile\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.912103 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.912079 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.912909 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.912886 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5c0070db-1f73-489b-8006-77143b9144c4-node-exporter-tls\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.917749 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.917723 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtsrg\" (UniqueName: \"kubernetes.io/projected/5c0070db-1f73-489b-8006-77143b9144c4-kube-api-access-rtsrg\") pod \"node-exporter-rd29n\" (UID: \"5c0070db-1f73-489b-8006-77143b9144c4\") " pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.968763 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:20.968737 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rd29n" Jun 02 18:42:20.977739 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:20.977705 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0070db_1f73_489b_8006_77143b9144c4.slice/crio-cfacf6706d7a62a94b511e16d099733997a5fc74c504679033d13ff0e46594af WatchSource:0}: Error finding container cfacf6706d7a62a94b511e16d099733997a5fc74c504679033d13ff0e46594af: Status 404 returned error can't find the container with id cfacf6706d7a62a94b511e16d099733997a5fc74c504679033d13ff0e46594af Jun 02 18:42:21.430231 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.430176 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rd29n" event={"ID":"5c0070db-1f73-489b-8006-77143b9144c4","Type":"ContainerStarted","Data":"cfacf6706d7a62a94b511e16d099733997a5fc74c504679033d13ff0e46594af"} Jun 02 18:42:21.676683 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.676649 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 18:42:21.682150 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.682094 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.684932 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.684908 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 18:42:21.685021 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.684962 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 18:42:21.685281 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.685192 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 18:42:21.685390 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.685279 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zmj26\"" Jun 02 18:42:21.685390 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.685366 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 18:42:21.685569 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.685554 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 18:42:21.685644 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.685603 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 18:42:21.685703 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.685554 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 18:42:21.685861 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.685819 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 18:42:21.685940 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.685879 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 18:42:21.692505 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.692479 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 18:42:21.816123 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnwzt\" (UniqueName: \"kubernetes.io/projected/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-kube-api-access-jnwzt\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816539 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-web-config\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816646 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816692 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-config-out\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.816951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.816755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917175 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917147 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-config-out\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917345 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917187 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917345 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917218 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917345 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917278 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917345 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917313 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917345 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917339 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnwzt\" (UniqueName: \"kubernetes.io/projected/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-kube-api-access-jnwzt\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917611 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:42:21.917380 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 18:42:21.917611 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:42:21.917457 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-main-tls podName:a045aca0-8bd5-46c9-8d8e-24af5aefd2e1 nodeName:}" failed. No retries permitted until 2026-06-02 18:42:22.417435579 +0000 UTC m=+155.081273717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a045aca0-8bd5-46c9-8d8e-24af5aefd2e1") : secret "alertmanager-main-tls" not found Jun 02 18:42:21.917741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917606 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917660 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917686 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917734 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917960 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917759 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917960 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917813 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-web-config\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.917960 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.917858 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.918275 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.918243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.919102 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.919074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.919867 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.919822 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.920755 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.920712 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.921101 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.920925 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-config-out\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.921591 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.921551 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.922259 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.922024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-config-volume\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.922259 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.922146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.922418 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.922258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.922931 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.922909 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.924256 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.924220 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-web-config\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:21.925561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:21.925539 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnwzt\" (UniqueName: \"kubernetes.io/projected/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-kube-api-access-jnwzt\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:22.423305 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:22.423274 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:22.426307 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:22.426269 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a045aca0-8bd5-46c9-8d8e-24af5aefd2e1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:22.435154 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:22.435118 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c8f969cd-7b4hm" event={"ID":"e4a0eb1d-78fa-4c34-b289-86d73df3f548","Type":"ContainerStarted","Data":"4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2"} Jun 02 18:42:22.450256 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:22.450066 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-9c8f969cd-7b4hm" podStartSLOduration=1.218758869 podStartE2EDuration="4.450051939s" podCreationTimestamp="2026-06-02 18:42:18 +0000 UTC" firstStartedPulling="2026-06-02 18:42:18.980355557 +0000 UTC m=+151.644193691" lastFinishedPulling="2026-06-02 18:42:22.211648638 +0000 UTC m=+154.875486761" observedRunningTime="2026-06-02 18:42:22.449626983 +0000 UTC m=+155.113465125" watchObservedRunningTime="2026-06-02 18:42:22.450051939 +0000 UTC m=+155.113890082" Jun 02 18:42:22.596060 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:22.595963 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 18:42:22.781595 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:22.781560 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 18:42:22.785151 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:22.785111 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda045aca0_8bd5_46c9_8d8e_24af5aefd2e1.slice/crio-c07a628848900f76c3c675bdf62c59e6826c3bea300a0de22d395339abf73c89 WatchSource:0}: Error finding container c07a628848900f76c3c675bdf62c59e6826c3bea300a0de22d395339abf73c89: Status 404 returned error can't find the container with id c07a628848900f76c3c675bdf62c59e6826c3bea300a0de22d395339abf73c89 Jun 02 18:42:23.439576 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:23.439541 2561 generic.go:358] "Generic (PLEG): container finished" podID="5c0070db-1f73-489b-8006-77143b9144c4" containerID="d14abd21171b8c85323d36f26e7ace9dc7233c2c556e1a35453b4e761a1aee78" exitCode=0 Jun 02 18:42:23.439759 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:23.439621 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rd29n" event={"ID":"5c0070db-1f73-489b-8006-77143b9144c4","Type":"ContainerDied","Data":"d14abd21171b8c85323d36f26e7ace9dc7233c2c556e1a35453b4e761a1aee78"} Jun 02 18:42:23.440897 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:23.440862 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1","Type":"ContainerStarted","Data":"c07a628848900f76c3c675bdf62c59e6826c3bea300a0de22d395339abf73c89"} Jun 02 18:42:24.446232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:24.446132 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rd29n" event={"ID":"5c0070db-1f73-489b-8006-77143b9144c4","Type":"ContainerStarted","Data":"14d878588227b57272a8a36e2719a300536445ca74dfd9edb90f5086d1bb10d9"} Jun 02 18:42:24.446232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:24.446188 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rd29n" event={"ID":"5c0070db-1f73-489b-8006-77143b9144c4","Type":"ContainerStarted","Data":"0fe7bddf0bc519d691eb3ab6d6178418a686c3a7c61c36d688627c0ead0b019c"} Jun 02 18:42:24.449095 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:24.449068 2561 generic.go:358] "Generic (PLEG): container finished" podID="a045aca0-8bd5-46c9-8d8e-24af5aefd2e1" containerID="10fd0272d79cade7e3d1374ff8943175d6de2fc9a38e9c26aa426dd425c3a77f" exitCode=0 Jun 02 18:42:24.449235 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:24.449129 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1","Type":"ContainerDied","Data":"10fd0272d79cade7e3d1374ff8943175d6de2fc9a38e9c26aa426dd425c3a77f"} Jun 02 18:42:24.466496 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:24.466455 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rd29n" podStartSLOduration=2.781991427 podStartE2EDuration="4.46644299s" podCreationTimestamp="2026-06-02 18:42:20 +0000 UTC" firstStartedPulling="2026-06-02 18:42:20.980240762 +0000 UTC m=+153.644078884" lastFinishedPulling="2026-06-02 18:42:22.664692323 +0000 UTC m=+155.328530447" observedRunningTime="2026-06-02 18:42:24.465100358 +0000 UTC m=+157.128938499" watchObservedRunningTime="2026-06-02 18:42:24.46644299 +0000 UTC m=+157.130281131" Jun 02 18:42:24.760008 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:42:24.759962 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9tvm7" podUID="a7123799-65fa-4a33-84fe-d00ff80098d9" Jun 02 18:42:24.775072 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:42:24.775023 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-rlbvb" podUID="55d18e74-ad37-4eae-ade7-44fc72b9c248" Jun 02 18:42:25.447437 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.447405 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8"] Jun 02 18:42:25.450931 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.450906 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" Jun 02 18:42:25.452168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.452088 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9tvm7" Jun 02 18:42:25.453119 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.453097 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 18:42:25.453232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.453160 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-56vw5\"" Jun 02 18:42:25.458069 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.458012 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8"] Jun 02 18:42:25.555414 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.555388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33869f3a-4048-490c-a289-51f29f69080e-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-x2cf8\" (UID: \"33869f3a-4048-490c-a289-51f29f69080e\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" Jun 02 18:42:25.656906 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.656864 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33869f3a-4048-490c-a289-51f29f69080e-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-x2cf8\" (UID: \"33869f3a-4048-490c-a289-51f29f69080e\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" Jun 02 18:42:25.659698 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.659670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33869f3a-4048-490c-a289-51f29f69080e-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-x2cf8\" (UID: \"33869f3a-4048-490c-a289-51f29f69080e\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" Jun 02 18:42:25.763286 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.763254 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" Jun 02 18:42:25.845091 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.845057 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6bbf556589-hp8tt"] Jun 02 18:42:25.851635 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.851601 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:25.853811 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.853784 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 18:42:25.854058 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.854001 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 18:42:25.854141 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.854076 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 18:42:25.854456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.854430 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-7ldd4\"" Jun 02 18:42:25.854566 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.854440 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 18:42:25.854624 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.854600 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 18:42:25.857324 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.857302 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bbf556589-hp8tt"] Jun 02 18:42:25.860509 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.860485 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 18:42:25.960513 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.960481 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-telemeter-client-tls\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:25.960643 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.960574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s5lj\" (UniqueName: \"kubernetes.io/projected/1e2f795a-7fb8-46e6-a941-af9b522af0db-kube-api-access-4s5lj\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:25.960643 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.960628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:25.960774 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.960751 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-secret-telemeter-client\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:25.960823 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.960791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-federate-client-tls\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:25.960886 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.960863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-metrics-client-ca\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:25.960925 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.960916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:25.960968 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:25.960947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-serving-certs-ca-bundle\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.062004 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.061975 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s5lj\" (UniqueName: \"kubernetes.io/projected/1e2f795a-7fb8-46e6-a941-af9b522af0db-kube-api-access-4s5lj\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.062144 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.062031 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.062144 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.062100 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-secret-telemeter-client\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.062144 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.062125 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-federate-client-tls\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.062277 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.062175 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-metrics-client-ca\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.062277 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.062235 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.062277 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.062265 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-serving-certs-ca-bundle\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.062411 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.062311 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-telemeter-client-tls\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.063120 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.062993 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.063561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.063527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-serving-certs-ca-bundle\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.064302 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.064059 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e2f795a-7fb8-46e6-a941-af9b522af0db-metrics-client-ca\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.065726 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.065699 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.066027 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.066005 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-secret-telemeter-client\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.066192 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.066169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-federate-client-tls\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.066276 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.066258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1e2f795a-7fb8-46e6-a941-af9b522af0db-telemeter-client-tls\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.070775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.070747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s5lj\" (UniqueName: \"kubernetes.io/projected/1e2f795a-7fb8-46e6-a941-af9b522af0db-kube-api-access-4s5lj\") pod \"telemeter-client-6bbf556589-hp8tt\" (UID: \"1e2f795a-7fb8-46e6-a941-af9b522af0db\") " pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.082360 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.082331 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8"] Jun 02 18:42:26.085328 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:26.085302 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33869f3a_4048_490c_a289_51f29f69080e.slice/crio-e62a847c65bdb41364844fe4d5fab629b5a21851a57f1b132f407b7af0874450 WatchSource:0}: Error finding container e62a847c65bdb41364844fe4d5fab629b5a21851a57f1b132f407b7af0874450: Status 404 returned error can't find the container with id e62a847c65bdb41364844fe4d5fab629b5a21851a57f1b132f407b7af0874450 Jun 02 18:42:26.164921 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.164895 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" Jun 02 18:42:26.307608 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.307577 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bbf556589-hp8tt"] Jun 02 18:42:26.311039 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:26.311011 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2f795a_7fb8_46e6_a941_af9b522af0db.slice/crio-f821196c7a025cc3c789ca353b4c89b41b4a3c5f4a9f173aa8d984f8acfb6508 WatchSource:0}: Error finding container f821196c7a025cc3c789ca353b4c89b41b4a3c5f4a9f173aa8d984f8acfb6508: Status 404 returned error can't find the container with id f821196c7a025cc3c789ca353b4c89b41b4a3c5f4a9f173aa8d984f8acfb6508 Jun 02 18:42:26.456916 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.456880 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" event={"ID":"33869f3a-4048-490c-a289-51f29f69080e","Type":"ContainerStarted","Data":"e62a847c65bdb41364844fe4d5fab629b5a21851a57f1b132f407b7af0874450"} Jun 02 18:42:26.459733 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.459709 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1","Type":"ContainerStarted","Data":"3f65b8c71e0f6d18e292865422565572d73c6e2671f663f49fcabcd05928e176"} Jun 02 18:42:26.459891 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.459741 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1","Type":"ContainerStarted","Data":"3a504ba4a90faccaae9ba9f37d084d877801bf7778f39c407ba58e2cecff9154"} Jun 02 18:42:26.459891 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.459757 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1","Type":"ContainerStarted","Data":"b3243f246e2ce1937ea076e24790e958592fd3b4b97725f430bb5b121e13b507"} Jun 02 18:42:26.459891 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.459770 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1","Type":"ContainerStarted","Data":"5bdcfcaf40dbf7d9ef22f40821a634776c5093a910a24968f04ec8df800939ba"} Jun 02 18:42:26.459891 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.459781 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1","Type":"ContainerStarted","Data":"89a6b9bfec170e6433150ee7e1bd5eaffb6e18c0e30bfb95c01cefafc5e3603b"} Jun 02 18:42:26.460589 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:26.460569 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" event={"ID":"1e2f795a-7fb8-46e6-a941-af9b522af0db","Type":"ContainerStarted","Data":"f821196c7a025cc3c789ca353b4c89b41b4a3c5f4a9f173aa8d984f8acfb6508"} Jun 02 18:42:27.527509 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:27.527460 2561 patch_prober.go:28] interesting pod/image-registry-7566b7bbc6-lhsdh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 18:42:27.527926 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:27.527525 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" podUID="4dd1df6e-089d-4cb8-a466-79c41dd49842" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:42:27.944907 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:27.944808 2561 patch_prober.go:28] interesting pod/image-registry-6c8b788444-8qtnf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 18:42:27.944907 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:27.944887 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" podUID="4ee72458-9ab4-43c3-b0be-806ed6a9746a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:42:28.470794 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.470753 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a045aca0-8bd5-46c9-8d8e-24af5aefd2e1","Type":"ContainerStarted","Data":"20425a9c78df09401db855fa062021464a4ccd61742f4fad4f9270d6b71ed2f1"} Jun 02 18:42:28.472242 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.472214 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" event={"ID":"33869f3a-4048-490c-a289-51f29f69080e","Type":"ContainerStarted","Data":"81fd53801975b5b2b80bdc587912e11adc26904abac159c672d96e8e99a3f1ca"} Jun 02 18:42:28.472438 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.472414 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" Jun 02 18:42:28.477896 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.477874 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" Jun 02 18:42:28.503332 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.502979 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.742624899 podStartE2EDuration="7.502959669s" podCreationTimestamp="2026-06-02 18:42:21 +0000 UTC" firstStartedPulling="2026-06-02 18:42:22.787267974 +0000 UTC m=+155.451106095" lastFinishedPulling="2026-06-02 18:42:27.547602739 +0000 UTC m=+160.211440865" observedRunningTime="2026-06-02 18:42:28.500281999 +0000 UTC m=+161.164120147" watchObservedRunningTime="2026-06-02 18:42:28.502959669 +0000 UTC m=+161.166797812" Jun 02 18:42:28.518435 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.518389 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-x2cf8" podStartSLOduration=2.055196511 podStartE2EDuration="3.51837426s" podCreationTimestamp="2026-06-02 18:42:25 +0000 UTC" firstStartedPulling="2026-06-02 18:42:26.087377046 +0000 UTC m=+158.751215179" lastFinishedPulling="2026-06-02 18:42:27.550554796 +0000 UTC m=+160.214392928" observedRunningTime="2026-06-02 18:42:28.516850326 +0000 UTC m=+161.180688470" watchObservedRunningTime="2026-06-02 18:42:28.51837426 +0000 UTC m=+161.182212437" Jun 02 18:42:28.853998 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.853975 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:28.854302 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.854015 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:28.855378 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.855359 2561 patch_prober.go:28] interesting pod/console-9c8f969cd-7b4hm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 02 18:42:28.855450 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:28.855404 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9c8f969cd-7b4hm" podUID="e4a0eb1d-78fa-4c34-b289-86d73df3f548" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 02 18:42:29.400304 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.400017 2561 patch_prober.go:28] interesting pod/image-registry-6c8b788444-8qtnf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 18:42:29.400304 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.400097 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" podUID="4ee72458-9ab4-43c3-b0be-806ed6a9746a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:42:29.477342 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.477310 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" event={"ID":"1e2f795a-7fb8-46e6-a941-af9b522af0db","Type":"ContainerStarted","Data":"7e7f08d8ae16ce28f70980d0612559ad3fdf7bb74c7efb38be4dad6f99376e32"} Jun 02 18:42:29.477484 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.477352 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" event={"ID":"1e2f795a-7fb8-46e6-a941-af9b522af0db","Type":"ContainerStarted","Data":"f869395600a7c5534a7bd670537de983801a44751a6bd1d4a070671ca65a3f16"} Jun 02 18:42:29.477484 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.477365 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" event={"ID":"1e2f795a-7fb8-46e6-a941-af9b522af0db","Type":"ContainerStarted","Data":"03fd0a2ea5e53ed37a402c33a4d5467187814d788b665560e3c21cbf849657b8"} Jun 02 18:42:29.501993 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.501940 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6bbf556589-hp8tt" podStartSLOduration=2.005430412 podStartE2EDuration="4.501920083s" podCreationTimestamp="2026-06-02 18:42:25 +0000 UTC" firstStartedPulling="2026-06-02 18:42:26.31379221 +0000 UTC m=+158.977630343" lastFinishedPulling="2026-06-02 18:42:28.810281886 +0000 UTC m=+161.474120014" observedRunningTime="2026-06-02 18:42:29.500864261 +0000 UTC m=+162.164702397" watchObservedRunningTime="2026-06-02 18:42:29.501920083 +0000 UTC m=+162.165758226" Jun 02 18:42:29.605327 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.605286 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9c8f969cd-7b4hm"] Jun 02 18:42:29.699813 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.699710 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:42:29.699813 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.699768 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:42:29.702325 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.702300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7123799-65fa-4a33-84fe-d00ff80098d9-metrics-tls\") pod \"dns-default-9tvm7\" (UID: \"a7123799-65fa-4a33-84fe-d00ff80098d9\") " pod="openshift-dns/dns-default-9tvm7" Jun 02 18:42:29.702393 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.702323 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55d18e74-ad37-4eae-ade7-44fc72b9c248-cert\") pod \"ingress-canary-rlbvb\" (UID: \"55d18e74-ad37-4eae-ade7-44fc72b9c248\") " pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:42:29.955759 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.955682 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h76xf\"" Jun 02 18:42:29.963699 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:29.963683 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9tvm7" Jun 02 18:42:30.093956 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:30.093929 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9tvm7"] Jun 02 18:42:30.096256 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:30.096227 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7123799_65fa_4a33_84fe_d00ff80098d9.slice/crio-6d7d2c49e8a76386085c040f0cc5b130758cc444726f449989ea23b96ecfdf72 WatchSource:0}: Error finding container 6d7d2c49e8a76386085c040f0cc5b130758cc444726f449989ea23b96ecfdf72: Status 404 returned error can't find the container with id 6d7d2c49e8a76386085c040f0cc5b130758cc444726f449989ea23b96ecfdf72 Jun 02 18:42:30.482317 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:30.482274 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9tvm7" event={"ID":"a7123799-65fa-4a33-84fe-d00ff80098d9","Type":"ContainerStarted","Data":"6d7d2c49e8a76386085c040f0cc5b130758cc444726f449989ea23b96ecfdf72"} Jun 02 18:42:31.486486 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:31.486458 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9tvm7" event={"ID":"a7123799-65fa-4a33-84fe-d00ff80098d9","Type":"ContainerStarted","Data":"8cef137d548837357ec97fa9fdc009836ffbcdf84111087d64d4fcce231fce82"} Jun 02 18:42:31.486855 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:31.486493 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9tvm7" event={"ID":"a7123799-65fa-4a33-84fe-d00ff80098d9","Type":"ContainerStarted","Data":"bebd62091bebd3dd497bdf9fe88176b599ad2cce5ccce0ebb13625782301313a"} Jun 02 18:42:31.486855 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:31.486596 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9tvm7" Jun 02 18:42:31.501964 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:31.501923 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9tvm7" podStartSLOduration=129.297572746 podStartE2EDuration="2m10.501908993s" podCreationTimestamp="2026-06-02 18:40:21 +0000 UTC" firstStartedPulling="2026-06-02 18:42:30.098040254 +0000 UTC m=+162.761878374" lastFinishedPulling="2026-06-02 18:42:31.302376502 +0000 UTC m=+163.966214621" observedRunningTime="2026-06-02 18:42:31.500757933 +0000 UTC m=+164.164596076" watchObservedRunningTime="2026-06-02 18:42:31.501908993 +0000 UTC m=+164.165747134" Jun 02 18:42:32.543058 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.542999 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" podUID="4dd1df6e-089d-4cb8-a466-79c41dd49842" containerName="registry" containerID="cri-o://c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca" gracePeriod=30 Jun 02 18:42:32.801664 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.801618 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:42:32.930022 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.929994 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-certificates\") pod \"4dd1df6e-089d-4cb8-a466-79c41dd49842\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " Jun 02 18:42:32.930168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930029 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-image-registry-private-configuration\") pod \"4dd1df6e-089d-4cb8-a466-79c41dd49842\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " Jun 02 18:42:32.930168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930052 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-bound-sa-token\") pod \"4dd1df6e-089d-4cb8-a466-79c41dd49842\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " Jun 02 18:42:32.930168 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930078 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-trusted-ca\") pod \"4dd1df6e-089d-4cb8-a466-79c41dd49842\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " Jun 02 18:42:32.930316 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930212 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrlwj\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-kube-api-access-hrlwj\") pod \"4dd1df6e-089d-4cb8-a466-79c41dd49842\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " Jun 02 18:42:32.930316 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930264 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") pod \"4dd1df6e-089d-4cb8-a466-79c41dd49842\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " Jun 02 18:42:32.930316 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930297 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dd1df6e-089d-4cb8-a466-79c41dd49842-ca-trust-extracted\") pod \"4dd1df6e-089d-4cb8-a466-79c41dd49842\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " Jun 02 18:42:32.930454 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930325 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-installation-pull-secrets\") pod \"4dd1df6e-089d-4cb8-a466-79c41dd49842\" (UID: \"4dd1df6e-089d-4cb8-a466-79c41dd49842\") " Jun 02 18:42:32.930593 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930557 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4dd1df6e-089d-4cb8-a466-79c41dd49842" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:32.930593 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930464 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4dd1df6e-089d-4cb8-a466-79c41dd49842" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:32.930766 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.930634 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-trusted-ca\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:32.932586 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.932553 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4dd1df6e-089d-4cb8-a466-79c41dd49842" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:42:32.932694 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.932596 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4dd1df6e-089d-4cb8-a466-79c41dd49842" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:42:32.932755 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.932708 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-kube-api-access-hrlwj" (OuterVolumeSpecName: "kube-api-access-hrlwj") pod "4dd1df6e-089d-4cb8-a466-79c41dd49842" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842"). InnerVolumeSpecName "kube-api-access-hrlwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:42:32.932889 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.932864 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4dd1df6e-089d-4cb8-a466-79c41dd49842" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:42:32.933770 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.933747 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4dd1df6e-089d-4cb8-a466-79c41dd49842" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:42:32.939116 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:32.939094 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dd1df6e-089d-4cb8-a466-79c41dd49842-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4dd1df6e-089d-4cb8-a466-79c41dd49842" (UID: "4dd1df6e-089d-4cb8-a466-79c41dd49842"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:42:33.031739 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.031708 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-certificates\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:33.031739 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.031738 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-image-registry-private-configuration\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:33.031905 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.031754 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-bound-sa-token\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:33.031905 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.031767 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrlwj\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-kube-api-access-hrlwj\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:33.031905 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.031780 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4dd1df6e-089d-4cb8-a466-79c41dd49842-registry-tls\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:33.031905 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.031792 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4dd1df6e-089d-4cb8-a466-79c41dd49842-ca-trust-extracted\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:33.031905 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.031804 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4dd1df6e-089d-4cb8-a466-79c41dd49842-installation-pull-secrets\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:33.493042 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.493004 2561 generic.go:358] "Generic (PLEG): container finished" podID="4dd1df6e-089d-4cb8-a466-79c41dd49842" containerID="c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca" exitCode=0 Jun 02 18:42:33.493206 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.493066 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" Jun 02 18:42:33.493206 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.493091 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" event={"ID":"4dd1df6e-089d-4cb8-a466-79c41dd49842","Type":"ContainerDied","Data":"c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca"} Jun 02 18:42:33.493206 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.493130 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7566b7bbc6-lhsdh" event={"ID":"4dd1df6e-089d-4cb8-a466-79c41dd49842","Type":"ContainerDied","Data":"2ee7066c2f6266e409432110d9002259d39c8c939402453fef5e45126554ae8f"} Jun 02 18:42:33.493206 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.493145 2561 scope.go:117] "RemoveContainer" containerID="c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca" Jun 02 18:42:33.501658 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.501643 2561 scope.go:117] "RemoveContainer" containerID="c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca" Jun 02 18:42:33.501966 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:42:33.501948 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca\": container with ID starting with c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca not found: ID does not exist" containerID="c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca" Jun 02 18:42:33.502048 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.501972 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca"} err="failed to get container status \"c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca\": rpc error: code = NotFound desc = could not find container \"c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca\": container with ID starting with c9620bb1bc42aaf511bb80ebab60f49f78e32aaef8829c59fd91d5a516d0acca not found: ID does not exist" Jun 02 18:42:33.513256 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.513235 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7566b7bbc6-lhsdh"] Jun 02 18:42:33.519203 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.519186 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7566b7bbc6-lhsdh"] Jun 02 18:42:33.874311 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:33.874238 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dd1df6e-089d-4cb8-a466-79c41dd49842" path="/var/lib/kubelet/pods/4dd1df6e-089d-4cb8-a466-79c41dd49842/volumes" Jun 02 18:42:36.870347 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:36.870265 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:42:36.873685 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:36.873664 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vdj79\"" Jun 02 18:42:36.880674 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:36.880653 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rlbvb" Jun 02 18:42:37.007128 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:37.007086 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rlbvb"] Jun 02 18:42:37.010205 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:42:37.010177 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55d18e74_ad37_4eae_ade7_44fc72b9c248.slice/crio-873f971fc6d5ffff173ae09cac0f9122784f09577810b1e07b1e464a3d5af2ca WatchSource:0}: Error finding container 873f971fc6d5ffff173ae09cac0f9122784f09577810b1e07b1e464a3d5af2ca: Status 404 returned error can't find the container with id 873f971fc6d5ffff173ae09cac0f9122784f09577810b1e07b1e464a3d5af2ca Jun 02 18:42:37.509741 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:37.509702 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rlbvb" event={"ID":"55d18e74-ad37-4eae-ade7-44fc72b9c248","Type":"ContainerStarted","Data":"873f971fc6d5ffff173ae09cac0f9122784f09577810b1e07b1e464a3d5af2ca"} Jun 02 18:42:37.945600 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:37.945516 2561 patch_prober.go:28] interesting pod/image-registry-6c8b788444-8qtnf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 18:42:37.945600 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:37.945580 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" podUID="4ee72458-9ab4-43c3-b0be-806ed6a9746a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:42:39.399159 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:39.399122 2561 patch_prober.go:28] interesting pod/image-registry-6c8b788444-8qtnf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 18:42:39.399578 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:39.399179 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" podUID="4ee72458-9ab4-43c3-b0be-806ed6a9746a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:42:39.516350 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:39.516316 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rlbvb" event={"ID":"55d18e74-ad37-4eae-ade7-44fc72b9c248","Type":"ContainerStarted","Data":"4e1653d715a08c32a642b9326d6c8db2f49576f859a20e642b24e96894d43b5c"} Jun 02 18:42:39.532032 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:39.531991 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rlbvb" podStartSLOduration=137.016201944 podStartE2EDuration="2m18.531977911s" podCreationTimestamp="2026-06-02 18:40:21 +0000 UTC" firstStartedPulling="2026-06-02 18:42:37.012596887 +0000 UTC m=+169.676435007" lastFinishedPulling="2026-06-02 18:42:38.52837285 +0000 UTC m=+171.192210974" observedRunningTime="2026-06-02 18:42:39.53097776 +0000 UTC m=+172.194815902" watchObservedRunningTime="2026-06-02 18:42:39.531977911 +0000 UTC m=+172.195816052" Jun 02 18:42:41.491695 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:41.491664 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9tvm7" Jun 02 18:42:46.536312 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:46.536254 2561 generic.go:358] "Generic (PLEG): container finished" podID="db80cc7f-a28e-470f-8de1-0d87fdc5f062" containerID="1af631208e744d9babf85acd004d96fa1b16a37848d5e5d2559c7a31ab8ceee5" exitCode=0 Jun 02 18:42:46.536701 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:46.536328 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" event={"ID":"db80cc7f-a28e-470f-8de1-0d87fdc5f062","Type":"ContainerDied","Data":"1af631208e744d9babf85acd004d96fa1b16a37848d5e5d2559c7a31ab8ceee5"} Jun 02 18:42:46.536701 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:46.536688 2561 scope.go:117] "RemoveContainer" containerID="1af631208e744d9babf85acd004d96fa1b16a37848d5e5d2559c7a31ab8ceee5" Jun 02 18:42:47.540566 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:47.540533 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fxd84" event={"ID":"db80cc7f-a28e-470f-8de1-0d87fdc5f062","Type":"ContainerStarted","Data":"3f6b34c50d079894b7d9178a026494aca4134a2dc1c1fa7ad60674c87008efc3"} Jun 02 18:42:47.944152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:47.944070 2561 patch_prober.go:28] interesting pod/image-registry-6c8b788444-8qtnf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 18:42:47.944152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:47.944130 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" podUID="4ee72458-9ab4-43c3-b0be-806ed6a9746a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:42:47.944333 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:47.944173 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:42:47.944699 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:47.944676 2561 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"7ee834851de42e8b3f0ac9cb3b6a6cf082d12ce5a2ab629c01b9eac5a8b4d8b2"} pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" containerMessage="Container registry failed liveness probe, will be restarted" Jun 02 18:42:47.948176 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:47.948045 2561 patch_prober.go:28] interesting pod/image-registry-6c8b788444-8qtnf container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 18:42:47.948270 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:47.948230 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" podUID="4ee72458-9ab4-43c3-b0be-806ed6a9746a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:42:54.627613 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.627546 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-9c8f969cd-7b4hm" podUID="e4a0eb1d-78fa-4c34-b289-86d73df3f548" containerName="console" containerID="cri-o://4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2" gracePeriod=15 Jun 02 18:42:54.871708 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.871685 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9c8f969cd-7b4hm_e4a0eb1d-78fa-4c34-b289-86d73df3f548/console/0.log" Jun 02 18:42:54.871818 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.871759 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:54.889545 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.889480 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-config\") pod \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " Jun 02 18:42:54.889545 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.889526 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-service-ca\") pod \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " Jun 02 18:42:54.889706 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.889559 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-serving-cert\") pod \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " Jun 02 18:42:54.889706 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.889596 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-oauth-config\") pod \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " Jun 02 18:42:54.889706 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.889652 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-trusted-ca-bundle\") pod \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " Jun 02 18:42:54.889706 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.889690 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnk86\" (UniqueName: \"kubernetes.io/projected/e4a0eb1d-78fa-4c34-b289-86d73df3f548-kube-api-access-qnk86\") pod \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " Jun 02 18:42:54.889919 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.889721 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-oauth-serving-cert\") pod \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\" (UID: \"e4a0eb1d-78fa-4c34-b289-86d73df3f548\") " Jun 02 18:42:54.890324 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.890184 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4a0eb1d-78fa-4c34-b289-86d73df3f548" (UID: "e4a0eb1d-78fa-4c34-b289-86d73df3f548"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:54.890324 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.890297 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4a0eb1d-78fa-4c34-b289-86d73df3f548" (UID: "e4a0eb1d-78fa-4c34-b289-86d73df3f548"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:54.890536 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.890512 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e4a0eb1d-78fa-4c34-b289-86d73df3f548" (UID: "e4a0eb1d-78fa-4c34-b289-86d73df3f548"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:54.890603 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.890588 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-config" (OuterVolumeSpecName: "console-config") pod "e4a0eb1d-78fa-4c34-b289-86d73df3f548" (UID: "e4a0eb1d-78fa-4c34-b289-86d73df3f548"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:42:54.892686 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.892660 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4a0eb1d-78fa-4c34-b289-86d73df3f548" (UID: "e4a0eb1d-78fa-4c34-b289-86d73df3f548"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:42:54.892795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.892735 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a0eb1d-78fa-4c34-b289-86d73df3f548-kube-api-access-qnk86" (OuterVolumeSpecName: "kube-api-access-qnk86") pod "e4a0eb1d-78fa-4c34-b289-86d73df3f548" (UID: "e4a0eb1d-78fa-4c34-b289-86d73df3f548"). InnerVolumeSpecName "kube-api-access-qnk86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:42:54.892795 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.892766 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4a0eb1d-78fa-4c34-b289-86d73df3f548" (UID: "e4a0eb1d-78fa-4c34-b289-86d73df3f548"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:42:54.990462 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.990429 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-trusted-ca-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:54.990462 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.990458 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnk86\" (UniqueName: \"kubernetes.io/projected/e4a0eb1d-78fa-4c34-b289-86d73df3f548-kube-api-access-qnk86\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:54.990462 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.990469 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-oauth-serving-cert\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:54.990664 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.990479 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-config\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:54.990664 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.990487 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4a0eb1d-78fa-4c34-b289-86d73df3f548-service-ca\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:54.990664 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.990496 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-serving-cert\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:54.990664 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:54.990504 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4a0eb1d-78fa-4c34-b289-86d73df3f548-console-oauth-config\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:42:55.562899 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.562869 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9c8f969cd-7b4hm_e4a0eb1d-78fa-4c34-b289-86d73df3f548/console/0.log" Jun 02 18:42:55.563067 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.562906 2561 generic.go:358] "Generic (PLEG): container finished" podID="e4a0eb1d-78fa-4c34-b289-86d73df3f548" containerID="4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2" exitCode=2 Jun 02 18:42:55.563067 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.562938 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c8f969cd-7b4hm" event={"ID":"e4a0eb1d-78fa-4c34-b289-86d73df3f548","Type":"ContainerDied","Data":"4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2"} Jun 02 18:42:55.563067 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.562978 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c8f969cd-7b4hm" event={"ID":"e4a0eb1d-78fa-4c34-b289-86d73df3f548","Type":"ContainerDied","Data":"7071930f11f1d95fa97aac93ab1a12af43b492d5f638306d18b76c567dae60b7"} Jun 02 18:42:55.563067 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.562993 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c8f969cd-7b4hm" Jun 02 18:42:55.563191 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.562997 2561 scope.go:117] "RemoveContainer" containerID="4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2" Jun 02 18:42:55.571623 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.571607 2561 scope.go:117] "RemoveContainer" containerID="4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2" Jun 02 18:42:55.571889 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:42:55.571867 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2\": container with ID starting with 4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2 not found: ID does not exist" containerID="4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2" Jun 02 18:42:55.571929 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.571904 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2"} err="failed to get container status \"4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2\": rpc error: code = NotFound desc = could not find container \"4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2\": container with ID starting with 4e4679846cbde68be93f6861475867440b33fd7c9bea0aaf176ca735e3800fd2 not found: ID does not exist" Jun 02 18:42:55.583315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.583290 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9c8f969cd-7b4hm"] Jun 02 18:42:55.586740 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.586721 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9c8f969cd-7b4hm"] Jun 02 18:42:55.879109 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:55.879030 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a0eb1d-78fa-4c34-b289-86d73df3f548" path="/var/lib/kubelet/pods/e4a0eb1d-78fa-4c34-b289-86d73df3f548/volumes" Jun 02 18:42:57.948964 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:42:57.948932 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:43:01.580933 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:01.580897 2561 generic.go:358] "Generic (PLEG): container finished" podID="a39c406c-09fe-4dcc-9e79-76b82302919f" containerID="efc5bf9cd59eb43e1e49a0e40185a559f55a4d22420794a05b1aafe95b699b70" exitCode=0 Jun 02 18:43:01.581334 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:01.580976 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-n9nc2" event={"ID":"a39c406c-09fe-4dcc-9e79-76b82302919f","Type":"ContainerDied","Data":"efc5bf9cd59eb43e1e49a0e40185a559f55a4d22420794a05b1aafe95b699b70"} Jun 02 18:43:01.581374 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:01.581336 2561 scope.go:117] "RemoveContainer" containerID="efc5bf9cd59eb43e1e49a0e40185a559f55a4d22420794a05b1aafe95b699b70" Jun 02 18:43:02.585453 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:02.585419 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-n9nc2" event={"ID":"a39c406c-09fe-4dcc-9e79-76b82302919f","Type":"ContainerStarted","Data":"0c7f5b1feed938205badc99d5357dd0221e85b4ca2878a813edf0274b98d1e44"} Jun 02 18:43:02.586645 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:02.586621 2561 generic.go:358] "Generic (PLEG): container finished" podID="9a4541d6-1ce2-4bed-b745-bd9967e91458" containerID="7bdd0b440579d1fc569965d3ac9dd6673b3e242b894a11e7015b3a7b9be889b8" exitCode=0 Jun 02 18:43:02.586758 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:02.586683 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" event={"ID":"9a4541d6-1ce2-4bed-b745-bd9967e91458","Type":"ContainerDied","Data":"7bdd0b440579d1fc569965d3ac9dd6673b3e242b894a11e7015b3a7b9be889b8"} Jun 02 18:43:02.586995 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:02.586982 2561 scope.go:117] "RemoveContainer" containerID="7bdd0b440579d1fc569965d3ac9dd6673b3e242b894a11e7015b3a7b9be889b8" Jun 02 18:43:03.590639 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:03.590601 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-zcx5n" event={"ID":"9a4541d6-1ce2-4bed-b745-bd9967e91458","Type":"ContainerStarted","Data":"b11d7e6966624f86845d52a9b7f2e54aa4ee337c271f5eb611d2976dfe38024f"} Jun 02 18:43:12.964155 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:12.964112 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" podUID="4ee72458-9ab4-43c3-b0be-806ed6a9746a" containerName="registry" containerID="cri-o://7ee834851de42e8b3f0ac9cb3b6a6cf082d12ce5a2ab629c01b9eac5a8b4d8b2" gracePeriod=30 Jun 02 18:43:14.624271 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:14.624234 2561 generic.go:358] "Generic (PLEG): container finished" podID="4ee72458-9ab4-43c3-b0be-806ed6a9746a" containerID="7ee834851de42e8b3f0ac9cb3b6a6cf082d12ce5a2ab629c01b9eac5a8b4d8b2" exitCode=0 Jun 02 18:43:14.624628 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:14.624291 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" event={"ID":"4ee72458-9ab4-43c3-b0be-806ed6a9746a","Type":"ContainerDied","Data":"7ee834851de42e8b3f0ac9cb3b6a6cf082d12ce5a2ab629c01b9eac5a8b4d8b2"} Jun 02 18:43:14.624628 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:14.624319 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" event={"ID":"4ee72458-9ab4-43c3-b0be-806ed6a9746a","Type":"ContainerStarted","Data":"c424d7cde13b07fdb2a0755563f4990d8175564cc509ebbcebf318bb1c570ae5"} Jun 02 18:43:14.624628 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:14.624394 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:43:35.633536 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:35.633503 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c8b788444-8qtnf" Jun 02 18:43:50.817919 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.817882 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-998b7c4d8-ftfwl"] Jun 02 18:43:50.818314 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.818296 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a0eb1d-78fa-4c34-b289-86d73df3f548" containerName="console" Jun 02 18:43:50.818357 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.818318 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a0eb1d-78fa-4c34-b289-86d73df3f548" containerName="console" Jun 02 18:43:50.818357 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.818336 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dd1df6e-089d-4cb8-a466-79c41dd49842" containerName="registry" Jun 02 18:43:50.818357 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.818344 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dd1df6e-089d-4cb8-a466-79c41dd49842" containerName="registry" Jun 02 18:43:50.818446 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.818416 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="4dd1df6e-089d-4cb8-a466-79c41dd49842" containerName="registry" Jun 02 18:43:50.818446 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.818428 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="e4a0eb1d-78fa-4c34-b289-86d73df3f548" containerName="console" Jun 02 18:43:50.822589 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.822570 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:50.825163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.825142 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 18:43:50.825250 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.825190 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 18:43:50.826040 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.826009 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 18:43:50.826137 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.826012 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tnkn5\"" Jun 02 18:43:50.826412 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.826394 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 18:43:50.826530 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.826437 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 18:43:50.826530 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.826471 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 18:43:50.827205 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.827189 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 18:43:50.830448 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.830419 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 18:43:50.832476 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.832456 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-998b7c4d8-ftfwl"] Jun 02 18:43:50.930349 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.930309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-config\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:50.930349 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.930352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-oauth-serving-cert\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:50.930574 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.930433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-serving-cert\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:50.930574 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.930484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-trusted-ca-bundle\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:50.930574 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.930519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-service-ca\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:50.930574 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.930553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs7r4\" (UniqueName: \"kubernetes.io/projected/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-kube-api-access-fs7r4\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:50.930703 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:50.930603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-oauth-config\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.031955 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.031922 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs7r4\" (UniqueName: \"kubernetes.io/projected/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-kube-api-access-fs7r4\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.032106 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.031974 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-oauth-config\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.032106 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.032003 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-config\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.032106 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.032043 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-oauth-serving-cert\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.032106 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.032094 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-serving-cert\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.032349 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.032117 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-trusted-ca-bundle\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.032349 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.032149 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-service-ca\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.032808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.032785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-config\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.032924 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.032882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-oauth-serving-cert\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.033105 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.033084 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-service-ca\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.033376 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.033353 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-trusted-ca-bundle\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.034721 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.034692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-oauth-config\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.034799 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.034717 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-serving-cert\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.039760 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.039738 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs7r4\" (UniqueName: \"kubernetes.io/projected/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-kube-api-access-fs7r4\") pod \"console-998b7c4d8-ftfwl\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.133616 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.133544 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:43:51.262422 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.262347 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-998b7c4d8-ftfwl"] Jun 02 18:43:51.264600 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:43:51.264571 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcebcf003_ea69_4ea5_84e1_066eaa2dbfe4.slice/crio-f067675f7cdd317362d4f3ea9fc320ac626582d5a62857a6232e639d9fb8e960 WatchSource:0}: Error finding container f067675f7cdd317362d4f3ea9fc320ac626582d5a62857a6232e639d9fb8e960: Status 404 returned error can't find the container with id f067675f7cdd317362d4f3ea9fc320ac626582d5a62857a6232e639d9fb8e960 Jun 02 18:43:51.734300 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.734267 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998b7c4d8-ftfwl" event={"ID":"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4","Type":"ContainerStarted","Data":"a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb"} Jun 02 18:43:51.734300 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.734302 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998b7c4d8-ftfwl" event={"ID":"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4","Type":"ContainerStarted","Data":"f067675f7cdd317362d4f3ea9fc320ac626582d5a62857a6232e639d9fb8e960"} Jun 02 18:43:51.754210 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:43:51.754169 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-998b7c4d8-ftfwl" podStartSLOduration=1.754156093 podStartE2EDuration="1.754156093s" podCreationTimestamp="2026-06-02 18:43:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:43:51.752676676 +0000 UTC m=+244.416514819" watchObservedRunningTime="2026-06-02 18:43:51.754156093 +0000 UTC m=+244.417994234" Jun 02 18:44:01.134638 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:01.134602 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:44:01.134638 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:01.134644 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:44:01.139423 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:01.139400 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:44:01.765723 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:01.765689 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:44:39.598888 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.598854 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng"] Jun 02 18:44:39.602078 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.602062 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.604507 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.604483 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 18:44:39.604507 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.604497 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9cn5\"" Jun 02 18:44:39.605357 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.605329 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 18:44:39.611729 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.611708 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng"] Jun 02 18:44:39.689903 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.689867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.689903 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.689908 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.690089 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.689990 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmg25\" (UniqueName: \"kubernetes.io/projected/206174c0-0259-4794-8326-fbf1e9810bf7-kube-api-access-kmg25\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.790564 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.790532 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmg25\" (UniqueName: \"kubernetes.io/projected/206174c0-0259-4794-8326-fbf1e9810bf7-kube-api-access-kmg25\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.790658 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.790584 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.790658 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.790614 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.791048 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.791027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.791097 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.791046 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.799329 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.799298 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmg25\" (UniqueName: \"kubernetes.io/projected/206174c0-0259-4794-8326-fbf1e9810bf7-kube-api-access-kmg25\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:39.911643 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:39.911555 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:44:40.041683 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:40.041660 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng"] Jun 02 18:44:40.044327 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:44:40.044299 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206174c0_0259_4794_8326_fbf1e9810bf7.slice/crio-1c2426433f81357fc1a6bb1280ed1f99db8994a4dd3ed5a585d61b6ff4281de2 WatchSource:0}: Error finding container 1c2426433f81357fc1a6bb1280ed1f99db8994a4dd3ed5a585d61b6ff4281de2: Status 404 returned error can't find the container with id 1c2426433f81357fc1a6bb1280ed1f99db8994a4dd3ed5a585d61b6ff4281de2 Jun 02 18:44:40.872221 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:40.872178 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" event={"ID":"206174c0-0259-4794-8326-fbf1e9810bf7","Type":"ContainerStarted","Data":"1c2426433f81357fc1a6bb1280ed1f99db8994a4dd3ed5a585d61b6ff4281de2"} Jun 02 18:44:47.908089 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:47.907937 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:44:47.908089 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:47.908067 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:44:47.917050 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:47.910500 2561 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 18:44:48.895943 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:48.895908 2561 generic.go:358] "Generic (PLEG): container finished" podID="206174c0-0259-4794-8326-fbf1e9810bf7" containerID="ca9322a5b910581ee0d77aeabe644527ff92f80203b8a62f844133283d79c53e" exitCode=0 Jun 02 18:44:48.896129 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:48.895961 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" event={"ID":"206174c0-0259-4794-8326-fbf1e9810bf7","Type":"ContainerDied","Data":"ca9322a5b910581ee0d77aeabe644527ff92f80203b8a62f844133283d79c53e"} Jun 02 18:44:48.896931 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:48.896912 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:44:51.906092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:51.906056 2561 generic.go:358] "Generic (PLEG): container finished" podID="206174c0-0259-4794-8326-fbf1e9810bf7" containerID="814b7754f7d6280be7516a8ddfff9c75b4a952de47c73d29ce2b89193421c1c9" exitCode=0 Jun 02 18:44:51.906525 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:51.906139 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" event={"ID":"206174c0-0259-4794-8326-fbf1e9810bf7","Type":"ContainerDied","Data":"814b7754f7d6280be7516a8ddfff9c75b4a952de47c73d29ce2b89193421c1c9"} Jun 02 18:44:59.933533 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:59.933500 2561 generic.go:358] "Generic (PLEG): container finished" podID="206174c0-0259-4794-8326-fbf1e9810bf7" containerID="8fa77247ccaf8d51f79ec4f70787923f24e858f824a3898a9e575c29fae5a78a" exitCode=0 Jun 02 18:44:59.933965 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:44:59.933580 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" event={"ID":"206174c0-0259-4794-8326-fbf1e9810bf7","Type":"ContainerDied","Data":"8fa77247ccaf8d51f79ec4f70787923f24e858f824a3898a9e575c29fae5a78a"} Jun 02 18:45:01.058691 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.058667 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:45:01.173223 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.173195 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-util\") pod \"206174c0-0259-4794-8326-fbf1e9810bf7\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " Jun 02 18:45:01.173451 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.173240 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmg25\" (UniqueName: \"kubernetes.io/projected/206174c0-0259-4794-8326-fbf1e9810bf7-kube-api-access-kmg25\") pod \"206174c0-0259-4794-8326-fbf1e9810bf7\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " Jun 02 18:45:01.173451 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.173310 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-bundle\") pod \"206174c0-0259-4794-8326-fbf1e9810bf7\" (UID: \"206174c0-0259-4794-8326-fbf1e9810bf7\") " Jun 02 18:45:01.174037 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.174013 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-bundle" (OuterVolumeSpecName: "bundle") pod "206174c0-0259-4794-8326-fbf1e9810bf7" (UID: "206174c0-0259-4794-8326-fbf1e9810bf7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:45:01.175699 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.175675 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/206174c0-0259-4794-8326-fbf1e9810bf7-kube-api-access-kmg25" (OuterVolumeSpecName: "kube-api-access-kmg25") pod "206174c0-0259-4794-8326-fbf1e9810bf7" (UID: "206174c0-0259-4794-8326-fbf1e9810bf7"). InnerVolumeSpecName "kube-api-access-kmg25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:45:01.177468 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.177442 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-util" (OuterVolumeSpecName: "util") pod "206174c0-0259-4794-8326-fbf1e9810bf7" (UID: "206174c0-0259-4794-8326-fbf1e9810bf7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:45:01.274342 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.274314 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:01.274342 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.274339 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/206174c0-0259-4794-8326-fbf1e9810bf7-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:01.274496 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.274353 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmg25\" (UniqueName: \"kubernetes.io/projected/206174c0-0259-4794-8326-fbf1e9810bf7-kube-api-access-kmg25\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:01.941157 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.941122 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" event={"ID":"206174c0-0259-4794-8326-fbf1e9810bf7","Type":"ContainerDied","Data":"1c2426433f81357fc1a6bb1280ed1f99db8994a4dd3ed5a585d61b6ff4281de2"} Jun 02 18:45:01.941292 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.941161 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c2426433f81357fc1a6bb1280ed1f99db8994a4dd3ed5a585d61b6ff4281de2" Jun 02 18:45:01.941292 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:01.941180 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d8v9ng" Jun 02 18:45:12.231684 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.231648 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp"] Jun 02 18:45:12.232075 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.231949 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206174c0-0259-4794-8326-fbf1e9810bf7" containerName="pull" Jun 02 18:45:12.232075 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.231961 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="206174c0-0259-4794-8326-fbf1e9810bf7" containerName="pull" Jun 02 18:45:12.232075 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.231972 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206174c0-0259-4794-8326-fbf1e9810bf7" containerName="util" Jun 02 18:45:12.232075 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.231977 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="206174c0-0259-4794-8326-fbf1e9810bf7" containerName="util" Jun 02 18:45:12.232075 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.231989 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206174c0-0259-4794-8326-fbf1e9810bf7" containerName="extract" Jun 02 18:45:12.232075 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.231994 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="206174c0-0259-4794-8326-fbf1e9810bf7" containerName="extract" Jun 02 18:45:12.232075 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.232045 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="206174c0-0259-4794-8326-fbf1e9810bf7" containerName="extract" Jun 02 18:45:12.234141 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.234126 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.236594 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.236570 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 18:45:12.236694 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.236570 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 18:45:12.237442 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.237428 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9cn5\"" Jun 02 18:45:12.243980 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.243955 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp"] Jun 02 18:45:12.265451 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.265424 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.265559 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.265487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.265559 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.265509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42h2\" (UniqueName: \"kubernetes.io/projected/460654e5-83eb-456c-aebc-d123ad6b1a56-kube-api-access-z42h2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.366793 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.366757 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.366938 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.366859 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.366938 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.366889 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z42h2\" (UniqueName: \"kubernetes.io/projected/460654e5-83eb-456c-aebc-d123ad6b1a56-kube-api-access-z42h2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.367188 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.367169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.367223 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.367189 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.375137 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.375110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42h2\" (UniqueName: \"kubernetes.io/projected/460654e5-83eb-456c-aebc-d123ad6b1a56-kube-api-access-z42h2\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.543422 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.543324 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:12.668092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.668068 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp"] Jun 02 18:45:12.670240 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:45:12.670213 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460654e5_83eb_456c_aebc_d123ad6b1a56.slice/crio-2805a8b8d5d8a6a0d68d9d0c71ae51553c8b54429418a7eb835627618e7f5c0a WatchSource:0}: Error finding container 2805a8b8d5d8a6a0d68d9d0c71ae51553c8b54429418a7eb835627618e7f5c0a: Status 404 returned error can't find the container with id 2805a8b8d5d8a6a0d68d9d0c71ae51553c8b54429418a7eb835627618e7f5c0a Jun 02 18:45:12.812015 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.811950 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4pcfk"] Jun 02 18:45:12.813884 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.813869 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:12.816284 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.816264 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jdh76\"" Jun 02 18:45:12.816386 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.816267 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 18:45:12.816386 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.816269 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 18:45:12.823468 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.823438 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4pcfk"] Jun 02 18:45:12.870382 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.870355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2wrq\" (UniqueName: \"kubernetes.io/projected/89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef-kube-api-access-q2wrq\") pod \"cert-manager-webhook-587ccfb98-4pcfk\" (UID: \"89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:12.870473 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.870440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4pcfk\" (UID: \"89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:12.971284 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.971258 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4pcfk\" (UID: \"89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:12.971424 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.971340 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2wrq\" (UniqueName: \"kubernetes.io/projected/89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef-kube-api-access-q2wrq\") pod \"cert-manager-webhook-587ccfb98-4pcfk\" (UID: \"89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:12.972494 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.972472 2561 generic.go:358] "Generic (PLEG): container finished" podID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerID="d54ecdebb129686f6cdb827b8666d3cb0fa92df58ff63cc222386c04198cc173" exitCode=0 Jun 02 18:45:12.972587 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.972510 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" event={"ID":"460654e5-83eb-456c-aebc-d123ad6b1a56","Type":"ContainerDied","Data":"d54ecdebb129686f6cdb827b8666d3cb0fa92df58ff63cc222386c04198cc173"} Jun 02 18:45:12.972587 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.972532 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" event={"ID":"460654e5-83eb-456c-aebc-d123ad6b1a56","Type":"ContainerStarted","Data":"2805a8b8d5d8a6a0d68d9d0c71ae51553c8b54429418a7eb835627618e7f5c0a"} Jun 02 18:45:12.980013 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.979991 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2wrq\" (UniqueName: \"kubernetes.io/projected/89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef-kube-api-access-q2wrq\") pod \"cert-manager-webhook-587ccfb98-4pcfk\" (UID: \"89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:12.980232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:12.980214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-4pcfk\" (UID: \"89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef\") " pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:13.153984 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:13.153896 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:13.276738 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:13.276714 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-4pcfk"] Jun 02 18:45:13.279247 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:45:13.279215 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89aadeb5_a0df_40f1_a7b9_8bbacb63a2ef.slice/crio-41a0f1e35aa759b15bc03e9ee3a4127579aa085a947862e7bcf9fa18c223bb05 WatchSource:0}: Error finding container 41a0f1e35aa759b15bc03e9ee3a4127579aa085a947862e7bcf9fa18c223bb05: Status 404 returned error can't find the container with id 41a0f1e35aa759b15bc03e9ee3a4127579aa085a947862e7bcf9fa18c223bb05 Jun 02 18:45:13.976187 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:13.976150 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" event={"ID":"89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef","Type":"ContainerStarted","Data":"41a0f1e35aa759b15bc03e9ee3a4127579aa085a947862e7bcf9fa18c223bb05"} Jun 02 18:45:14.980765 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:14.980729 2561 generic.go:358] "Generic (PLEG): container finished" podID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerID="22e9cbed4a295b49a3bf7420ea0b67c1235f0f7c4f4e10371b61b13659b5d630" exitCode=0 Jun 02 18:45:14.981162 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:14.980819 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" event={"ID":"460654e5-83eb-456c-aebc-d123ad6b1a56","Type":"ContainerDied","Data":"22e9cbed4a295b49a3bf7420ea0b67c1235f0f7c4f4e10371b61b13659b5d630"} Jun 02 18:45:15.044918 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.044888 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vnwdx"] Jun 02 18:45:15.047575 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.047554 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" Jun 02 18:45:15.050095 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.050076 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sbspg\"" Jun 02 18:45:15.053799 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.053779 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vnwdx"] Jun 02 18:45:15.090255 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.090230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75271d4-fd90-4db5-ab19-c68ab1bcbf8b-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vnwdx\" (UID: \"b75271d4-fd90-4db5-ab19-c68ab1bcbf8b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" Jun 02 18:45:15.090375 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.090263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m7f9\" (UniqueName: \"kubernetes.io/projected/b75271d4-fd90-4db5-ab19-c68ab1bcbf8b-kube-api-access-8m7f9\") pod \"cert-manager-cainjector-68b757865b-vnwdx\" (UID: \"b75271d4-fd90-4db5-ab19-c68ab1bcbf8b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" Jun 02 18:45:15.191444 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.191417 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75271d4-fd90-4db5-ab19-c68ab1bcbf8b-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vnwdx\" (UID: \"b75271d4-fd90-4db5-ab19-c68ab1bcbf8b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" Jun 02 18:45:15.191556 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.191452 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8m7f9\" (UniqueName: \"kubernetes.io/projected/b75271d4-fd90-4db5-ab19-c68ab1bcbf8b-kube-api-access-8m7f9\") pod \"cert-manager-cainjector-68b757865b-vnwdx\" (UID: \"b75271d4-fd90-4db5-ab19-c68ab1bcbf8b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" Jun 02 18:45:15.199259 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.199233 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b75271d4-fd90-4db5-ab19-c68ab1bcbf8b-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-vnwdx\" (UID: \"b75271d4-fd90-4db5-ab19-c68ab1bcbf8b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" Jun 02 18:45:15.199382 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.199348 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m7f9\" (UniqueName: \"kubernetes.io/projected/b75271d4-fd90-4db5-ab19-c68ab1bcbf8b-kube-api-access-8m7f9\") pod \"cert-manager-cainjector-68b757865b-vnwdx\" (UID: \"b75271d4-fd90-4db5-ab19-c68ab1bcbf8b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" Jun 02 18:45:15.361804 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.361707 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" Jun 02 18:45:15.495930 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.495906 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-vnwdx"] Jun 02 18:45:15.498700 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:45:15.498669 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb75271d4_fd90_4db5_ab19_c68ab1bcbf8b.slice/crio-bad34ae1fce2c1da744355d6e39792ff50489a224671402f306cb040fa873972 WatchSource:0}: Error finding container bad34ae1fce2c1da744355d6e39792ff50489a224671402f306cb040fa873972: Status 404 returned error can't find the container with id bad34ae1fce2c1da744355d6e39792ff50489a224671402f306cb040fa873972 Jun 02 18:45:15.984770 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.984725 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" event={"ID":"b75271d4-fd90-4db5-ab19-c68ab1bcbf8b","Type":"ContainerStarted","Data":"bad34ae1fce2c1da744355d6e39792ff50489a224671402f306cb040fa873972"} Jun 02 18:45:15.986468 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.986435 2561 generic.go:358] "Generic (PLEG): container finished" podID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerID="06968ceb1dbc0d2d83aa6a1a67989c1595784791950a2981bd7b78caab756c79" exitCode=0 Jun 02 18:45:15.986585 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:15.986516 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" event={"ID":"460654e5-83eb-456c-aebc-d123ad6b1a56","Type":"ContainerDied","Data":"06968ceb1dbc0d2d83aa6a1a67989c1595784791950a2981bd7b78caab756c79"} Jun 02 18:45:17.122593 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.122568 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:17.208399 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.208356 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z42h2\" (UniqueName: \"kubernetes.io/projected/460654e5-83eb-456c-aebc-d123ad6b1a56-kube-api-access-z42h2\") pod \"460654e5-83eb-456c-aebc-d123ad6b1a56\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " Jun 02 18:45:17.208399 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.208404 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-bundle\") pod \"460654e5-83eb-456c-aebc-d123ad6b1a56\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " Jun 02 18:45:17.208619 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.208427 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-util\") pod \"460654e5-83eb-456c-aebc-d123ad6b1a56\" (UID: \"460654e5-83eb-456c-aebc-d123ad6b1a56\") " Jun 02 18:45:17.208857 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.208812 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-bundle" (OuterVolumeSpecName: "bundle") pod "460654e5-83eb-456c-aebc-d123ad6b1a56" (UID: "460654e5-83eb-456c-aebc-d123ad6b1a56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:45:17.210630 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.210607 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460654e5-83eb-456c-aebc-d123ad6b1a56-kube-api-access-z42h2" (OuterVolumeSpecName: "kube-api-access-z42h2") pod "460654e5-83eb-456c-aebc-d123ad6b1a56" (UID: "460654e5-83eb-456c-aebc-d123ad6b1a56"). InnerVolumeSpecName "kube-api-access-z42h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:45:17.214055 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.214029 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-util" (OuterVolumeSpecName: "util") pod "460654e5-83eb-456c-aebc-d123ad6b1a56" (UID: "460654e5-83eb-456c-aebc-d123ad6b1a56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:45:17.309713 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.309644 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z42h2\" (UniqueName: \"kubernetes.io/projected/460654e5-83eb-456c-aebc-d123ad6b1a56-kube-api-access-z42h2\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:17.309713 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.309673 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:17.309713 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.309684 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/460654e5-83eb-456c-aebc-d123ad6b1a56-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:17.996947 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.996916 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" event={"ID":"460654e5-83eb-456c-aebc-d123ad6b1a56","Type":"ContainerDied","Data":"2805a8b8d5d8a6a0d68d9d0c71ae51553c8b54429418a7eb835627618e7f5c0a"} Jun 02 18:45:17.996947 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.996950 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2805a8b8d5d8a6a0d68d9d0c71ae51553c8b54429418a7eb835627618e7f5c0a" Jun 02 18:45:17.997180 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:17.996966 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvt6sp" Jun 02 18:45:19.001283 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:19.001246 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" event={"ID":"89aadeb5-a0df-40f1-a7b9-8bbacb63a2ef","Type":"ContainerStarted","Data":"facf04aed90b689bddd35aa71a54d3faa7546f73b46c57d979fe6a5210b8de87"} Jun 02 18:45:19.001725 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:19.001292 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:19.002590 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:19.002565 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" event={"ID":"b75271d4-fd90-4db5-ab19-c68ab1bcbf8b","Type":"ContainerStarted","Data":"b03354d6cda8de159b3b2efe4be41f311cd348cb4b04bf913250136f3c1f2b13"} Jun 02 18:45:19.017268 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:19.017230 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" podStartSLOduration=1.8648184589999999 podStartE2EDuration="7.017219838s" podCreationTimestamp="2026-06-02 18:45:12 +0000 UTC" firstStartedPulling="2026-06-02 18:45:13.281163172 +0000 UTC m=+325.945001292" lastFinishedPulling="2026-06-02 18:45:18.43356455 +0000 UTC m=+331.097402671" observedRunningTime="2026-06-02 18:45:19.015730975 +0000 UTC m=+331.679569118" watchObservedRunningTime="2026-06-02 18:45:19.017219838 +0000 UTC m=+331.681057979" Jun 02 18:45:19.031653 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:19.031615 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-vnwdx" podStartSLOduration=1.089428492 podStartE2EDuration="4.031604979s" podCreationTimestamp="2026-06-02 18:45:15 +0000 UTC" firstStartedPulling="2026-06-02 18:45:15.500943718 +0000 UTC m=+328.164781838" lastFinishedPulling="2026-06-02 18:45:18.443120199 +0000 UTC m=+331.106958325" observedRunningTime="2026-06-02 18:45:19.030244543 +0000 UTC m=+331.694082685" watchObservedRunningTime="2026-06-02 18:45:19.031604979 +0000 UTC m=+331.695443121" Jun 02 18:45:25.007152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.007121 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-4pcfk" Jun 02 18:45:25.762023 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.761991 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-8n8xs"] Jun 02 18:45:25.762308 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.762296 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerName="pull" Jun 02 18:45:25.762359 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.762309 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerName="pull" Jun 02 18:45:25.762359 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.762322 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerName="extract" Jun 02 18:45:25.762359 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.762327 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerName="extract" Jun 02 18:45:25.762359 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.762341 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerName="util" Jun 02 18:45:25.762359 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.762346 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerName="util" Jun 02 18:45:25.762523 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.762399 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="460654e5-83eb-456c-aebc-d123ad6b1a56" containerName="extract" Jun 02 18:45:25.764230 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.764210 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-8n8xs" Jun 02 18:45:25.770195 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.770169 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-xqjlg\"" Jun 02 18:45:25.774818 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.774794 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-8n8xs"] Jun 02 18:45:25.881218 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.881129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f59kt\" (UniqueName: \"kubernetes.io/projected/13df8fa7-d71a-4db0-a609-2ad05d00b9f6-kube-api-access-f59kt\") pod \"cert-manager-79c8d999ff-8n8xs\" (UID: \"13df8fa7-d71a-4db0-a609-2ad05d00b9f6\") " pod="cert-manager/cert-manager-79c8d999ff-8n8xs" Jun 02 18:45:25.881218 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.881173 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13df8fa7-d71a-4db0-a609-2ad05d00b9f6-bound-sa-token\") pod \"cert-manager-79c8d999ff-8n8xs\" (UID: \"13df8fa7-d71a-4db0-a609-2ad05d00b9f6\") " pod="cert-manager/cert-manager-79c8d999ff-8n8xs" Jun 02 18:45:25.982550 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.982517 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f59kt\" (UniqueName: \"kubernetes.io/projected/13df8fa7-d71a-4db0-a609-2ad05d00b9f6-kube-api-access-f59kt\") pod \"cert-manager-79c8d999ff-8n8xs\" (UID: \"13df8fa7-d71a-4db0-a609-2ad05d00b9f6\") " pod="cert-manager/cert-manager-79c8d999ff-8n8xs" Jun 02 18:45:25.982550 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.982555 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13df8fa7-d71a-4db0-a609-2ad05d00b9f6-bound-sa-token\") pod \"cert-manager-79c8d999ff-8n8xs\" (UID: \"13df8fa7-d71a-4db0-a609-2ad05d00b9f6\") " pod="cert-manager/cert-manager-79c8d999ff-8n8xs" Jun 02 18:45:25.990137 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.990103 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13df8fa7-d71a-4db0-a609-2ad05d00b9f6-bound-sa-token\") pod \"cert-manager-79c8d999ff-8n8xs\" (UID: \"13df8fa7-d71a-4db0-a609-2ad05d00b9f6\") " pod="cert-manager/cert-manager-79c8d999ff-8n8xs" Jun 02 18:45:25.990237 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:25.990219 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f59kt\" (UniqueName: \"kubernetes.io/projected/13df8fa7-d71a-4db0-a609-2ad05d00b9f6-kube-api-access-f59kt\") pod \"cert-manager-79c8d999ff-8n8xs\" (UID: \"13df8fa7-d71a-4db0-a609-2ad05d00b9f6\") " pod="cert-manager/cert-manager-79c8d999ff-8n8xs" Jun 02 18:45:26.078788 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:26.078765 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-8n8xs" Jun 02 18:45:26.219980 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:26.219947 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-8n8xs"] Jun 02 18:45:26.222998 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:45:26.222966 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13df8fa7_d71a_4db0_a609_2ad05d00b9f6.slice/crio-f195d7c8aa25f792ab519123c097861caeb5a0ff4b2241cbae2d8a5d9607d181 WatchSource:0}: Error finding container f195d7c8aa25f792ab519123c097861caeb5a0ff4b2241cbae2d8a5d9607d181: Status 404 returned error can't find the container with id f195d7c8aa25f792ab519123c097861caeb5a0ff4b2241cbae2d8a5d9607d181 Jun 02 18:45:27.026146 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:27.026107 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-8n8xs" event={"ID":"13df8fa7-d71a-4db0-a609-2ad05d00b9f6","Type":"ContainerStarted","Data":"d10f856bb8d497a7a70ba1a8291c028ab11a56a0c71a6b8f802d23715ff78255"} Jun 02 18:45:27.026146 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:27.026144 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-8n8xs" event={"ID":"13df8fa7-d71a-4db0-a609-2ad05d00b9f6","Type":"ContainerStarted","Data":"f195d7c8aa25f792ab519123c097861caeb5a0ff4b2241cbae2d8a5d9607d181"} Jun 02 18:45:27.041588 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:27.041542 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-8n8xs" podStartSLOduration=2.041531218 podStartE2EDuration="2.041531218s" podCreationTimestamp="2026-06-02 18:45:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:45:27.039683422 +0000 UTC m=+339.703521618" watchObservedRunningTime="2026-06-02 18:45:27.041531218 +0000 UTC m=+339.705369360" Jun 02 18:45:32.078121 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.078081 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98"] Jun 02 18:45:32.096979 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.096951 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98"] Jun 02 18:45:32.097123 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.097075 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.099607 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.099584 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 18:45:32.099607 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.099594 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9cn5\"" Jun 02 18:45:32.100500 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.100479 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 18:45:32.234702 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.234667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.234909 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.234721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.234909 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.234740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgvmg\" (UniqueName: \"kubernetes.io/projected/4a3119d5-2a8a-40ae-918d-b29708ee19b3-kube-api-access-jgvmg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.335683 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.335599 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.335683 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.335649 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.335683 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.335669 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgvmg\" (UniqueName: \"kubernetes.io/projected/4a3119d5-2a8a-40ae-918d-b29708ee19b3-kube-api-access-jgvmg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.336106 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.336082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.336147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.336088 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.343326 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.343299 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgvmg\" (UniqueName: \"kubernetes.io/projected/4a3119d5-2a8a-40ae-918d-b29708ee19b3-kube-api-access-jgvmg\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.407330 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.407295 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:32.535193 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:32.535160 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98"] Jun 02 18:45:32.538936 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:45:32.538907 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3119d5_2a8a_40ae_918d_b29708ee19b3.slice/crio-53d4aacb8e71d342074de891d271196c1a0829f776fcd2336f64adeb5dd872ec WatchSource:0}: Error finding container 53d4aacb8e71d342074de891d271196c1a0829f776fcd2336f64adeb5dd872ec: Status 404 returned error can't find the container with id 53d4aacb8e71d342074de891d271196c1a0829f776fcd2336f64adeb5dd872ec Jun 02 18:45:33.045364 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:33.045328 2561 generic.go:358] "Generic (PLEG): container finished" podID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerID="fe7d2afd09b84eed296dfe8c8e601941d17c9d179f86a84e4589686b6a0e01a0" exitCode=0 Jun 02 18:45:33.045539 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:33.045373 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" event={"ID":"4a3119d5-2a8a-40ae-918d-b29708ee19b3","Type":"ContainerDied","Data":"fe7d2afd09b84eed296dfe8c8e601941d17c9d179f86a84e4589686b6a0e01a0"} Jun 02 18:45:33.045539 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:33.045406 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" event={"ID":"4a3119d5-2a8a-40ae-918d-b29708ee19b3","Type":"ContainerStarted","Data":"53d4aacb8e71d342074de891d271196c1a0829f776fcd2336f64adeb5dd872ec"} Jun 02 18:45:34.050552 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:34.050518 2561 generic.go:358] "Generic (PLEG): container finished" podID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerID="5800f3ba77b6ce14dd618ca4467d60b7ee9f615710a473d5f20b1da56c012785" exitCode=0 Jun 02 18:45:34.050961 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:34.050583 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" event={"ID":"4a3119d5-2a8a-40ae-918d-b29708ee19b3","Type":"ContainerDied","Data":"5800f3ba77b6ce14dd618ca4467d60b7ee9f615710a473d5f20b1da56c012785"} Jun 02 18:45:35.055985 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:35.055905 2561 generic.go:358] "Generic (PLEG): container finished" podID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerID="90305f3d7fd20504948b6f8661fe08528c99a98a17fd33428f3ddb73fd078c97" exitCode=0 Jun 02 18:45:35.055985 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:35.055968 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" event={"ID":"4a3119d5-2a8a-40ae-918d-b29708ee19b3","Type":"ContainerDied","Data":"90305f3d7fd20504948b6f8661fe08528c99a98a17fd33428f3ddb73fd078c97"} Jun 02 18:45:36.184964 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.184943 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:36.268350 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.268325 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-bundle\") pod \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " Jun 02 18:45:36.268458 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.268361 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-util\") pod \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " Jun 02 18:45:36.268458 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.268411 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgvmg\" (UniqueName: \"kubernetes.io/projected/4a3119d5-2a8a-40ae-918d-b29708ee19b3-kube-api-access-jgvmg\") pod \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\" (UID: \"4a3119d5-2a8a-40ae-918d-b29708ee19b3\") " Jun 02 18:45:36.269021 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.268992 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-bundle" (OuterVolumeSpecName: "bundle") pod "4a3119d5-2a8a-40ae-918d-b29708ee19b3" (UID: "4a3119d5-2a8a-40ae-918d-b29708ee19b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:45:36.270477 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.270449 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a3119d5-2a8a-40ae-918d-b29708ee19b3-kube-api-access-jgvmg" (OuterVolumeSpecName: "kube-api-access-jgvmg") pod "4a3119d5-2a8a-40ae-918d-b29708ee19b3" (UID: "4a3119d5-2a8a-40ae-918d-b29708ee19b3"). InnerVolumeSpecName "kube-api-access-jgvmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:45:36.276678 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.276654 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-util" (OuterVolumeSpecName: "util") pod "4a3119d5-2a8a-40ae-918d-b29708ee19b3" (UID: "4a3119d5-2a8a-40ae-918d-b29708ee19b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:45:36.369463 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.369407 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:36.369463 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.369429 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4a3119d5-2a8a-40ae-918d-b29708ee19b3-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:36.369463 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:36.369439 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgvmg\" (UniqueName: \"kubernetes.io/projected/4a3119d5-2a8a-40ae-918d-b29708ee19b3-kube-api-access-jgvmg\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:45:37.063788 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:37.063755 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" event={"ID":"4a3119d5-2a8a-40ae-918d-b29708ee19b3","Type":"ContainerDied","Data":"53d4aacb8e71d342074de891d271196c1a0829f776fcd2336f64adeb5dd872ec"} Jun 02 18:45:37.063788 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:37.063786 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53d4aacb8e71d342074de891d271196c1a0829f776fcd2336f64adeb5dd872ec" Jun 02 18:45:37.063995 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:37.063880 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdwkf98" Jun 02 18:45:45.200434 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.200397 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk"] Jun 02 18:45:45.200875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.200798 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerName="pull" Jun 02 18:45:45.200875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.200814 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerName="pull" Jun 02 18:45:45.200875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.200848 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerName="util" Jun 02 18:45:45.200875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.200856 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerName="util" Jun 02 18:45:45.200875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.200866 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerName="extract" Jun 02 18:45:45.200875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.200872 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerName="extract" Jun 02 18:45:45.201092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.200941 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="4a3119d5-2a8a-40ae-918d-b29708ee19b3" containerName="extract" Jun 02 18:45:45.203364 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.203347 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.206092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.206070 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 18:45:45.206218 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.206202 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 18:45:45.206545 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.206525 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 18:45:45.206882 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.206647 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 18:45:45.206882 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.206680 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-795jw\"" Jun 02 18:45:45.219095 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.219075 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk"] Jun 02 18:45:45.335254 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.335214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a5b684f-668b-4ab8-961d-3667b3f3b29c-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.335422 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.335264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a5b684f-668b-4ab8-961d-3667b3f3b29c-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.335422 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.335287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a5b684f-668b-4ab8-961d-3667b3f3b29c-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.335422 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.335360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a5b684f-668b-4ab8-961d-3667b3f3b29c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.335422 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.335401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q259b\" (UniqueName: \"kubernetes.io/projected/2a5b684f-668b-4ab8-961d-3667b3f3b29c-kube-api-access-q259b\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.436186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.436150 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a5b684f-668b-4ab8-961d-3667b3f3b29c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.436186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.436189 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q259b\" (UniqueName: \"kubernetes.io/projected/2a5b684f-668b-4ab8-961d-3667b3f3b29c-kube-api-access-q259b\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.436388 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.436231 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a5b684f-668b-4ab8-961d-3667b3f3b29c-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.436388 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.436263 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a5b684f-668b-4ab8-961d-3667b3f3b29c-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.436388 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.436283 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a5b684f-668b-4ab8-961d-3667b3f3b29c-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.436638 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.436621 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a5b684f-668b-4ab8-961d-3667b3f3b29c-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.438640 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.438620 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a5b684f-668b-4ab8-961d-3667b3f3b29c-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.438807 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.438791 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a5b684f-668b-4ab8-961d-3667b3f3b29c-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.438969 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.438947 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a5b684f-668b-4ab8-961d-3667b3f3b29c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.471137 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.471111 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q259b\" (UniqueName: \"kubernetes.io/projected/2a5b684f-668b-4ab8-961d-3667b3f3b29c-kube-api-access-q259b\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-qpggk\" (UID: \"2a5b684f-668b-4ab8-961d-3667b3f3b29c\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.513151 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.513129 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:45.648861 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:45.648817 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk"] Jun 02 18:45:45.651152 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:45:45.651122 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5b684f_668b_4ab8_961d_3667b3f3b29c.slice/crio-751d11b884b510038d167416d8734893b228f63f4ef29997a56e295c7cdb3c55 WatchSource:0}: Error finding container 751d11b884b510038d167416d8734893b228f63f4ef29997a56e295c7cdb3c55: Status 404 returned error can't find the container with id 751d11b884b510038d167416d8734893b228f63f4ef29997a56e295c7cdb3c55 Jun 02 18:45:46.093613 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:46.093576 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" event={"ID":"2a5b684f-668b-4ab8-961d-3667b3f3b29c","Type":"ContainerStarted","Data":"751d11b884b510038d167416d8734893b228f63f4ef29997a56e295c7cdb3c55"} Jun 02 18:45:49.106886 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:49.106849 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" event={"ID":"2a5b684f-668b-4ab8-961d-3667b3f3b29c","Type":"ContainerStarted","Data":"3ae4e87e4ca44bc4c7132e0f2bf1b8f7df50d82c01b0e34d4f8ffd1be1e60d98"} Jun 02 18:45:50.111690 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:50.111652 2561 generic.go:358] "Generic (PLEG): container finished" podID="2a5b684f-668b-4ab8-961d-3667b3f3b29c" containerID="3ae4e87e4ca44bc4c7132e0f2bf1b8f7df50d82c01b0e34d4f8ffd1be1e60d98" exitCode=0 Jun 02 18:45:50.112137 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:50.111699 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" event={"ID":"2a5b684f-668b-4ab8-961d-3667b3f3b29c","Type":"ContainerDied","Data":"3ae4e87e4ca44bc4c7132e0f2bf1b8f7df50d82c01b0e34d4f8ffd1be1e60d98"} Jun 02 18:45:51.117066 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:51.117025 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" event={"ID":"2a5b684f-668b-4ab8-961d-3667b3f3b29c","Type":"ContainerStarted","Data":"c52429e682d3b21ffa5622e1ea0ebd71e9d95ece6e8c4ae2bcb9015d5a02dc4f"} Jun 02 18:45:51.117462 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:51.117148 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:45:51.138153 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:45:51.138112 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" podStartSLOduration=1.356665616 podStartE2EDuration="6.138101412s" podCreationTimestamp="2026-06-02 18:45:45 +0000 UTC" firstStartedPulling="2026-06-02 18:45:45.652884607 +0000 UTC m=+358.316722726" lastFinishedPulling="2026-06-02 18:45:50.434320401 +0000 UTC m=+363.098158522" observedRunningTime="2026-06-02 18:45:51.135788269 +0000 UTC m=+363.799626411" watchObservedRunningTime="2026-06-02 18:45:51.138101412 +0000 UTC m=+363.801939554" Jun 02 18:46:02.122879 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:02.122822 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-qpggk" Jun 02 18:46:03.742170 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.742135 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj"] Jun 02 18:46:03.747080 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.747051 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.752520 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.752477 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 18:46:03.752520 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.752494 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 18:46:03.752520 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.752494 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r6zjj\"" Jun 02 18:46:03.752791 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.752549 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:46:03.752791 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.752477 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 18:46:03.752791 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.752644 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 18:46:03.776479 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.776446 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj"] Jun 02 18:46:03.894195 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.894126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwqtj\" (UniqueName: \"kubernetes.io/projected/bcdfa942-88c9-423e-bd08-ff62f91cd55b-kube-api-access-hwqtj\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.894421 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.894216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcdfa942-88c9-423e-bd08-ff62f91cd55b-cert\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.894421 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.894251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bcdfa942-88c9-423e-bd08-ff62f91cd55b-manager-config\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.894421 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.894304 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcdfa942-88c9-423e-bd08-ff62f91cd55b-metrics-cert\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.994751 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.994648 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwqtj\" (UniqueName: \"kubernetes.io/projected/bcdfa942-88c9-423e-bd08-ff62f91cd55b-kube-api-access-hwqtj\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.994751 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.994699 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcdfa942-88c9-423e-bd08-ff62f91cd55b-cert\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.994751 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.994742 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bcdfa942-88c9-423e-bd08-ff62f91cd55b-manager-config\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.995073 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.994808 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcdfa942-88c9-423e-bd08-ff62f91cd55b-metrics-cert\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.995572 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.995552 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bcdfa942-88c9-423e-bd08-ff62f91cd55b-manager-config\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.997571 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.997551 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcdfa942-88c9-423e-bd08-ff62f91cd55b-cert\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:03.997633 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:03.997551 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcdfa942-88c9-423e-bd08-ff62f91cd55b-metrics-cert\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:04.030196 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:04.030158 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwqtj\" (UniqueName: \"kubernetes.io/projected/bcdfa942-88c9-423e-bd08-ff62f91cd55b-kube-api-access-hwqtj\") pod \"lws-controller-manager-655df48c9-2wmhj\" (UID: \"bcdfa942-88c9-423e-bd08-ff62f91cd55b\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:04.058016 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:04.057972 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:04.226546 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:04.226511 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj"] Jun 02 18:46:04.229419 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:46:04.229384 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcdfa942_88c9_423e_bd08_ff62f91cd55b.slice/crio-0d5e92e2a09df3db76d7dd6de45cb3143f987bad8efbc4c0d8f784886b4f0ef2 WatchSource:0}: Error finding container 0d5e92e2a09df3db76d7dd6de45cb3143f987bad8efbc4c0d8f784886b4f0ef2: Status 404 returned error can't find the container with id 0d5e92e2a09df3db76d7dd6de45cb3143f987bad8efbc4c0d8f784886b4f0ef2 Jun 02 18:46:05.170945 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:05.170901 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" event={"ID":"bcdfa942-88c9-423e-bd08-ff62f91cd55b","Type":"ContainerStarted","Data":"0d5e92e2a09df3db76d7dd6de45cb3143f987bad8efbc4c0d8f784886b4f0ef2"} Jun 02 18:46:06.176128 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.176045 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" event={"ID":"bcdfa942-88c9-423e-bd08-ff62f91cd55b","Type":"ContainerStarted","Data":"d55bbf986d945277f8b3558affd2f2b655ac1bae4e9ef963c7afb63902ef4e3e"} Jun 02 18:46:06.176450 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.176142 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:06.192627 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.192582 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" podStartSLOduration=1.532088102 podStartE2EDuration="3.192570407s" podCreationTimestamp="2026-06-02 18:46:03 +0000 UTC" firstStartedPulling="2026-06-02 18:46:04.231145339 +0000 UTC m=+376.894983459" lastFinishedPulling="2026-06-02 18:46:05.891627642 +0000 UTC m=+378.555465764" observedRunningTime="2026-06-02 18:46:06.190764195 +0000 UTC m=+378.854602336" watchObservedRunningTime="2026-06-02 18:46:06.192570407 +0000 UTC m=+378.856408546" Jun 02 18:46:06.354126 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.354094 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp"] Jun 02 18:46:06.356456 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.356440 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.358801 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.358777 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9cn5\"" Jun 02 18:46:06.358935 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.358848 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 18:46:06.358935 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.358855 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 18:46:06.364351 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.364329 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp"] Jun 02 18:46:06.418348 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.418326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.418457 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.418367 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b74n\" (UniqueName: \"kubernetes.io/projected/c9050547-af9f-4541-af97-0d43f12e2deb-kube-api-access-7b74n\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.418502 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.418484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.519210 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.519180 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.519329 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.519216 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b74n\" (UniqueName: \"kubernetes.io/projected/c9050547-af9f-4541-af97-0d43f12e2deb-kube-api-access-7b74n\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.519329 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.519266 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.519652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.519621 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.519652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.519641 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.527688 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.527659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b74n\" (UniqueName: \"kubernetes.io/projected/c9050547-af9f-4541-af97-0d43f12e2deb-kube-api-access-7b74n\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.666862 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.666819 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:06.789641 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:06.789612 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp"] Jun 02 18:46:06.791299 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:46:06.791271 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9050547_af9f_4541_af97_0d43f12e2deb.slice/crio-25cb7706e874a9ed1b670fe6281b140416ebf455513cd058168bad69e8e631f0 WatchSource:0}: Error finding container 25cb7706e874a9ed1b670fe6281b140416ebf455513cd058168bad69e8e631f0: Status 404 returned error can't find the container with id 25cb7706e874a9ed1b670fe6281b140416ebf455513cd058168bad69e8e631f0 Jun 02 18:46:07.180613 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:07.180527 2561 generic.go:358] "Generic (PLEG): container finished" podID="c9050547-af9f-4541-af97-0d43f12e2deb" containerID="63d83d74a83b204db5f4493503346fd572902b1c21855d7268b0f402e72baa28" exitCode=0 Jun 02 18:46:07.181010 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:07.180616 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" event={"ID":"c9050547-af9f-4541-af97-0d43f12e2deb","Type":"ContainerDied","Data":"63d83d74a83b204db5f4493503346fd572902b1c21855d7268b0f402e72baa28"} Jun 02 18:46:07.181010 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:07.180654 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" event={"ID":"c9050547-af9f-4541-af97-0d43f12e2deb","Type":"ContainerStarted","Data":"25cb7706e874a9ed1b670fe6281b140416ebf455513cd058168bad69e8e631f0"} Jun 02 18:46:08.186406 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:08.186324 2561 generic.go:358] "Generic (PLEG): container finished" podID="c9050547-af9f-4541-af97-0d43f12e2deb" containerID="44f616321c5b853e0fb21bafe1e4a6a4550639baa9fe3300b9617b9b314bbb0b" exitCode=0 Jun 02 18:46:08.186744 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:08.186411 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" event={"ID":"c9050547-af9f-4541-af97-0d43f12e2deb","Type":"ContainerDied","Data":"44f616321c5b853e0fb21bafe1e4a6a4550639baa9fe3300b9617b9b314bbb0b"} Jun 02 18:46:09.191751 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:09.191713 2561 generic.go:358] "Generic (PLEG): container finished" podID="c9050547-af9f-4541-af97-0d43f12e2deb" containerID="4e9273dce8ea82ea5f1c478196b4e780c9662a1464368b6ab27c9a1e6411355b" exitCode=0 Jun 02 18:46:09.192130 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:09.191809 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" event={"ID":"c9050547-af9f-4541-af97-0d43f12e2deb","Type":"ContainerDied","Data":"4e9273dce8ea82ea5f1c478196b4e780c9662a1464368b6ab27c9a1e6411355b"} Jun 02 18:46:10.316160 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.316137 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:10.351390 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.351363 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b74n\" (UniqueName: \"kubernetes.io/projected/c9050547-af9f-4541-af97-0d43f12e2deb-kube-api-access-7b74n\") pod \"c9050547-af9f-4541-af97-0d43f12e2deb\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " Jun 02 18:46:10.351547 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.351413 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-bundle\") pod \"c9050547-af9f-4541-af97-0d43f12e2deb\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " Jun 02 18:46:10.351547 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.351475 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-util\") pod \"c9050547-af9f-4541-af97-0d43f12e2deb\" (UID: \"c9050547-af9f-4541-af97-0d43f12e2deb\") " Jun 02 18:46:10.352380 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.352346 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-bundle" (OuterVolumeSpecName: "bundle") pod "c9050547-af9f-4541-af97-0d43f12e2deb" (UID: "c9050547-af9f-4541-af97-0d43f12e2deb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:46:10.353673 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.353648 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9050547-af9f-4541-af97-0d43f12e2deb-kube-api-access-7b74n" (OuterVolumeSpecName: "kube-api-access-7b74n") pod "c9050547-af9f-4541-af97-0d43f12e2deb" (UID: "c9050547-af9f-4541-af97-0d43f12e2deb"). InnerVolumeSpecName "kube-api-access-7b74n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:46:10.356970 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.356940 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-util" (OuterVolumeSpecName: "util") pod "c9050547-af9f-4541-af97-0d43f12e2deb" (UID: "c9050547-af9f-4541-af97-0d43f12e2deb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:46:10.452773 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.452689 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:46:10.452773 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.452716 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9050547-af9f-4541-af97-0d43f12e2deb-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:46:10.452773 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:10.452727 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b74n\" (UniqueName: \"kubernetes.io/projected/c9050547-af9f-4541-af97-0d43f12e2deb-kube-api-access-7b74n\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:46:11.199974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:11.199941 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" event={"ID":"c9050547-af9f-4541-af97-0d43f12e2deb","Type":"ContainerDied","Data":"25cb7706e874a9ed1b670fe6281b140416ebf455513cd058168bad69e8e631f0"} Jun 02 18:46:11.199974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:11.199967 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835r4ktp" Jun 02 18:46:11.199974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:11.199976 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25cb7706e874a9ed1b670fe6281b140416ebf455513cd058168bad69e8e631f0" Jun 02 18:46:17.183212 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:17.183182 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-655df48c9-2wmhj" Jun 02 18:46:21.670696 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.670654 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh"] Jun 02 18:46:21.671199 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.670983 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9050547-af9f-4541-af97-0d43f12e2deb" containerName="pull" Jun 02 18:46:21.671199 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.670995 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9050547-af9f-4541-af97-0d43f12e2deb" containerName="pull" Jun 02 18:46:21.671199 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.671009 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9050547-af9f-4541-af97-0d43f12e2deb" containerName="util" Jun 02 18:46:21.671199 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.671014 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9050547-af9f-4541-af97-0d43f12e2deb" containerName="util" Jun 02 18:46:21.671199 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.671024 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9050547-af9f-4541-af97-0d43f12e2deb" containerName="extract" Jun 02 18:46:21.671199 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.671030 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9050547-af9f-4541-af97-0d43f12e2deb" containerName="extract" Jun 02 18:46:21.671199 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.671085 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="c9050547-af9f-4541-af97-0d43f12e2deb" containerName="extract" Jun 02 18:46:21.730352 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.730310 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh"] Jun 02 18:46:21.730515 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.730439 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.734032 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.734004 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 18:46:21.734560 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.734540 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 18:46:21.735207 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.735190 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9cn5\"" Jun 02 18:46:21.847633 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.847590 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.847815 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.847655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfrzt\" (UniqueName: \"kubernetes.io/projected/3b778f11-3947-41c2-95fd-96b008b2c9d9-kube-api-access-hfrzt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.847815 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.847768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.948928 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.948813 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.949066 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.948923 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.949066 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.948991 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfrzt\" (UniqueName: \"kubernetes.io/projected/3b778f11-3947-41c2-95fd-96b008b2c9d9-kube-api-access-hfrzt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.949313 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.949290 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.949348 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.949304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:21.964059 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:21.964034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfrzt\" (UniqueName: \"kubernetes.io/projected/3b778f11-3947-41c2-95fd-96b008b2c9d9-kube-api-access-hfrzt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:22.039762 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:22.039725 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:22.172978 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:22.172950 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh"] Jun 02 18:46:22.174990 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:46:22.174961 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b778f11_3947_41c2_95fd_96b008b2c9d9.slice/crio-ac0cc79ec2b26cd0a58259da75c90b6e6aafb16654db1150ac776079fdd5a914 WatchSource:0}: Error finding container ac0cc79ec2b26cd0a58259da75c90b6e6aafb16654db1150ac776079fdd5a914: Status 404 returned error can't find the container with id ac0cc79ec2b26cd0a58259da75c90b6e6aafb16654db1150ac776079fdd5a914 Jun 02 18:46:22.242154 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:22.242115 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" event={"ID":"3b778f11-3947-41c2-95fd-96b008b2c9d9","Type":"ContainerStarted","Data":"207a255200cc9889e75af8c4a80e92222db950089ef5f8ddce4be06469598178"} Jun 02 18:46:22.242154 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:22.242154 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" event={"ID":"3b778f11-3947-41c2-95fd-96b008b2c9d9","Type":"ContainerStarted","Data":"ac0cc79ec2b26cd0a58259da75c90b6e6aafb16654db1150ac776079fdd5a914"} Jun 02 18:46:23.247299 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:23.247210 2561 generic.go:358] "Generic (PLEG): container finished" podID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerID="207a255200cc9889e75af8c4a80e92222db950089ef5f8ddce4be06469598178" exitCode=0 Jun 02 18:46:23.247299 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:23.247277 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" event={"ID":"3b778f11-3947-41c2-95fd-96b008b2c9d9","Type":"ContainerDied","Data":"207a255200cc9889e75af8c4a80e92222db950089ef5f8ddce4be06469598178"} Jun 02 18:46:24.252998 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:24.252966 2561 generic.go:358] "Generic (PLEG): container finished" podID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerID="bfdc4ef1fb0066c1d5c23a2bbc53725dec43a3291c40473703e9f788d096a6b0" exitCode=0 Jun 02 18:46:24.253353 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:24.253055 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" event={"ID":"3b778f11-3947-41c2-95fd-96b008b2c9d9","Type":"ContainerDied","Data":"bfdc4ef1fb0066c1d5c23a2bbc53725dec43a3291c40473703e9f788d096a6b0"} Jun 02 18:46:25.258875 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:25.258819 2561 generic.go:358] "Generic (PLEG): container finished" podID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerID="d4a66830a7439a8d269306e2b8979980941f49312a9c7255ed7f99f99cac046a" exitCode=0 Jun 02 18:46:25.259343 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:25.258900 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" event={"ID":"3b778f11-3947-41c2-95fd-96b008b2c9d9","Type":"ContainerDied","Data":"d4a66830a7439a8d269306e2b8979980941f49312a9c7255ed7f99f99cac046a"} Jun 02 18:46:26.389980 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.389956 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:26.489343 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.489306 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfrzt\" (UniqueName: \"kubernetes.io/projected/3b778f11-3947-41c2-95fd-96b008b2c9d9-kube-api-access-hfrzt\") pod \"3b778f11-3947-41c2-95fd-96b008b2c9d9\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " Jun 02 18:46:26.489540 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.489354 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-bundle\") pod \"3b778f11-3947-41c2-95fd-96b008b2c9d9\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " Jun 02 18:46:26.489540 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.489438 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-util\") pod \"3b778f11-3947-41c2-95fd-96b008b2c9d9\" (UID: \"3b778f11-3947-41c2-95fd-96b008b2c9d9\") " Jun 02 18:46:26.490408 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.490383 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-bundle" (OuterVolumeSpecName: "bundle") pod "3b778f11-3947-41c2-95fd-96b008b2c9d9" (UID: "3b778f11-3947-41c2-95fd-96b008b2c9d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:46:26.491543 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.491517 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b778f11-3947-41c2-95fd-96b008b2c9d9-kube-api-access-hfrzt" (OuterVolumeSpecName: "kube-api-access-hfrzt") pod "3b778f11-3947-41c2-95fd-96b008b2c9d9" (UID: "3b778f11-3947-41c2-95fd-96b008b2c9d9"). InnerVolumeSpecName "kube-api-access-hfrzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:46:26.494788 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.494754 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-util" (OuterVolumeSpecName: "util") pod "3b778f11-3947-41c2-95fd-96b008b2c9d9" (UID: "3b778f11-3947-41c2-95fd-96b008b2c9d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:46:26.590821 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.590735 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:46:26.590821 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.590767 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfrzt\" (UniqueName: \"kubernetes.io/projected/3b778f11-3947-41c2-95fd-96b008b2c9d9-kube-api-access-hfrzt\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:46:26.590821 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:26.590778 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b778f11-3947-41c2-95fd-96b008b2c9d9-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:46:27.267514 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:27.267469 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" event={"ID":"3b778f11-3947-41c2-95fd-96b008b2c9d9","Type":"ContainerDied","Data":"ac0cc79ec2b26cd0a58259da75c90b6e6aafb16654db1150ac776079fdd5a914"} Jun 02 18:46:27.267514 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:27.267506 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atd5xh" Jun 02 18:46:27.267514 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:27.267518 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac0cc79ec2b26cd0a58259da75c90b6e6aafb16654db1150ac776079fdd5a914" Jun 02 18:46:35.730886 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.730821 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg"] Jun 02 18:46:35.731361 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.731346 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerName="extract" Jun 02 18:46:35.731404 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.731365 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerName="extract" Jun 02 18:46:35.731404 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.731382 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerName="pull" Jun 02 18:46:35.731404 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.731391 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerName="pull" Jun 02 18:46:35.731490 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.731423 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerName="util" Jun 02 18:46:35.731490 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.731431 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerName="util" Jun 02 18:46:35.731554 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.731524 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b778f11-3947-41c2-95fd-96b008b2c9d9" containerName="extract" Jun 02 18:46:35.733675 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.733654 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.736207 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.736185 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 18:46:35.736322 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.736186 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 18:46:35.736322 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.736231 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xb8gn\"" Jun 02 18:46:35.736632 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.736614 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 18:46:35.745087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.745065 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg"] Jun 02 18:46:35.873603 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57c573be-749d-4f76-850a-3103f1df9517-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.873769 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873628 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.873769 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57c573be-749d-4f76-850a-3103f1df9517-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.873769 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57c573be-749d-4f76-850a-3103f1df9517-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.873985 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873790 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.873985 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.873985 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.873985 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.874138 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.873985 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8dbb\" (UniqueName: \"kubernetes.io/projected/57c573be-749d-4f76-850a-3103f1df9517-kube-api-access-c8dbb\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975090 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975045 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975285 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975104 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57c573be-749d-4f76-850a-3103f1df9517-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975285 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975132 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57c573be-749d-4f76-850a-3103f1df9517-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975285 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975192 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975285 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975228 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975285 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975254 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975285 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975283 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975599 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975323 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8dbb\" (UniqueName: \"kubernetes.io/projected/57c573be-749d-4f76-850a-3103f1df9517-kube-api-access-c8dbb\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975599 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975364 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57c573be-749d-4f76-850a-3103f1df9517-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975599 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975599 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975574 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975788 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975721 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.975788 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.975775 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.976134 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.976115 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57c573be-749d-4f76-850a-3103f1df9517-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.977722 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.977696 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57c573be-749d-4f76-850a-3103f1df9517-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.977844 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.977780 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57c573be-749d-4f76-850a-3103f1df9517-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.983145 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.983082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57c573be-749d-4f76-850a-3103f1df9517-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:35.983241 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:35.983184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8dbb\" (UniqueName: \"kubernetes.io/projected/57c573be-749d-4f76-850a-3103f1df9517-kube-api-access-c8dbb\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg\" (UID: \"57c573be-749d-4f76-850a-3103f1df9517\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:36.044661 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:36.044623 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:36.188924 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:36.188894 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg"] Jun 02 18:46:36.190389 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:46:36.190358 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c573be_749d_4f76_850a_3103f1df9517.slice/crio-44f320114e27a7242c0efc38c296c54928b98b51a175bd522f9365dcd2041584 WatchSource:0}: Error finding container 44f320114e27a7242c0efc38c296c54928b98b51a175bd522f9365dcd2041584: Status 404 returned error can't find the container with id 44f320114e27a7242c0efc38c296c54928b98b51a175bd522f9365dcd2041584 Jun 02 18:46:36.300789 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:36.300695 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" event={"ID":"57c573be-749d-4f76-850a-3103f1df9517","Type":"ContainerStarted","Data":"44f320114e27a7242c0efc38c296c54928b98b51a175bd522f9365dcd2041584"} Jun 02 18:46:39.241649 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.241609 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 18:46:39.241903 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.241688 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 18:46:39.241903 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.241716 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 18:46:39.312785 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.312750 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" event={"ID":"57c573be-749d-4f76-850a-3103f1df9517","Type":"ContainerStarted","Data":"4f9bf5822b3f4e82820708a14e8a39d0412b46115af2e06a6b8751a526e2cf65"} Jun 02 18:46:39.397485 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.397411 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" podStartSLOduration=1.348373847 podStartE2EDuration="4.397382407s" podCreationTimestamp="2026-06-02 18:46:35 +0000 UTC" firstStartedPulling="2026-06-02 18:46:36.192298605 +0000 UTC m=+408.856136738" lastFinishedPulling="2026-06-02 18:46:39.24130716 +0000 UTC m=+411.905145298" observedRunningTime="2026-06-02 18:46:39.392392368 +0000 UTC m=+412.056230509" watchObservedRunningTime="2026-06-02 18:46:39.397382407 +0000 UTC m=+412.061220550" Jun 02 18:46:39.880589 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.880551 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8d496bf45-w24mr"] Jun 02 18:46:39.883700 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.883678 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" Jun 02 18:46:39.887395 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.887372 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vt8v5\"" Jun 02 18:46:39.887670 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.887654 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 18:46:39.896228 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:39.896196 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8d496bf45-w24mr"] Jun 02 18:46:40.014301 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.014269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4snq\" (UniqueName: \"kubernetes.io/projected/ca2e9a74-bda1-4d7d-ab25-2e7664118229-kube-api-access-b4snq\") pod \"dashboard-redirect-8d496bf45-w24mr\" (UID: \"ca2e9a74-bda1-4d7d-ab25-2e7664118229\") " pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" Jun 02 18:46:40.014481 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.014325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca2e9a74-bda1-4d7d-ab25-2e7664118229-redirect-config\") pod \"dashboard-redirect-8d496bf45-w24mr\" (UID: \"ca2e9a74-bda1-4d7d-ab25-2e7664118229\") " pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" Jun 02 18:46:40.045591 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.045552 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:40.050422 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.050396 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:40.115447 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.115409 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4snq\" (UniqueName: \"kubernetes.io/projected/ca2e9a74-bda1-4d7d-ab25-2e7664118229-kube-api-access-b4snq\") pod \"dashboard-redirect-8d496bf45-w24mr\" (UID: \"ca2e9a74-bda1-4d7d-ab25-2e7664118229\") " pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" Jun 02 18:46:40.115622 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.115459 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca2e9a74-bda1-4d7d-ab25-2e7664118229-redirect-config\") pod \"dashboard-redirect-8d496bf45-w24mr\" (UID: \"ca2e9a74-bda1-4d7d-ab25-2e7664118229\") " pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" Jun 02 18:46:40.116221 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.116203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ca2e9a74-bda1-4d7d-ab25-2e7664118229-redirect-config\") pod \"dashboard-redirect-8d496bf45-w24mr\" (UID: \"ca2e9a74-bda1-4d7d-ab25-2e7664118229\") " pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" Jun 02 18:46:40.130414 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.130391 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4snq\" (UniqueName: \"kubernetes.io/projected/ca2e9a74-bda1-4d7d-ab25-2e7664118229-kube-api-access-b4snq\") pod \"dashboard-redirect-8d496bf45-w24mr\" (UID: \"ca2e9a74-bda1-4d7d-ab25-2e7664118229\") " pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" Jun 02 18:46:40.196243 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.196135 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" Jun 02 18:46:40.317954 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.317925 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:40.318970 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.318948 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg" Jun 02 18:46:40.330334 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:40.330310 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8d496bf45-w24mr"] Jun 02 18:46:40.332195 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:46:40.332172 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2e9a74_bda1_4d7d_ab25_2e7664118229.slice/crio-aea57deab6606f6787f53741cb868f2b53f6b04981e17b4252236d2fe457901e WatchSource:0}: Error finding container aea57deab6606f6787f53741cb868f2b53f6b04981e17b4252236d2fe457901e: Status 404 returned error can't find the container with id aea57deab6606f6787f53741cb868f2b53f6b04981e17b4252236d2fe457901e Jun 02 18:46:41.322700 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:41.322660 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" event={"ID":"ca2e9a74-bda1-4d7d-ab25-2e7664118229","Type":"ContainerStarted","Data":"aea57deab6606f6787f53741cb868f2b53f6b04981e17b4252236d2fe457901e"} Jun 02 18:46:44.336581 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:44.336542 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" event={"ID":"ca2e9a74-bda1-4d7d-ab25-2e7664118229","Type":"ContainerStarted","Data":"728dc84279f0d2a1a204a9536f917c16d0896c97390c24e09ed23267826398b5"} Jun 02 18:46:44.352726 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:46:44.352669 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8d496bf45-w24mr" podStartSLOduration=2.33597352 podStartE2EDuration="5.352655275s" podCreationTimestamp="2026-06-02 18:46:39 +0000 UTC" firstStartedPulling="2026-06-02 18:46:40.33342975 +0000 UTC m=+412.997267869" lastFinishedPulling="2026-06-02 18:46:43.350111504 +0000 UTC m=+416.013949624" observedRunningTime="2026-06-02 18:46:44.351485117 +0000 UTC m=+417.015323267" watchObservedRunningTime="2026-06-02 18:46:44.352655275 +0000 UTC m=+417.016493448" Jun 02 18:47:05.562930 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.562849 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hv2gp"] Jun 02 18:47:05.566212 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.566192 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" Jun 02 18:47:05.568823 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.568798 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 18:47:05.568951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.568798 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 18:47:05.569625 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.569609 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-js2pz\"" Jun 02 18:47:05.572766 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.572744 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hv2gp"] Jun 02 18:47:05.624920 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.624885 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv2dt\" (UniqueName: \"kubernetes.io/projected/b97b3cdb-bf35-4d50-ae30-1b1dd117d35b-kube-api-access-xv2dt\") pod \"kuadrant-operator-catalog-hv2gp\" (UID: \"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b\") " pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" Jun 02 18:47:05.725904 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.725864 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv2dt\" (UniqueName: \"kubernetes.io/projected/b97b3cdb-bf35-4d50-ae30-1b1dd117d35b-kube-api-access-xv2dt\") pod \"kuadrant-operator-catalog-hv2gp\" (UID: \"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b\") " pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" Jun 02 18:47:05.733631 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.733601 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv2dt\" (UniqueName: \"kubernetes.io/projected/b97b3cdb-bf35-4d50-ae30-1b1dd117d35b-kube-api-access-xv2dt\") pod \"kuadrant-operator-catalog-hv2gp\" (UID: \"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b\") " pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" Jun 02 18:47:05.876864 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.876746 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" Jun 02 18:47:05.929645 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:05.929608 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hv2gp"] Jun 02 18:47:06.009167 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.009141 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hv2gp"] Jun 02 18:47:06.011521 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:06.011489 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97b3cdb_bf35_4d50_ae30_1b1dd117d35b.slice/crio-97f5fc8a375f1266c1748129047a001aafdea005d56435e4ec5589370c2c4245 WatchSource:0}: Error finding container 97f5fc8a375f1266c1748129047a001aafdea005d56435e4ec5589370c2c4245: Status 404 returned error can't find the container with id 97f5fc8a375f1266c1748129047a001aafdea005d56435e4ec5589370c2c4245 Jun 02 18:47:06.138098 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.138019 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2tqk"] Jun 02 18:47:06.142583 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.142567 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:06.147815 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.147793 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2tqk"] Jun 02 18:47:06.231365 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.231333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szpcz\" (UniqueName: \"kubernetes.io/projected/627f8696-98b6-48d5-bd53-28132b7f4e95-kube-api-access-szpcz\") pod \"kuadrant-operator-catalog-r2tqk\" (UID: \"627f8696-98b6-48d5-bd53-28132b7f4e95\") " pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:06.332919 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.332884 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szpcz\" (UniqueName: \"kubernetes.io/projected/627f8696-98b6-48d5-bd53-28132b7f4e95-kube-api-access-szpcz\") pod \"kuadrant-operator-catalog-r2tqk\" (UID: \"627f8696-98b6-48d5-bd53-28132b7f4e95\") " pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:06.340983 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.340954 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szpcz\" (UniqueName: \"kubernetes.io/projected/627f8696-98b6-48d5-bd53-28132b7f4e95-kube-api-access-szpcz\") pod \"kuadrant-operator-catalog-r2tqk\" (UID: \"627f8696-98b6-48d5-bd53-28132b7f4e95\") " pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:06.412769 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.412691 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" event={"ID":"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b","Type":"ContainerStarted","Data":"97f5fc8a375f1266c1748129047a001aafdea005d56435e4ec5589370c2c4245"} Jun 02 18:47:06.453230 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.453199 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:06.801429 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:06.801279 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r2tqk"] Jun 02 18:47:06.817801 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:06.817759 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627f8696_98b6_48d5_bd53_28132b7f4e95.slice/crio-b853160e8d9c2666eed1e3c549146826516ab36f02587232010f302c1c779efc WatchSource:0}: Error finding container b853160e8d9c2666eed1e3c549146826516ab36f02587232010f302c1c779efc: Status 404 returned error can't find the container with id b853160e8d9c2666eed1e3c549146826516ab36f02587232010f302c1c779efc Jun 02 18:47:07.417685 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:07.417651 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" event={"ID":"627f8696-98b6-48d5-bd53-28132b7f4e95","Type":"ContainerStarted","Data":"b853160e8d9c2666eed1e3c549146826516ab36f02587232010f302c1c779efc"} Jun 02 18:47:08.423682 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.423642 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" event={"ID":"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b","Type":"ContainerStarted","Data":"2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9"} Jun 02 18:47:08.424196 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.423718 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" podUID="b97b3cdb-bf35-4d50-ae30-1b1dd117d35b" containerName="registry-server" containerID="cri-o://2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9" gracePeriod=2 Jun 02 18:47:08.425534 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.425493 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" event={"ID":"627f8696-98b6-48d5-bd53-28132b7f4e95","Type":"ContainerStarted","Data":"d9da2f1f0b57fed23b56b04a8de7842bf8d4eeb16d1d814c09d2da62440bce3f"} Jun 02 18:47:08.440819 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.440778 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" podStartSLOduration=1.194376252 podStartE2EDuration="3.440762738s" podCreationTimestamp="2026-06-02 18:47:05 +0000 UTC" firstStartedPulling="2026-06-02 18:47:06.01284717 +0000 UTC m=+438.676685290" lastFinishedPulling="2026-06-02 18:47:08.259233657 +0000 UTC m=+440.923071776" observedRunningTime="2026-06-02 18:47:08.437481077 +0000 UTC m=+441.101319219" watchObservedRunningTime="2026-06-02 18:47:08.440762738 +0000 UTC m=+441.104600906" Jun 02 18:47:08.453244 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.453204 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" podStartSLOduration=1.010576498 podStartE2EDuration="2.453190415s" podCreationTimestamp="2026-06-02 18:47:06 +0000 UTC" firstStartedPulling="2026-06-02 18:47:06.81909336 +0000 UTC m=+439.482931485" lastFinishedPulling="2026-06-02 18:47:08.261707267 +0000 UTC m=+440.925545402" observedRunningTime="2026-06-02 18:47:08.450783001 +0000 UTC m=+441.114621144" watchObservedRunningTime="2026-06-02 18:47:08.453190415 +0000 UTC m=+441.117028556" Jun 02 18:47:08.674469 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.674447 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hv2gp_b97b3cdb-bf35-4d50-ae30-1b1dd117d35b/registry-server/0.log" Jun 02 18:47:08.674595 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.674505 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" Jun 02 18:47:08.756780 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.756748 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xv2dt\" (UniqueName: \"kubernetes.io/projected/b97b3cdb-bf35-4d50-ae30-1b1dd117d35b-kube-api-access-xv2dt\") pod \"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b\" (UID: \"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b\") " Jun 02 18:47:08.758978 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.758952 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97b3cdb-bf35-4d50-ae30-1b1dd117d35b-kube-api-access-xv2dt" (OuterVolumeSpecName: "kube-api-access-xv2dt") pod "b97b3cdb-bf35-4d50-ae30-1b1dd117d35b" (UID: "b97b3cdb-bf35-4d50-ae30-1b1dd117d35b"). InnerVolumeSpecName "kube-api-access-xv2dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:47:08.858205 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:08.858124 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xv2dt\" (UniqueName: \"kubernetes.io/projected/b97b3cdb-bf35-4d50-ae30-1b1dd117d35b-kube-api-access-xv2dt\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:09.429935 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.429907 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hv2gp_b97b3cdb-bf35-4d50-ae30-1b1dd117d35b/registry-server/0.log" Jun 02 18:47:09.430420 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.429945 2561 generic.go:358] "Generic (PLEG): container finished" podID="b97b3cdb-bf35-4d50-ae30-1b1dd117d35b" containerID="2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9" exitCode=1 Jun 02 18:47:09.430420 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.430025 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" Jun 02 18:47:09.430420 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.430036 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" event={"ID":"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b","Type":"ContainerDied","Data":"2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9"} Jun 02 18:47:09.430420 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.430076 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hv2gp" event={"ID":"b97b3cdb-bf35-4d50-ae30-1b1dd117d35b","Type":"ContainerDied","Data":"97f5fc8a375f1266c1748129047a001aafdea005d56435e4ec5589370c2c4245"} Jun 02 18:47:09.430420 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.430092 2561 scope.go:117] "RemoveContainer" containerID="2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9" Jun 02 18:47:09.439003 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.438987 2561 scope.go:117] "RemoveContainer" containerID="2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9" Jun 02 18:47:09.439229 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:47:09.439212 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9\": container with ID starting with 2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9 not found: ID does not exist" containerID="2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9" Jun 02 18:47:09.439280 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.439237 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9"} err="failed to get container status \"2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9\": rpc error: code = NotFound desc = could not find container \"2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9\": container with ID starting with 2662bbdecff50d3200a6cdff06a905a7095b5992a5ae907d98b5d76d8770ece9 not found: ID does not exist" Jun 02 18:47:09.453184 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.453159 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hv2gp"] Jun 02 18:47:09.457912 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.457890 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hv2gp"] Jun 02 18:47:09.874751 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:09.874721 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97b3cdb-bf35-4d50-ae30-1b1dd117d35b" path="/var/lib/kubelet/pods/b97b3cdb-bf35-4d50-ae30-1b1dd117d35b/volumes" Jun 02 18:47:16.453496 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:16.453461 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:16.454041 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:16.453508 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:16.475777 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:16.475750 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:17.480872 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:17.480817 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r2tqk" Jun 02 18:47:21.167955 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.167920 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5"] Jun 02 18:47:21.168317 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.168279 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97b3cdb-bf35-4d50-ae30-1b1dd117d35b" containerName="registry-server" Jun 02 18:47:21.168317 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.168289 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97b3cdb-bf35-4d50-ae30-1b1dd117d35b" containerName="registry-server" Jun 02 18:47:21.168387 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.168355 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="b97b3cdb-bf35-4d50-ae30-1b1dd117d35b" containerName="registry-server" Jun 02 18:47:21.182635 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.182597 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5"] Jun 02 18:47:21.182783 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.182673 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.185193 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.185167 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cwcfj\"" Jun 02 18:47:21.262445 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.262419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.262581 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.262471 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.262581 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.262568 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-886h5\" (UniqueName: \"kubernetes.io/projected/fc274027-e193-46eb-a267-50482e6d3ab8-kube-api-access-886h5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.363113 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.363088 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.363231 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.363133 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.363231 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.363182 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-886h5\" (UniqueName: \"kubernetes.io/projected/fc274027-e193-46eb-a267-50482e6d3ab8-kube-api-access-886h5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.363497 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.363477 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.363564 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.363523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.371987 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.371970 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-886h5\" (UniqueName: \"kubernetes.io/projected/fc274027-e193-46eb-a267-50482e6d3ab8-kube-api-access-886h5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.492628 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.492607 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:21.568364 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.568332 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt"] Jun 02 18:47:21.573670 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.573519 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.581505 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.581457 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt"] Jun 02 18:47:21.629409 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.629373 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5"] Jun 02 18:47:21.631339 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:21.631312 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc274027_e193_46eb_a267_50482e6d3ab8.slice/crio-5bdc1ce7f5672ce39c970b89035b823ae3e502c3a244864283182b16e68e3e8e WatchSource:0}: Error finding container 5bdc1ce7f5672ce39c970b89035b823ae3e502c3a244864283182b16e68e3e8e: Status 404 returned error can't find the container with id 5bdc1ce7f5672ce39c970b89035b823ae3e502c3a244864283182b16e68e3e8e Jun 02 18:47:21.666058 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.666026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.666163 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.666065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.666233 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.666212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkd5h\" (UniqueName: \"kubernetes.io/projected/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-kube-api-access-hkd5h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.767203 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.767145 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkd5h\" (UniqueName: \"kubernetes.io/projected/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-kube-api-access-hkd5h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.767203 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.767188 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.767383 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.767206 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.767549 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.767529 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.767598 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.767557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.774791 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.774772 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkd5h\" (UniqueName: \"kubernetes.io/projected/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-kube-api-access-hkd5h\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.886353 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.886317 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:21.972150 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.972119 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp"] Jun 02 18:47:21.977974 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.977949 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:21.981689 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:21.981656 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp"] Jun 02 18:47:22.022878 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.022855 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt"] Jun 02 18:47:22.025037 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:22.025007 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8e0c8f_50a9_4f69_aef3_f9a02638a608.slice/crio-41aff442b92e3c549ccfc09072d2e67d1ac522054b9c5686c488b2a73d5e0969 WatchSource:0}: Error finding container 41aff442b92e3c549ccfc09072d2e67d1ac522054b9c5686c488b2a73d5e0969: Status 404 returned error can't find the container with id 41aff442b92e3c549ccfc09072d2e67d1ac522054b9c5686c488b2a73d5e0969 Jun 02 18:47:22.069964 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.069934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.070087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.070013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.070087 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.070044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfxrh\" (UniqueName: \"kubernetes.io/projected/626f9246-c2f0-4df7-a26d-bc747f01ae4c-kube-api-access-cfxrh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.170731 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.170694 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.171112 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.170751 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfxrh\" (UniqueName: \"kubernetes.io/projected/626f9246-c2f0-4df7-a26d-bc747f01ae4c-kube-api-access-cfxrh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.171112 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.170799 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.171186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.171109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.171186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.171135 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.178800 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.178781 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfxrh\" (UniqueName: \"kubernetes.io/projected/626f9246-c2f0-4df7-a26d-bc747f01ae4c-kube-api-access-cfxrh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.290631 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.290541 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:22.371944 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.371894 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2"] Jun 02 18:47:22.377095 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.377072 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.383632 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.383608 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2"] Jun 02 18:47:22.426812 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.426791 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp"] Jun 02 18:47:22.428533 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:22.428502 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626f9246_c2f0_4df7_a26d_bc747f01ae4c.slice/crio-f506ccca3bb3e3d15581659ac76ff0082861b17c182c8def8b5e8d5edf927481 WatchSource:0}: Error finding container f506ccca3bb3e3d15581659ac76ff0082861b17c182c8def8b5e8d5edf927481: Status 404 returned error can't find the container with id f506ccca3bb3e3d15581659ac76ff0082861b17c182c8def8b5e8d5edf927481 Jun 02 18:47:22.473755 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.473726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.473906 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.473879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjdp\" (UniqueName: \"kubernetes.io/projected/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-kube-api-access-5pjdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.473986 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.473924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.482638 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.482542 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" event={"ID":"626f9246-c2f0-4df7-a26d-bc747f01ae4c","Type":"ContainerStarted","Data":"f506ccca3bb3e3d15581659ac76ff0082861b17c182c8def8b5e8d5edf927481"} Jun 02 18:47:22.483857 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.483810 2561 generic.go:358] "Generic (PLEG): container finished" podID="fc274027-e193-46eb-a267-50482e6d3ab8" containerID="b25b7f1fc615caa37dcfba16ea888e68c3844f84283b58cef7e9d69a60566f1a" exitCode=0 Jun 02 18:47:22.483956 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.483871 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" event={"ID":"fc274027-e193-46eb-a267-50482e6d3ab8","Type":"ContainerDied","Data":"b25b7f1fc615caa37dcfba16ea888e68c3844f84283b58cef7e9d69a60566f1a"} Jun 02 18:47:22.483956 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.483902 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" event={"ID":"fc274027-e193-46eb-a267-50482e6d3ab8","Type":"ContainerStarted","Data":"5bdc1ce7f5672ce39c970b89035b823ae3e502c3a244864283182b16e68e3e8e"} Jun 02 18:47:22.485267 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.485246 2561 generic.go:358] "Generic (PLEG): container finished" podID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerID="ebf36340ad81c8afccdef37f44950a2fcbcfda1913a3d22766012bdef71884f7" exitCode=0 Jun 02 18:47:22.485407 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.485275 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" event={"ID":"ec8e0c8f-50a9-4f69-aef3-f9a02638a608","Type":"ContainerDied","Data":"ebf36340ad81c8afccdef37f44950a2fcbcfda1913a3d22766012bdef71884f7"} Jun 02 18:47:22.485407 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.485305 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" event={"ID":"ec8e0c8f-50a9-4f69-aef3-f9a02638a608","Type":"ContainerStarted","Data":"41aff442b92e3c549ccfc09072d2e67d1ac522054b9c5686c488b2a73d5e0969"} Jun 02 18:47:22.574940 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.574859 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.575095 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.574956 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjdp\" (UniqueName: \"kubernetes.io/projected/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-kube-api-access-5pjdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.575095 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.575015 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.575269 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.575247 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.575340 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.575310 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.584159 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.584137 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjdp\" (UniqueName: \"kubernetes.io/projected/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-kube-api-access-5pjdp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.705217 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.705183 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:22.836118 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:22.836014 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2"] Jun 02 18:47:22.838173 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:22.838149 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1e5553_fef8_48ab_8ef8_9fb5b950a538.slice/crio-e86a997689c7a41e071aee022c1bfc7f43643d8ed60bf6bb886208eb6e0bbffd WatchSource:0}: Error finding container e86a997689c7a41e071aee022c1bfc7f43643d8ed60bf6bb886208eb6e0bbffd: Status 404 returned error can't find the container with id e86a997689c7a41e071aee022c1bfc7f43643d8ed60bf6bb886208eb6e0bbffd Jun 02 18:47:23.490436 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:23.490400 2561 generic.go:358] "Generic (PLEG): container finished" podID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerID="f12751cf9f6c2a6a58bb20bf4e2d01b86e31a8b464f655f10d955103624b9d83" exitCode=0 Jun 02 18:47:23.490823 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:23.490496 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" event={"ID":"626f9246-c2f0-4df7-a26d-bc747f01ae4c","Type":"ContainerDied","Data":"f12751cf9f6c2a6a58bb20bf4e2d01b86e31a8b464f655f10d955103624b9d83"} Jun 02 18:47:23.492171 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:23.492149 2561 generic.go:358] "Generic (PLEG): container finished" podID="fc274027-e193-46eb-a267-50482e6d3ab8" containerID="e0967d127caaf378b0245ab60a11a26b115a9a514d280207f3f7d4041ca74ddc" exitCode=0 Jun 02 18:47:23.492269 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:23.492233 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" event={"ID":"fc274027-e193-46eb-a267-50482e6d3ab8","Type":"ContainerDied","Data":"e0967d127caaf378b0245ab60a11a26b115a9a514d280207f3f7d4041ca74ddc"} Jun 02 18:47:23.493656 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:23.493634 2561 generic.go:358] "Generic (PLEG): container finished" podID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerID="1fa2dd0643dade1915c08dd803d7edd09f3b744b1ed1e44a5bf1cc10680234fb" exitCode=0 Jun 02 18:47:23.493757 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:23.493666 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" event={"ID":"7b1e5553-fef8-48ab-8ef8-9fb5b950a538","Type":"ContainerDied","Data":"1fa2dd0643dade1915c08dd803d7edd09f3b744b1ed1e44a5bf1cc10680234fb"} Jun 02 18:47:23.493757 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:23.493701 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" event={"ID":"7b1e5553-fef8-48ab-8ef8-9fb5b950a538","Type":"ContainerStarted","Data":"e86a997689c7a41e071aee022c1bfc7f43643d8ed60bf6bb886208eb6e0bbffd"} Jun 02 18:47:23.495500 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:23.495479 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" event={"ID":"ec8e0c8f-50a9-4f69-aef3-f9a02638a608","Type":"ContainerStarted","Data":"bfed94056cb493a7258c2ecf84cb5336816941c76bc574b317bd3a2d0e962e45"} Jun 02 18:47:24.501437 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.501400 2561 generic.go:358] "Generic (PLEG): container finished" podID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerID="49bdb9bdc5927fe37f3b93713c620255e079a5c7416eb8595f603f11fd55a57f" exitCode=0 Jun 02 18:47:24.501905 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.501499 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" event={"ID":"626f9246-c2f0-4df7-a26d-bc747f01ae4c","Type":"ContainerDied","Data":"49bdb9bdc5927fe37f3b93713c620255e079a5c7416eb8595f603f11fd55a57f"} Jun 02 18:47:24.503525 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.503503 2561 generic.go:358] "Generic (PLEG): container finished" podID="fc274027-e193-46eb-a267-50482e6d3ab8" containerID="f04cc4b60f82262b854b2d7ee5aff0b1a35eaf7edd461cc741bcac3219a8cf4f" exitCode=0 Jun 02 18:47:24.503650 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.503582 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" event={"ID":"fc274027-e193-46eb-a267-50482e6d3ab8","Type":"ContainerDied","Data":"f04cc4b60f82262b854b2d7ee5aff0b1a35eaf7edd461cc741bcac3219a8cf4f"} Jun 02 18:47:24.505260 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.505239 2561 generic.go:358] "Generic (PLEG): container finished" podID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerID="8deef47036197065d9eff8d89c598be52fb7459c795ab9b9eb74e2cf30fe7b21" exitCode=0 Jun 02 18:47:24.505346 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.505319 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" event={"ID":"7b1e5553-fef8-48ab-8ef8-9fb5b950a538","Type":"ContainerDied","Data":"8deef47036197065d9eff8d89c598be52fb7459c795ab9b9eb74e2cf30fe7b21"} Jun 02 18:47:24.507282 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.507257 2561 generic.go:358] "Generic (PLEG): container finished" podID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerID="bfed94056cb493a7258c2ecf84cb5336816941c76bc574b317bd3a2d0e962e45" exitCode=0 Jun 02 18:47:24.507282 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.507281 2561 generic.go:358] "Generic (PLEG): container finished" podID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerID="358dea1638c88c911268576f2b8f6c92fe8308f56043d7df971f59e85b30f3cc" exitCode=0 Jun 02 18:47:24.507417 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.507302 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" event={"ID":"ec8e0c8f-50a9-4f69-aef3-f9a02638a608","Type":"ContainerDied","Data":"bfed94056cb493a7258c2ecf84cb5336816941c76bc574b317bd3a2d0e962e45"} Jun 02 18:47:24.507417 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:24.507319 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" event={"ID":"ec8e0c8f-50a9-4f69-aef3-f9a02638a608","Type":"ContainerDied","Data":"358dea1638c88c911268576f2b8f6c92fe8308f56043d7df971f59e85b30f3cc"} Jun 02 18:47:25.512808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.512769 2561 generic.go:358] "Generic (PLEG): container finished" podID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerID="d0287b69697b74337a433a01ccecaff1f53f29d9dadf9e7526200ebdb856da1b" exitCode=0 Jun 02 18:47:25.513253 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.512866 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" event={"ID":"626f9246-c2f0-4df7-a26d-bc747f01ae4c","Type":"ContainerDied","Data":"d0287b69697b74337a433a01ccecaff1f53f29d9dadf9e7526200ebdb856da1b"} Jun 02 18:47:25.514769 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.514744 2561 generic.go:358] "Generic (PLEG): container finished" podID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerID="8e1f33e9953299fe8ae5c607ccbe516f20cc464504a29fce9923bc747023d598" exitCode=0 Jun 02 18:47:25.514919 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.514840 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" event={"ID":"7b1e5553-fef8-48ab-8ef8-9fb5b950a538","Type":"ContainerDied","Data":"8e1f33e9953299fe8ae5c607ccbe516f20cc464504a29fce9923bc747023d598"} Jun 02 18:47:25.670329 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.670308 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:25.673282 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.673264 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:25.807280 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.807246 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-util\") pod \"fc274027-e193-46eb-a267-50482e6d3ab8\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " Jun 02 18:47:25.807444 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.807339 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-bundle\") pod \"fc274027-e193-46eb-a267-50482e6d3ab8\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " Jun 02 18:47:25.807444 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.807365 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkd5h\" (UniqueName: \"kubernetes.io/projected/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-kube-api-access-hkd5h\") pod \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " Jun 02 18:47:25.807444 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.807400 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-886h5\" (UniqueName: \"kubernetes.io/projected/fc274027-e193-46eb-a267-50482e6d3ab8-kube-api-access-886h5\") pod \"fc274027-e193-46eb-a267-50482e6d3ab8\" (UID: \"fc274027-e193-46eb-a267-50482e6d3ab8\") " Jun 02 18:47:25.807620 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.807492 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-bundle\") pod \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " Jun 02 18:47:25.807620 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.807518 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-util\") pod \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\" (UID: \"ec8e0c8f-50a9-4f69-aef3-f9a02638a608\") " Jun 02 18:47:25.807984 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.807947 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-bundle" (OuterVolumeSpecName: "bundle") pod "fc274027-e193-46eb-a267-50482e6d3ab8" (UID: "fc274027-e193-46eb-a267-50482e6d3ab8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:47:25.807984 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.807944 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-bundle" (OuterVolumeSpecName: "bundle") pod "ec8e0c8f-50a9-4f69-aef3-f9a02638a608" (UID: "ec8e0c8f-50a9-4f69-aef3-f9a02638a608"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:47:25.809599 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.809570 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-kube-api-access-hkd5h" (OuterVolumeSpecName: "kube-api-access-hkd5h") pod "ec8e0c8f-50a9-4f69-aef3-f9a02638a608" (UID: "ec8e0c8f-50a9-4f69-aef3-f9a02638a608"). InnerVolumeSpecName "kube-api-access-hkd5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:47:25.810034 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.810013 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc274027-e193-46eb-a267-50482e6d3ab8-kube-api-access-886h5" (OuterVolumeSpecName: "kube-api-access-886h5") pod "fc274027-e193-46eb-a267-50482e6d3ab8" (UID: "fc274027-e193-46eb-a267-50482e6d3ab8"). InnerVolumeSpecName "kube-api-access-886h5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:47:25.812196 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.812173 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-util" (OuterVolumeSpecName: "util") pod "fc274027-e193-46eb-a267-50482e6d3ab8" (UID: "fc274027-e193-46eb-a267-50482e6d3ab8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:47:25.813436 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.813415 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-util" (OuterVolumeSpecName: "util") pod "ec8e0c8f-50a9-4f69-aef3-f9a02638a608" (UID: "ec8e0c8f-50a9-4f69-aef3-f9a02638a608"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:47:25.908775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.908705 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-886h5\" (UniqueName: \"kubernetes.io/projected/fc274027-e193-46eb-a267-50482e6d3ab8-kube-api-access-886h5\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:25.908775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.908732 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:25.908775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.908742 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:25.908775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.908749 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:25.908775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.908757 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc274027-e193-46eb-a267-50482e6d3ab8-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:25.908775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:25.908765 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkd5h\" (UniqueName: \"kubernetes.io/projected/ec8e0c8f-50a9-4f69-aef3-f9a02638a608-kube-api-access-hkd5h\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:26.520607 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.520566 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" event={"ID":"fc274027-e193-46eb-a267-50482e6d3ab8","Type":"ContainerDied","Data":"5bdc1ce7f5672ce39c970b89035b823ae3e502c3a244864283182b16e68e3e8e"} Jun 02 18:47:26.520607 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.520590 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5" Jun 02 18:47:26.520607 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.520605 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bdc1ce7f5672ce39c970b89035b823ae3e502c3a244864283182b16e68e3e8e" Jun 02 18:47:26.522359 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.522327 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" event={"ID":"ec8e0c8f-50a9-4f69-aef3-f9a02638a608","Type":"ContainerDied","Data":"41aff442b92e3c549ccfc09072d2e67d1ac522054b9c5686c488b2a73d5e0969"} Jun 02 18:47:26.522359 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.522335 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt" Jun 02 18:47:26.522561 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.522377 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41aff442b92e3c549ccfc09072d2e67d1ac522054b9c5686c488b2a73d5e0969" Jun 02 18:47:26.654212 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.654189 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:26.689065 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.689040 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:26.715537 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.715509 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-bundle\") pod \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " Jun 02 18:47:26.715688 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.715598 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pjdp\" (UniqueName: \"kubernetes.io/projected/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-kube-api-access-5pjdp\") pod \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " Jun 02 18:47:26.715688 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.715644 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-util\") pod \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\" (UID: \"7b1e5553-fef8-48ab-8ef8-9fb5b950a538\") " Jun 02 18:47:26.716346 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.716314 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-bundle" (OuterVolumeSpecName: "bundle") pod "7b1e5553-fef8-48ab-8ef8-9fb5b950a538" (UID: "7b1e5553-fef8-48ab-8ef8-9fb5b950a538"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:47:26.717917 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.717887 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-kube-api-access-5pjdp" (OuterVolumeSpecName: "kube-api-access-5pjdp") pod "7b1e5553-fef8-48ab-8ef8-9fb5b950a538" (UID: "7b1e5553-fef8-48ab-8ef8-9fb5b950a538"). InnerVolumeSpecName "kube-api-access-5pjdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:47:26.721366 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.721339 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-util" (OuterVolumeSpecName: "util") pod "7b1e5553-fef8-48ab-8ef8-9fb5b950a538" (UID: "7b1e5553-fef8-48ab-8ef8-9fb5b950a538"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:47:26.816859 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.816748 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-bundle\") pod \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " Jun 02 18:47:26.816859 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.816782 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfxrh\" (UniqueName: \"kubernetes.io/projected/626f9246-c2f0-4df7-a26d-bc747f01ae4c-kube-api-access-cfxrh\") pod \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " Jun 02 18:47:26.816859 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.816807 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-util\") pod \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\" (UID: \"626f9246-c2f0-4df7-a26d-bc747f01ae4c\") " Jun 02 18:47:26.817126 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.817045 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:26.817126 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.817063 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pjdp\" (UniqueName: \"kubernetes.io/projected/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-kube-api-access-5pjdp\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:26.817126 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.817073 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b1e5553-fef8-48ab-8ef8-9fb5b950a538-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:26.817330 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.817300 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-bundle" (OuterVolumeSpecName: "bundle") pod "626f9246-c2f0-4df7-a26d-bc747f01ae4c" (UID: "626f9246-c2f0-4df7-a26d-bc747f01ae4c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:47:26.818995 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.818973 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/626f9246-c2f0-4df7-a26d-bc747f01ae4c-kube-api-access-cfxrh" (OuterVolumeSpecName: "kube-api-access-cfxrh") pod "626f9246-c2f0-4df7-a26d-bc747f01ae4c" (UID: "626f9246-c2f0-4df7-a26d-bc747f01ae4c"). InnerVolumeSpecName "kube-api-access-cfxrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:47:26.822314 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.822285 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-util" (OuterVolumeSpecName: "util") pod "626f9246-c2f0-4df7-a26d-bc747f01ae4c" (UID: "626f9246-c2f0-4df7-a26d-bc747f01ae4c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:47:26.917942 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.917897 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:26.917942 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.917936 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfxrh\" (UniqueName: \"kubernetes.io/projected/626f9246-c2f0-4df7-a26d-bc747f01ae4c-kube-api-access-cfxrh\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:26.917942 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:26.917947 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/626f9246-c2f0-4df7-a26d-bc747f01ae4c-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:47:27.527419 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:27.527388 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" Jun 02 18:47:27.527419 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:27.527396 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2" event={"ID":"7b1e5553-fef8-48ab-8ef8-9fb5b950a538","Type":"ContainerDied","Data":"e86a997689c7a41e071aee022c1bfc7f43643d8ed60bf6bb886208eb6e0bbffd"} Jun 02 18:47:27.527944 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:27.527428 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e86a997689c7a41e071aee022c1bfc7f43643d8ed60bf6bb886208eb6e0bbffd" Jun 02 18:47:27.529231 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:27.529206 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" event={"ID":"626f9246-c2f0-4df7-a26d-bc747f01ae4c","Type":"ContainerDied","Data":"f506ccca3bb3e3d15581659ac76ff0082861b17c182c8def8b5e8d5edf927481"} Jun 02 18:47:27.529337 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:27.529236 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f506ccca3bb3e3d15581659ac76ff0082861b17c182c8def8b5e8d5edf927481" Jun 02 18:47:27.529337 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:27.529260 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp" Jun 02 18:47:36.121593 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.121560 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6885c9f4dc-xfxl5"] Jun 02 18:47:36.122173 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122157 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerName="extract" Jun 02 18:47:36.122232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122184 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerName="extract" Jun 02 18:47:36.122232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122195 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerName="extract" Jun 02 18:47:36.122232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122204 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerName="extract" Jun 02 18:47:36.122232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122226 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerName="util" Jun 02 18:47:36.122232 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122233 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerName="util" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122253 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerName="util" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122259 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerName="util" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122268 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerName="pull" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122278 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerName="pull" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122290 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc274027-e193-46eb-a267-50482e6d3ab8" containerName="extract" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122296 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc274027-e193-46eb-a267-50482e6d3ab8" containerName="extract" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122307 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc274027-e193-46eb-a267-50482e6d3ab8" containerName="pull" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122312 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc274027-e193-46eb-a267-50482e6d3ab8" containerName="pull" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122318 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerName="pull" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122323 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerName="pull" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122333 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerName="pull" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122338 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerName="pull" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122345 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc274027-e193-46eb-a267-50482e6d3ab8" containerName="util" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122350 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc274027-e193-46eb-a267-50482e6d3ab8" containerName="util" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122362 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerName="util" Jun 02 18:47:36.122371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122367 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerName="util" Jun 02 18:47:36.122808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122382 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerName="extract" Jun 02 18:47:36.122808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122387 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerName="extract" Jun 02 18:47:36.122808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122492 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="fc274027-e193-46eb-a267-50482e6d3ab8" containerName="extract" Jun 02 18:47:36.122808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122499 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec8e0c8f-50a9-4f69-aef3-f9a02638a608" containerName="extract" Jun 02 18:47:36.122808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122511 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="626f9246-c2f0-4df7-a26d-bc747f01ae4c" containerName="extract" Jun 02 18:47:36.122808 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.122524 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b1e5553-fef8-48ab-8ef8-9fb5b950a538" containerName="extract" Jun 02 18:47:36.126340 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.126315 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.135675 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.135650 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6885c9f4dc-xfxl5"] Jun 02 18:47:36.201497 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.201462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nzgc\" (UniqueName: \"kubernetes.io/projected/05198e5e-07bf-48d6-b467-50eb1308996d-kube-api-access-4nzgc\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.201642 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.201515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05198e5e-07bf-48d6-b467-50eb1308996d-console-oauth-config\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.201642 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.201534 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-trusted-ca-bundle\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.201764 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.201646 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-console-config\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.201764 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.201697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05198e5e-07bf-48d6-b467-50eb1308996d-console-serving-cert\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.201764 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.201725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-service-ca\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.201764 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.201751 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-oauth-serving-cert\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.302804 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.302775 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05198e5e-07bf-48d6-b467-50eb1308996d-console-serving-cert\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.302804 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.302807 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-service-ca\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.303000 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.302844 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-oauth-serving-cert\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.303000 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.302876 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nzgc\" (UniqueName: \"kubernetes.io/projected/05198e5e-07bf-48d6-b467-50eb1308996d-kube-api-access-4nzgc\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.303000 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.302914 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05198e5e-07bf-48d6-b467-50eb1308996d-console-oauth-config\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.303000 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.302931 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-trusted-ca-bundle\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.303000 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.302973 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-console-config\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.303529 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.303504 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-service-ca\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.303618 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.303600 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-oauth-serving-cert\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.303920 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.303899 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-console-config\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.304082 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.304060 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05198e5e-07bf-48d6-b467-50eb1308996d-trusted-ca-bundle\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.305501 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.305482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05198e5e-07bf-48d6-b467-50eb1308996d-console-serving-cert\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.305585 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.305513 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05198e5e-07bf-48d6-b467-50eb1308996d-console-oauth-config\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.309993 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.309972 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nzgc\" (UniqueName: \"kubernetes.io/projected/05198e5e-07bf-48d6-b467-50eb1308996d-kube-api-access-4nzgc\") pod \"console-6885c9f4dc-xfxl5\" (UID: \"05198e5e-07bf-48d6-b467-50eb1308996d\") " pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.436376 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.436320 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:36.569643 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:36.569616 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6885c9f4dc-xfxl5"] Jun 02 18:47:36.571543 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:36.571514 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05198e5e_07bf_48d6_b467_50eb1308996d.slice/crio-bc46ee19d0efa56bf138c7b4509502893c8eafc86253f5953f1fa40b2cf60f2a WatchSource:0}: Error finding container bc46ee19d0efa56bf138c7b4509502893c8eafc86253f5953f1fa40b2cf60f2a: Status 404 returned error can't find the container with id bc46ee19d0efa56bf138c7b4509502893c8eafc86253f5953f1fa40b2cf60f2a Jun 02 18:47:37.567695 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:37.567658 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6885c9f4dc-xfxl5" event={"ID":"05198e5e-07bf-48d6-b467-50eb1308996d","Type":"ContainerStarted","Data":"388597b1b7cccef23a8309702f48dc433715ca769ac6fb7a4eb39afd56d9b040"} Jun 02 18:47:37.567695 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:37.567696 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6885c9f4dc-xfxl5" event={"ID":"05198e5e-07bf-48d6-b467-50eb1308996d","Type":"ContainerStarted","Data":"bc46ee19d0efa56bf138c7b4509502893c8eafc86253f5953f1fa40b2cf60f2a"} Jun 02 18:47:37.588016 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:37.587974 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6885c9f4dc-xfxl5" podStartSLOduration=1.587960389 podStartE2EDuration="1.587960389s" podCreationTimestamp="2026-06-02 18:47:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:47:37.586354175 +0000 UTC m=+470.250192334" watchObservedRunningTime="2026-06-02 18:47:37.587960389 +0000 UTC m=+470.251798531" Jun 02 18:47:37.752302 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:37.752272 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tq5cv"] Jun 02 18:47:37.755758 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:37.755741 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" Jun 02 18:47:37.758553 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:37.758530 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5gp4j\"" Jun 02 18:47:37.769670 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:37.769649 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tq5cv"] Jun 02 18:47:37.916869 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:37.916763 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b4x8\" (UniqueName: \"kubernetes.io/projected/5b4c4e90-57e6-4739-8cd4-f720056a62be-kube-api-access-7b4x8\") pod \"authorino-operator-657f44b778-tq5cv\" (UID: \"5b4c4e90-57e6-4739-8cd4-f720056a62be\") " pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" Jun 02 18:47:38.018167 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:38.018133 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b4x8\" (UniqueName: \"kubernetes.io/projected/5b4c4e90-57e6-4739-8cd4-f720056a62be-kube-api-access-7b4x8\") pod \"authorino-operator-657f44b778-tq5cv\" (UID: \"5b4c4e90-57e6-4739-8cd4-f720056a62be\") " pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" Jun 02 18:47:38.027950 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:38.027927 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b4x8\" (UniqueName: \"kubernetes.io/projected/5b4c4e90-57e6-4739-8cd4-f720056a62be-kube-api-access-7b4x8\") pod \"authorino-operator-657f44b778-tq5cv\" (UID: \"5b4c4e90-57e6-4739-8cd4-f720056a62be\") " pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" Jun 02 18:47:38.066171 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:38.066150 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" Jun 02 18:47:38.203523 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:38.203499 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-tq5cv"] Jun 02 18:47:38.205757 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:38.205732 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4c4e90_57e6_4739_8cd4_f720056a62be.slice/crio-f2521d7de9e039b564e0fc441e4aa224425f5e6e07f71c9476adbbc6d446f006 WatchSource:0}: Error finding container f2521d7de9e039b564e0fc441e4aa224425f5e6e07f71c9476adbbc6d446f006: Status 404 returned error can't find the container with id f2521d7de9e039b564e0fc441e4aa224425f5e6e07f71c9476adbbc6d446f006 Jun 02 18:47:38.576092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:38.576059 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" event={"ID":"5b4c4e90-57e6-4739-8cd4-f720056a62be","Type":"ContainerStarted","Data":"f2521d7de9e039b564e0fc441e4aa224425f5e6e07f71c9476adbbc6d446f006"} Jun 02 18:47:40.585667 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:40.585629 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" event={"ID":"5b4c4e90-57e6-4739-8cd4-f720056a62be","Type":"ContainerStarted","Data":"a39c127929940e08ca069474d20b991f7044ecb7b78e03420cd8b295dd02a56d"} Jun 02 18:47:40.586004 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:40.585695 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" Jun 02 18:47:40.610872 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:40.610805 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" podStartSLOduration=1.402856277 podStartE2EDuration="3.610790854s" podCreationTimestamp="2026-06-02 18:47:37 +0000 UTC" firstStartedPulling="2026-06-02 18:47:38.208142619 +0000 UTC m=+470.871980739" lastFinishedPulling="2026-06-02 18:47:40.416077195 +0000 UTC m=+473.079915316" observedRunningTime="2026-06-02 18:47:40.607423591 +0000 UTC m=+473.271261733" watchObservedRunningTime="2026-06-02 18:47:40.610790854 +0000 UTC m=+473.274628996" Jun 02 18:47:46.437166 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:46.437135 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:46.437166 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:46.437174 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:46.441817 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:46.441794 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:46.611748 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:46.611720 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6885c9f4dc-xfxl5" Jun 02 18:47:46.734106 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:46.734075 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-998b7c4d8-ftfwl"] Jun 02 18:47:51.592466 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:51.592433 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-tq5cv" Jun 02 18:47:56.222124 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.222085 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s"] Jun 02 18:47:56.227328 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.227307 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.229892 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.229863 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 02 18:47:56.230028 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.229894 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cwcfj\"" Jun 02 18:47:56.230028 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.229912 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 02 18:47:56.235501 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.235162 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s"] Jun 02 18:47:56.274064 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.274024 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.274252 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.274072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.274252 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.274164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbbvm\" (UniqueName: \"kubernetes.io/projected/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-kube-api-access-cbbvm\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.375282 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.375241 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.375486 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.375387 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.375558 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.375497 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbbvm\" (UniqueName: \"kubernetes.io/projected/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-kube-api-access-cbbvm\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.375939 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.375918 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.378053 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.378028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.383433 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.383402 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbbvm\" (UniqueName: \"kubernetes.io/projected/07a2ca65-74e6-4cad-804a-7bdd5f7f1220-kube-api-access-cbbvm\") pod \"kuadrant-console-plugin-6cb54b5c86-kxj4s\" (UID: \"07a2ca65-74e6-4cad-804a-7bdd5f7f1220\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.538670 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.538588 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" Jun 02 18:47:56.668542 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:56.668515 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s"] Jun 02 18:47:56.670338 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:47:56.670310 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07a2ca65_74e6_4cad_804a_7bdd5f7f1220.slice/crio-31f2d4f381f26c3c61fc9303906735b4a39c4aa3ead740af9087c666ac70f52d WatchSource:0}: Error finding container 31f2d4f381f26c3c61fc9303906735b4a39c4aa3ead740af9087c666ac70f52d: Status 404 returned error can't find the container with id 31f2d4f381f26c3c61fc9303906735b4a39c4aa3ead740af9087c666ac70f52d Jun 02 18:47:57.651896 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:47:57.651856 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" event={"ID":"07a2ca65-74e6-4cad-804a-7bdd5f7f1220","Type":"ContainerStarted","Data":"31f2d4f381f26c3c61fc9303906735b4a39c4aa3ead740af9087c666ac70f52d"} Jun 02 18:48:11.759537 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:11.759473 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-998b7c4d8-ftfwl" podUID="cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" containerName="console" containerID="cri-o://a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb" gracePeriod=15 Jun 02 18:48:11.764596 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:11.764562 2561 patch_prober.go:28] interesting pod/console-998b7c4d8-ftfwl container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.22:8443/health\": read tcp 10.133.0.2:32826->10.133.0.22:8443: read: connection reset by peer" start-of-body= Jun 02 18:48:11.764742 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:11.764642 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-998b7c4d8-ftfwl" podUID="cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": read tcp 10.133.0.2:32826->10.133.0.22:8443: read: connection reset by peer" Jun 02 18:48:20.315897 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.315874 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-998b7c4d8-ftfwl_cebcf003-ea69-4ea5-84e1-066eaa2dbfe4/console/0.log" Jun 02 18:48:20.316184 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.315952 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:48:20.423088 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423016 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-config\") pod \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " Jun 02 18:48:20.423088 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423049 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-service-ca\") pod \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " Jun 02 18:48:20.423088 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423085 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-oauth-serving-cert\") pod \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " Jun 02 18:48:20.423336 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423130 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-oauth-config\") pod \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " Jun 02 18:48:20.423336 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423148 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-trusted-ca-bundle\") pod \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " Jun 02 18:48:20.423336 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423177 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-serving-cert\") pod \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " Jun 02 18:48:20.423336 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423224 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs7r4\" (UniqueName: \"kubernetes.io/projected/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-kube-api-access-fs7r4\") pod \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\" (UID: \"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4\") " Jun 02 18:48:20.423533 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423359 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-config" (OuterVolumeSpecName: "console-config") pod "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" (UID: "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:48:20.423533 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423468 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-service-ca" (OuterVolumeSpecName: "service-ca") pod "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" (UID: "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:48:20.423533 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423487 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" (UID: "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:48:20.423533 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423521 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" (UID: "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:48:20.423712 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.423527 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-config\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:48:20.425327 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.425304 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" (UID: "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:48:20.425455 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.425434 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" (UID: "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:48:20.425518 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.425498 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-kube-api-access-fs7r4" (OuterVolumeSpecName: "kube-api-access-fs7r4") pod "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" (UID: "cebcf003-ea69-4ea5-84e1-066eaa2dbfe4"). InnerVolumeSpecName "kube-api-access-fs7r4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:48:20.524794 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.524759 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-oauth-config\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:48:20.524794 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.524789 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-trusted-ca-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:48:20.524794 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.524802 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-console-serving-cert\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:48:20.525043 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.524814 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs7r4\" (UniqueName: \"kubernetes.io/projected/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-kube-api-access-fs7r4\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:48:20.525043 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.524845 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-service-ca\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:48:20.525043 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.524858 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4-oauth-serving-cert\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:48:20.753897 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.753861 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" event={"ID":"07a2ca65-74e6-4cad-804a-7bdd5f7f1220","Type":"ContainerStarted","Data":"6210480f4cc5a1c51c16fbc934a0d1e1e265fd3fb3177005cbe17871b7dbac95"} Jun 02 18:48:20.755082 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.755062 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-998b7c4d8-ftfwl_cebcf003-ea69-4ea5-84e1-066eaa2dbfe4/console/0.log" Jun 02 18:48:20.755197 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.755097 2561 generic.go:358] "Generic (PLEG): container finished" podID="cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" containerID="a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb" exitCode=2 Jun 02 18:48:20.755197 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.755128 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998b7c4d8-ftfwl" event={"ID":"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4","Type":"ContainerDied","Data":"a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb"} Jun 02 18:48:20.755197 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.755147 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-998b7c4d8-ftfwl" event={"ID":"cebcf003-ea69-4ea5-84e1-066eaa2dbfe4","Type":"ContainerDied","Data":"f067675f7cdd317362d4f3ea9fc320ac626582d5a62857a6232e639d9fb8e960"} Jun 02 18:48:20.755197 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.755161 2561 scope.go:117] "RemoveContainer" containerID="a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb" Jun 02 18:48:20.755197 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.755161 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-998b7c4d8-ftfwl" Jun 02 18:48:20.764284 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.764268 2561 scope.go:117] "RemoveContainer" containerID="a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb" Jun 02 18:48:20.764524 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:48:20.764507 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb\": container with ID starting with a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb not found: ID does not exist" containerID="a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb" Jun 02 18:48:20.764570 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.764533 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb"} err="failed to get container status \"a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb\": rpc error: code = NotFound desc = could not find container \"a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb\": container with ID starting with a8cfa51de7c3ecdd85bd0b9766d1af68fd7ce5a7f592e227c90daf8c5e4d2eeb not found: ID does not exist" Jun 02 18:48:20.775147 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.775105 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-kxj4s" podStartSLOduration=1.208671948 podStartE2EDuration="24.775093562s" podCreationTimestamp="2026-06-02 18:47:56 +0000 UTC" firstStartedPulling="2026-06-02 18:47:56.671653986 +0000 UTC m=+489.335492109" lastFinishedPulling="2026-06-02 18:48:20.23807559 +0000 UTC m=+512.901913723" observedRunningTime="2026-06-02 18:48:20.773065403 +0000 UTC m=+513.436903545" watchObservedRunningTime="2026-06-02 18:48:20.775093562 +0000 UTC m=+513.438931704" Jun 02 18:48:20.790152 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.790127 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-998b7c4d8-ftfwl"] Jun 02 18:48:20.796510 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:20.796486 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-998b7c4d8-ftfwl"] Jun 02 18:48:21.875178 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:21.875145 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" path="/var/lib/kubelet/pods/cebcf003-ea69-4ea5-84e1-066eaa2dbfe4/volumes" Jun 02 18:48:53.517910 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.517874 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:48:53.518349 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.518217 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" containerName="console" Jun 02 18:48:53.518349 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.518226 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" containerName="console" Jun 02 18:48:53.518349 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.518290 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="cebcf003-ea69-4ea5-84e1-066eaa2dbfe4" containerName="console" Jun 02 18:48:53.567138 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.567105 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:48:53.567138 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.567130 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:48:53.567333 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.567221 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:53.574055 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.574032 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 18:48:53.596148 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.596122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t2pc\" (UniqueName: \"kubernetes.io/projected/c85fde3d-d1f3-467c-bf39-1d25d7511b5c-kube-api-access-9t2pc\") pod \"limitador-limitador-78c99df468-vhscb\" (UID: \"c85fde3d-d1f3-467c-bf39-1d25d7511b5c\") " pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:53.596255 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.596158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c85fde3d-d1f3-467c-bf39-1d25d7511b5c-config-file\") pod \"limitador-limitador-78c99df468-vhscb\" (UID: \"c85fde3d-d1f3-467c-bf39-1d25d7511b5c\") " pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:53.696500 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.696471 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9t2pc\" (UniqueName: \"kubernetes.io/projected/c85fde3d-d1f3-467c-bf39-1d25d7511b5c-kube-api-access-9t2pc\") pod \"limitador-limitador-78c99df468-vhscb\" (UID: \"c85fde3d-d1f3-467c-bf39-1d25d7511b5c\") " pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:53.696615 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.696506 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c85fde3d-d1f3-467c-bf39-1d25d7511b5c-config-file\") pod \"limitador-limitador-78c99df468-vhscb\" (UID: \"c85fde3d-d1f3-467c-bf39-1d25d7511b5c\") " pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:53.697149 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.697128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c85fde3d-d1f3-467c-bf39-1d25d7511b5c-config-file\") pod \"limitador-limitador-78c99df468-vhscb\" (UID: \"c85fde3d-d1f3-467c-bf39-1d25d7511b5c\") " pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:53.711024 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.711002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t2pc\" (UniqueName: \"kubernetes.io/projected/c85fde3d-d1f3-467c-bf39-1d25d7511b5c-kube-api-access-9t2pc\") pod \"limitador-limitador-78c99df468-vhscb\" (UID: \"c85fde3d-d1f3-467c-bf39-1d25d7511b5c\") " pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:53.876721 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:53.876650 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:54.031474 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.031447 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:48:54.032385 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:48:54.032363 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85fde3d_d1f3_467c_bf39_1d25d7511b5c.slice/crio-6170a15586aee6234dfe3e4dc0b39a4b8f447f3584111193c242e4ea39031504 WatchSource:0}: Error finding container 6170a15586aee6234dfe3e4dc0b39a4b8f447f3584111193c242e4ea39031504: Status 404 returned error can't find the container with id 6170a15586aee6234dfe3e4dc0b39a4b8f447f3584111193c242e4ea39031504 Jun 02 18:48:54.263999 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.263972 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-c56qt"] Jun 02 18:48:54.268737 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.268720 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c56qt" Jun 02 18:48:54.272685 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.272656 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-98kwc\"" Jun 02 18:48:54.302358 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.302333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlssk\" (UniqueName: \"kubernetes.io/projected/2d0668f6-c47a-49a0-882a-78cc5c2fccf4-kube-api-access-zlssk\") pod \"authorino-7498df8756-c56qt\" (UID: \"2d0668f6-c47a-49a0-882a-78cc5c2fccf4\") " pod="kuadrant-system/authorino-7498df8756-c56qt" Jun 02 18:48:54.314090 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.314062 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-c56qt"] Jun 02 18:48:54.403637 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.403610 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlssk\" (UniqueName: \"kubernetes.io/projected/2d0668f6-c47a-49a0-882a-78cc5c2fccf4-kube-api-access-zlssk\") pod \"authorino-7498df8756-c56qt\" (UID: \"2d0668f6-c47a-49a0-882a-78cc5c2fccf4\") " pod="kuadrant-system/authorino-7498df8756-c56qt" Jun 02 18:48:54.416598 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.416578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlssk\" (UniqueName: \"kubernetes.io/projected/2d0668f6-c47a-49a0-882a-78cc5c2fccf4-kube-api-access-zlssk\") pod \"authorino-7498df8756-c56qt\" (UID: \"2d0668f6-c47a-49a0-882a-78cc5c2fccf4\") " pod="kuadrant-system/authorino-7498df8756-c56qt" Jun 02 18:48:54.578071 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.577572 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c56qt" Jun 02 18:48:54.772520 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.771343 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-c56qt"] Jun 02 18:48:54.776131 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:48:54.774893 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d0668f6_c47a_49a0_882a_78cc5c2fccf4.slice/crio-2f0debe46e65ed92bf4b45b382be382070146aed5b6d5811a75e124877c4223e WatchSource:0}: Error finding container 2f0debe46e65ed92bf4b45b382be382070146aed5b6d5811a75e124877c4223e: Status 404 returned error can't find the container with id 2f0debe46e65ed92bf4b45b382be382070146aed5b6d5811a75e124877c4223e Jun 02 18:48:54.883854 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.883742 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" event={"ID":"c85fde3d-d1f3-467c-bf39-1d25d7511b5c","Type":"ContainerStarted","Data":"6170a15586aee6234dfe3e4dc0b39a4b8f447f3584111193c242e4ea39031504"} Jun 02 18:48:54.884968 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:54.884941 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c56qt" event={"ID":"2d0668f6-c47a-49a0-882a-78cc5c2fccf4","Type":"ContainerStarted","Data":"2f0debe46e65ed92bf4b45b382be382070146aed5b6d5811a75e124877c4223e"} Jun 02 18:48:58.903134 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:58.903033 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" event={"ID":"c85fde3d-d1f3-467c-bf39-1d25d7511b5c","Type":"ContainerStarted","Data":"a45b4e624dbc39ba154c968e9299c34caab21da81b8f0844c76c48e443185e77"} Jun 02 18:48:58.903134 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:58.903106 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:48:58.904434 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:58.904407 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c56qt" event={"ID":"2d0668f6-c47a-49a0-882a-78cc5c2fccf4","Type":"ContainerStarted","Data":"114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b"} Jun 02 18:48:58.927408 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:58.927359 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" podStartSLOduration=1.38449552 podStartE2EDuration="5.927345253s" podCreationTimestamp="2026-06-02 18:48:53 +0000 UTC" firstStartedPulling="2026-06-02 18:48:54.034253433 +0000 UTC m=+546.698091553" lastFinishedPulling="2026-06-02 18:48:58.577103149 +0000 UTC m=+551.240941286" observedRunningTime="2026-06-02 18:48:58.925881807 +0000 UTC m=+551.589719946" watchObservedRunningTime="2026-06-02 18:48:58.927345253 +0000 UTC m=+551.591183395" Jun 02 18:48:58.945619 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:48:58.945512 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-c56qt" podStartSLOduration=1.142278234 podStartE2EDuration="4.945496394s" podCreationTimestamp="2026-06-02 18:48:54 +0000 UTC" firstStartedPulling="2026-06-02 18:48:54.77631877 +0000 UTC m=+547.440156892" lastFinishedPulling="2026-06-02 18:48:58.579536911 +0000 UTC m=+551.243375052" observedRunningTime="2026-06-02 18:48:58.944048287 +0000 UTC m=+551.607886428" watchObservedRunningTime="2026-06-02 18:48:58.945496394 +0000 UTC m=+551.609334537" Jun 02 18:49:09.909494 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:09.909463 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-vhscb" Jun 02 18:49:30.474753 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.474719 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf"] Jun 02 18:49:30.481667 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.481649 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.484626 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.484604 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j9cn5\"" Jun 02 18:49:30.485006 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.484989 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 18:49:30.485607 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.485580 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 18:49:30.495805 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.495783 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf"] Jun 02 18:49:30.520153 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.520128 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.520267 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.520164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.520267 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.520203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kz6t\" (UniqueName: \"kubernetes.io/projected/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-kube-api-access-2kz6t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.620854 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.620792 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.621035 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.620876 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.621035 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.620939 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kz6t\" (UniqueName: \"kubernetes.io/projected/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-kube-api-access-2kz6t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.621264 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.621237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.621324 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.621249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.634105 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.634074 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kz6t\" (UniqueName: \"kubernetes.io/projected/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-kube-api-access-2kz6t\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.791598 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.791520 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:30.936967 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:30.936935 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf"] Jun 02 18:49:30.945328 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:49:30.945282 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b5b17b_ac5e_4a3f_b138_4a995c7354cc.slice/crio-939e28069038ee24ebcf77caffc66f041dc31fcdbcda2ab25060cd211705969d WatchSource:0}: Error finding container 939e28069038ee24ebcf77caffc66f041dc31fcdbcda2ab25060cd211705969d: Status 404 returned error can't find the container with id 939e28069038ee24ebcf77caffc66f041dc31fcdbcda2ab25060cd211705969d Jun 02 18:49:31.031070 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:31.031042 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" event={"ID":"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc","Type":"ContainerStarted","Data":"3f9594c89e2d21c29c9e7f7b839c0f2a4cb8f2ecb4f7f2fd7da655a30787b215"} Jun 02 18:49:31.031181 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:31.031083 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" event={"ID":"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc","Type":"ContainerStarted","Data":"939e28069038ee24ebcf77caffc66f041dc31fcdbcda2ab25060cd211705969d"} Jun 02 18:49:32.035386 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:32.035349 2561 generic.go:358] "Generic (PLEG): container finished" podID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerID="3f9594c89e2d21c29c9e7f7b839c0f2a4cb8f2ecb4f7f2fd7da655a30787b215" exitCode=0 Jun 02 18:49:32.035866 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:32.035401 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" event={"ID":"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc","Type":"ContainerDied","Data":"3f9594c89e2d21c29c9e7f7b839c0f2a4cb8f2ecb4f7f2fd7da655a30787b215"} Jun 02 18:49:34.050224 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:34.050190 2561 generic.go:358] "Generic (PLEG): container finished" podID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerID="4e0c85f25da96c26a61149481b9b02c5804509afe9ce1d5b542f56779c47e6e0" exitCode=0 Jun 02 18:49:34.050601 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:34.050256 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" event={"ID":"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc","Type":"ContainerDied","Data":"4e0c85f25da96c26a61149481b9b02c5804509afe9ce1d5b542f56779c47e6e0"} Jun 02 18:49:35.056118 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:35.056074 2561 generic.go:358] "Generic (PLEG): container finished" podID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerID="f0099f6d013ea28710f014ae240da43692c207f0b3c7587247f52ea953ff6f38" exitCode=0 Jun 02 18:49:35.056469 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:35.056155 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" event={"ID":"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc","Type":"ContainerDied","Data":"f0099f6d013ea28710f014ae240da43692c207f0b3c7587247f52ea953ff6f38"} Jun 02 18:49:36.194585 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.194562 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:36.262534 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.262508 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kz6t\" (UniqueName: \"kubernetes.io/projected/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-kube-api-access-2kz6t\") pod \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " Jun 02 18:49:36.262675 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.262564 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-util\") pod \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " Jun 02 18:49:36.262675 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.262600 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-bundle\") pod \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\" (UID: \"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc\") " Jun 02 18:49:36.263186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.263159 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-bundle" (OuterVolumeSpecName: "bundle") pod "a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" (UID: "a1b5b17b-ac5e-4a3f-b138-4a995c7354cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:49:36.264869 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.264820 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-kube-api-access-2kz6t" (OuterVolumeSpecName: "kube-api-access-2kz6t") pod "a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" (UID: "a1b5b17b-ac5e-4a3f-b138-4a995c7354cc"). InnerVolumeSpecName "kube-api-access-2kz6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:49:36.268692 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.268671 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-util" (OuterVolumeSpecName: "util") pod "a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" (UID: "a1b5b17b-ac5e-4a3f-b138-4a995c7354cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:49:36.363790 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.363720 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kz6t\" (UniqueName: \"kubernetes.io/projected/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-kube-api-access-2kz6t\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:49:36.363790 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.363746 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-util\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:49:36.363790 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:36.363760 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1b5b17b-ac5e-4a3f-b138-4a995c7354cc-bundle\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:49:37.065652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:37.065611 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" event={"ID":"a1b5b17b-ac5e-4a3f-b138-4a995c7354cc","Type":"ContainerDied","Data":"939e28069038ee24ebcf77caffc66f041dc31fcdbcda2ab25060cd211705969d"} Jun 02 18:49:37.065652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:37.065653 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="939e28069038ee24ebcf77caffc66f041dc31fcdbcda2ab25060cd211705969d" Jun 02 18:49:37.065871 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:37.065660 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70clqwf" Jun 02 18:49:47.941535 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:47.941427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:49:47.961706 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:49:47.942106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:50:27.688458 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.688421 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-czxrs"] Jun 02 18:50:27.688902 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.688797 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerName="pull" Jun 02 18:50:27.688902 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.688809 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerName="pull" Jun 02 18:50:27.688902 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.688818 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerName="util" Jun 02 18:50:27.688902 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.688823 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerName="util" Jun 02 18:50:27.688902 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.688854 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerName="extract" Jun 02 18:50:27.688902 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.688860 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerName="extract" Jun 02 18:50:27.689092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.688917 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1b5b17b-ac5e-4a3f-b138-4a995c7354cc" containerName="extract" Jun 02 18:50:27.691905 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.691885 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-czxrs" Jun 02 18:50:27.702716 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.702690 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-czxrs"] Jun 02 18:50:27.802652 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.802616 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjnvw\" (UniqueName: \"kubernetes.io/projected/5f7395f4-1536-4002-a84f-5b726f22cc12-kube-api-access-zjnvw\") pod \"authorino-8b475cf9f-czxrs\" (UID: \"5f7395f4-1536-4002-a84f-5b726f22cc12\") " pod="kuadrant-system/authorino-8b475cf9f-czxrs" Jun 02 18:50:27.903405 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.903365 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjnvw\" (UniqueName: \"kubernetes.io/projected/5f7395f4-1536-4002-a84f-5b726f22cc12-kube-api-access-zjnvw\") pod \"authorino-8b475cf9f-czxrs\" (UID: \"5f7395f4-1536-4002-a84f-5b726f22cc12\") " pod="kuadrant-system/authorino-8b475cf9f-czxrs" Jun 02 18:50:27.913915 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.913884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjnvw\" (UniqueName: \"kubernetes.io/projected/5f7395f4-1536-4002-a84f-5b726f22cc12-kube-api-access-zjnvw\") pod \"authorino-8b475cf9f-czxrs\" (UID: \"5f7395f4-1536-4002-a84f-5b726f22cc12\") " pod="kuadrant-system/authorino-8b475cf9f-czxrs" Jun 02 18:50:27.925778 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.925756 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-czxrs"] Jun 02 18:50:27.926010 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.925997 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-czxrs" Jun 02 18:50:27.967565 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.967531 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59d8f86b97-rxvlh"] Jun 02 18:50:27.972444 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.972419 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d8f86b97-rxvlh" Jun 02 18:50:27.987559 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:27.987533 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59d8f86b97-rxvlh"] Jun 02 18:50:28.004570 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.004542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj5vr\" (UniqueName: \"kubernetes.io/projected/9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67-kube-api-access-bj5vr\") pod \"authorino-59d8f86b97-rxvlh\" (UID: \"9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67\") " pod="kuadrant-system/authorino-59d8f86b97-rxvlh" Jun 02 18:50:28.077509 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.077483 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-czxrs"] Jun 02 18:50:28.080014 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:50:28.079981 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f7395f4_1536_4002_a84f_5b726f22cc12.slice/crio-db4ffb95a2662f7994ac9b13dd94b50afdb862e21acab8e9fd86a3af6a962fe9 WatchSource:0}: Error finding container db4ffb95a2662f7994ac9b13dd94b50afdb862e21acab8e9fd86a3af6a962fe9: Status 404 returned error can't find the container with id db4ffb95a2662f7994ac9b13dd94b50afdb862e21acab8e9fd86a3af6a962fe9 Jun 02 18:50:28.082022 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.082003 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:50:28.085081 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.085058 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59d8f86b97-rxvlh"] Jun 02 18:50:28.085397 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:50:28.085374 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bj5vr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-59d8f86b97-rxvlh" podUID="9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67" Jun 02 18:50:28.105804 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.105775 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bj5vr\" (UniqueName: \"kubernetes.io/projected/9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67-kube-api-access-bj5vr\") pod \"authorino-59d8f86b97-rxvlh\" (UID: \"9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67\") " pod="kuadrant-system/authorino-59d8f86b97-rxvlh" Jun 02 18:50:28.108189 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.108169 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-668b466cb5-nvlf7"] Jun 02 18:50:28.111497 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.111481 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:50:28.113931 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.113915 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 18:50:28.118382 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.118358 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-668b466cb5-nvlf7"] Jun 02 18:50:28.119938 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.119914 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj5vr\" (UniqueName: \"kubernetes.io/projected/9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67-kube-api-access-bj5vr\") pod \"authorino-59d8f86b97-rxvlh\" (UID: \"9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67\") " pod="kuadrant-system/authorino-59d8f86b97-rxvlh" Jun 02 18:50:28.207085 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.207052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf520d0-9549-4b88-acb3-4c4656188df2-tls-cert\") pod \"authorino-668b466cb5-nvlf7\" (UID: \"faf520d0-9549-4b88-acb3-4c4656188df2\") " pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:50:28.207251 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.207152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5zrh\" (UniqueName: \"kubernetes.io/projected/faf520d0-9549-4b88-acb3-4c4656188df2-kube-api-access-n5zrh\") pod \"authorino-668b466cb5-nvlf7\" (UID: \"faf520d0-9549-4b88-acb3-4c4656188df2\") " pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:50:28.257818 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.257740 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-czxrs" event={"ID":"5f7395f4-1536-4002-a84f-5b726f22cc12","Type":"ContainerStarted","Data":"db4ffb95a2662f7994ac9b13dd94b50afdb862e21acab8e9fd86a3af6a962fe9"} Jun 02 18:50:28.257977 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.257823 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d8f86b97-rxvlh" Jun 02 18:50:28.262084 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.262064 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d8f86b97-rxvlh" Jun 02 18:50:28.308522 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.308494 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj5vr\" (UniqueName: \"kubernetes.io/projected/9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67-kube-api-access-bj5vr\") pod \"9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67\" (UID: \"9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67\") " Jun 02 18:50:28.308696 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.308683 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf520d0-9549-4b88-acb3-4c4656188df2-tls-cert\") pod \"authorino-668b466cb5-nvlf7\" (UID: \"faf520d0-9549-4b88-acb3-4c4656188df2\") " pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:50:28.308764 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.308752 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5zrh\" (UniqueName: \"kubernetes.io/projected/faf520d0-9549-4b88-acb3-4c4656188df2-kube-api-access-n5zrh\") pod \"authorino-668b466cb5-nvlf7\" (UID: \"faf520d0-9549-4b88-acb3-4c4656188df2\") " pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:50:28.310734 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.310710 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67-kube-api-access-bj5vr" (OuterVolumeSpecName: "kube-api-access-bj5vr") pod "9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67" (UID: "9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67"). InnerVolumeSpecName "kube-api-access-bj5vr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:50:28.311117 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.311099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf520d0-9549-4b88-acb3-4c4656188df2-tls-cert\") pod \"authorino-668b466cb5-nvlf7\" (UID: \"faf520d0-9549-4b88-acb3-4c4656188df2\") " pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:50:28.317670 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.317649 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5zrh\" (UniqueName: \"kubernetes.io/projected/faf520d0-9549-4b88-acb3-4c4656188df2-kube-api-access-n5zrh\") pod \"authorino-668b466cb5-nvlf7\" (UID: \"faf520d0-9549-4b88-acb3-4c4656188df2\") " pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:50:28.410097 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.410071 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj5vr\" (UniqueName: \"kubernetes.io/projected/9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67-kube-api-access-bj5vr\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:50:28.430092 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.430064 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:50:28.571364 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:28.571340 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-668b466cb5-nvlf7"] Jun 02 18:50:28.573273 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:50:28.573248 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaf520d0_9549_4b88_acb3_4c4656188df2.slice/crio-5d7d94917d2e20f22606bfe9159315937417af4bcd21266f89964bb823da4a08 WatchSource:0}: Error finding container 5d7d94917d2e20f22606bfe9159315937417af4bcd21266f89964bb823da4a08: Status 404 returned error can't find the container with id 5d7d94917d2e20f22606bfe9159315937417af4bcd21266f89964bb823da4a08 Jun 02 18:50:29.265183 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.265145 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668b466cb5-nvlf7" event={"ID":"faf520d0-9549-4b88-acb3-4c4656188df2","Type":"ContainerStarted","Data":"e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5"} Jun 02 18:50:29.265640 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.265189 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668b466cb5-nvlf7" event={"ID":"faf520d0-9549-4b88-acb3-4c4656188df2","Type":"ContainerStarted","Data":"5d7d94917d2e20f22606bfe9159315937417af4bcd21266f89964bb823da4a08"} Jun 02 18:50:29.266470 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.266443 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-czxrs" event={"ID":"5f7395f4-1536-4002-a84f-5b726f22cc12","Type":"ContainerStarted","Data":"08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce"} Jun 02 18:50:29.266578 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.266465 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-czxrs" podUID="5f7395f4-1536-4002-a84f-5b726f22cc12" containerName="authorino" containerID="cri-o://08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce" gracePeriod=30 Jun 02 18:50:29.266578 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.266503 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59d8f86b97-rxvlh" Jun 02 18:50:29.300693 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.300651 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-668b466cb5-nvlf7" podStartSLOduration=1.011455102 podStartE2EDuration="1.300637579s" podCreationTimestamp="2026-06-02 18:50:28 +0000 UTC" firstStartedPulling="2026-06-02 18:50:28.574533589 +0000 UTC m=+641.238371709" lastFinishedPulling="2026-06-02 18:50:28.863716067 +0000 UTC m=+641.527554186" observedRunningTime="2026-06-02 18:50:29.298557569 +0000 UTC m=+641.962395710" watchObservedRunningTime="2026-06-02 18:50:29.300637579 +0000 UTC m=+641.964475715" Jun 02 18:50:29.366588 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.366540 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-czxrs" podStartSLOduration=1.9746670160000002 podStartE2EDuration="2.366522618s" podCreationTimestamp="2026-06-02 18:50:27 +0000 UTC" firstStartedPulling="2026-06-02 18:50:28.082175768 +0000 UTC m=+640.746013888" lastFinishedPulling="2026-06-02 18:50:28.474031351 +0000 UTC m=+641.137869490" observedRunningTime="2026-06-02 18:50:29.34143543 +0000 UTC m=+642.005273553" watchObservedRunningTime="2026-06-02 18:50:29.366522618 +0000 UTC m=+642.030360762" Jun 02 18:50:29.367177 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.367158 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-c56qt"] Jun 02 18:50:29.367367 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.367349 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-c56qt" podUID="2d0668f6-c47a-49a0-882a-78cc5c2fccf4" containerName="authorino" containerID="cri-o://114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b" gracePeriod=30 Jun 02 18:50:29.421334 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.421295 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59d8f86b97-rxvlh"] Jun 02 18:50:29.430710 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.430675 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59d8f86b97-rxvlh"] Jun 02 18:50:29.528566 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.528503 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-czxrs" Jun 02 18:50:29.621249 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.621202 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjnvw\" (UniqueName: \"kubernetes.io/projected/5f7395f4-1536-4002-a84f-5b726f22cc12-kube-api-access-zjnvw\") pod \"5f7395f4-1536-4002-a84f-5b726f22cc12\" (UID: \"5f7395f4-1536-4002-a84f-5b726f22cc12\") " Jun 02 18:50:29.623451 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.623416 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7395f4-1536-4002-a84f-5b726f22cc12-kube-api-access-zjnvw" (OuterVolumeSpecName: "kube-api-access-zjnvw") pod "5f7395f4-1536-4002-a84f-5b726f22cc12" (UID: "5f7395f4-1536-4002-a84f-5b726f22cc12"). InnerVolumeSpecName "kube-api-access-zjnvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:50:29.628452 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.628435 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c56qt" Jun 02 18:50:29.722482 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.722441 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlssk\" (UniqueName: \"kubernetes.io/projected/2d0668f6-c47a-49a0-882a-78cc5c2fccf4-kube-api-access-zlssk\") pod \"2d0668f6-c47a-49a0-882a-78cc5c2fccf4\" (UID: \"2d0668f6-c47a-49a0-882a-78cc5c2fccf4\") " Jun 02 18:50:29.722686 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.722666 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjnvw\" (UniqueName: \"kubernetes.io/projected/5f7395f4-1536-4002-a84f-5b726f22cc12-kube-api-access-zjnvw\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:50:29.724615 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.724585 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d0668f6-c47a-49a0-882a-78cc5c2fccf4-kube-api-access-zlssk" (OuterVolumeSpecName: "kube-api-access-zlssk") pod "2d0668f6-c47a-49a0-882a-78cc5c2fccf4" (UID: "2d0668f6-c47a-49a0-882a-78cc5c2fccf4"). InnerVolumeSpecName "kube-api-access-zlssk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:50:29.823244 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.823155 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlssk\" (UniqueName: \"kubernetes.io/projected/2d0668f6-c47a-49a0-882a-78cc5c2fccf4-kube-api-access-zlssk\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:50:29.875024 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:29.874987 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67" path="/var/lib/kubelet/pods/9d9f4ce6-dfe6-459f-b4ff-7efcd0e09e67/volumes" Jun 02 18:50:30.271647 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.271608 2561 generic.go:358] "Generic (PLEG): container finished" podID="2d0668f6-c47a-49a0-882a-78cc5c2fccf4" containerID="114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b" exitCode=0 Jun 02 18:50:30.272105 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.271661 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-c56qt" Jun 02 18:50:30.272105 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.271690 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c56qt" event={"ID":"2d0668f6-c47a-49a0-882a-78cc5c2fccf4","Type":"ContainerDied","Data":"114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b"} Jun 02 18:50:30.272105 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.271730 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-c56qt" event={"ID":"2d0668f6-c47a-49a0-882a-78cc5c2fccf4","Type":"ContainerDied","Data":"2f0debe46e65ed92bf4b45b382be382070146aed5b6d5811a75e124877c4223e"} Jun 02 18:50:30.272105 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.271746 2561 scope.go:117] "RemoveContainer" containerID="114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b" Jun 02 18:50:30.273096 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.273077 2561 generic.go:358] "Generic (PLEG): container finished" podID="5f7395f4-1536-4002-a84f-5b726f22cc12" containerID="08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce" exitCode=0 Jun 02 18:50:30.273186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.273131 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-czxrs" event={"ID":"5f7395f4-1536-4002-a84f-5b726f22cc12","Type":"ContainerDied","Data":"08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce"} Jun 02 18:50:30.273186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.273153 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-czxrs" Jun 02 18:50:30.273186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.273159 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-czxrs" event={"ID":"5f7395f4-1536-4002-a84f-5b726f22cc12","Type":"ContainerDied","Data":"db4ffb95a2662f7994ac9b13dd94b50afdb862e21acab8e9fd86a3af6a962fe9"} Jun 02 18:50:30.280745 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.280729 2561 scope.go:117] "RemoveContainer" containerID="114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b" Jun 02 18:50:30.281026 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:50:30.281007 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b\": container with ID starting with 114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b not found: ID does not exist" containerID="114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b" Jun 02 18:50:30.281098 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.281033 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b"} err="failed to get container status \"114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b\": rpc error: code = NotFound desc = could not find container \"114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b\": container with ID starting with 114027be08a6bb21cd42ac4dbf4feb68e3fa8c54bac30a10d9d5f0af7d29cf3b not found: ID does not exist" Jun 02 18:50:30.281098 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.281051 2561 scope.go:117] "RemoveContainer" containerID="08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce" Jun 02 18:50:30.288814 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.288801 2561 scope.go:117] "RemoveContainer" containerID="08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce" Jun 02 18:50:30.289078 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:50:30.289062 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce\": container with ID starting with 08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce not found: ID does not exist" containerID="08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce" Jun 02 18:50:30.289139 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.289094 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce"} err="failed to get container status \"08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce\": rpc error: code = NotFound desc = could not find container \"08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce\": container with ID starting with 08ae708f87384060a7d4ec446a02169a65b2c69a1f2451e940749879500547ce not found: ID does not exist" Jun 02 18:50:30.299488 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.299469 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-c56qt"] Jun 02 18:50:30.308662 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.308644 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-c56qt"] Jun 02 18:50:30.343419 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.343393 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-czxrs"] Jun 02 18:50:30.345572 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:30.345552 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-czxrs"] Jun 02 18:50:31.874899 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:31.874868 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d0668f6-c47a-49a0-882a-78cc5c2fccf4" path="/var/lib/kubelet/pods/2d0668f6-c47a-49a0-882a-78cc5c2fccf4/volumes" Jun 02 18:50:31.875351 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:50:31.875169 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f7395f4-1536-4002-a84f-5b726f22cc12" path="/var/lib/kubelet/pods/5f7395f4-1536-4002-a84f-5b726f22cc12/volumes" Jun 02 18:51:10.488028 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:10.487983 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:51:58.261569 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.261535 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d697878ff-r9grx"] Jun 02 18:51:58.262056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.261904 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7395f4-1536-4002-a84f-5b726f22cc12" containerName="authorino" Jun 02 18:51:58.262056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.261916 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7395f4-1536-4002-a84f-5b726f22cc12" containerName="authorino" Jun 02 18:51:58.262056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.261930 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d0668f6-c47a-49a0-882a-78cc5c2fccf4" containerName="authorino" Jun 02 18:51:58.262056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.261935 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d0668f6-c47a-49a0-882a-78cc5c2fccf4" containerName="authorino" Jun 02 18:51:58.262056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.261995 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f7395f4-1536-4002-a84f-5b726f22cc12" containerName="authorino" Jun 02 18:51:58.262056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.262005 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d0668f6-c47a-49a0-882a-78cc5c2fccf4" containerName="authorino" Jun 02 18:51:58.264990 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.264975 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.267297 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.267274 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 18:51:58.272756 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.272730 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d697878ff-r9grx"] Jun 02 18:51:58.372166 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.372137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f88j9\" (UniqueName: \"kubernetes.io/projected/c5e4d091-e5b7-4845-9656-aee7d07f100c-kube-api-access-f88j9\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.372304 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.372179 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c5e4d091-e5b7-4845-9656-aee7d07f100c-oidc-ca\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.372304 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.372262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5e4d091-e5b7-4845-9656-aee7d07f100c-tls-cert\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.473149 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.473119 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5e4d091-e5b7-4845-9656-aee7d07f100c-tls-cert\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.473297 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.473163 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f88j9\" (UniqueName: \"kubernetes.io/projected/c5e4d091-e5b7-4845-9656-aee7d07f100c-kube-api-access-f88j9\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.473297 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.473206 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c5e4d091-e5b7-4845-9656-aee7d07f100c-oidc-ca\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.473921 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.473888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c5e4d091-e5b7-4845-9656-aee7d07f100c-oidc-ca\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.475676 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.475654 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5e4d091-e5b7-4845-9656-aee7d07f100c-tls-cert\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.484440 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.484415 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f88j9\" (UniqueName: \"kubernetes.io/projected/c5e4d091-e5b7-4845-9656-aee7d07f100c-kube-api-access-f88j9\") pod \"authorino-7d697878ff-r9grx\" (UID: \"c5e4d091-e5b7-4845-9656-aee7d07f100c\") " pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.575415 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.575346 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d697878ff-r9grx" Jun 02 18:51:58.706363 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:58.706231 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d697878ff-r9grx"] Jun 02 18:51:58.709101 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:51:58.709074 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5e4d091_e5b7_4845_9656_aee7d07f100c.slice/crio-38fef13110698a452a2696572a784110cb25c123d051a81130319a98186e431e WatchSource:0}: Error finding container 38fef13110698a452a2696572a784110cb25c123d051a81130319a98186e431e: Status 404 returned error can't find the container with id 38fef13110698a452a2696572a784110cb25c123d051a81130319a98186e431e Jun 02 18:51:59.626717 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:59.626672 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d697878ff-r9grx" event={"ID":"c5e4d091-e5b7-4845-9656-aee7d07f100c","Type":"ContainerStarted","Data":"932e76f88834c4f6565374dda112c149c8aa17217b2f9ec67cfff573d067b171"} Jun 02 18:51:59.626717 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:59.626718 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d697878ff-r9grx" event={"ID":"c5e4d091-e5b7-4845-9656-aee7d07f100c","Type":"ContainerStarted","Data":"38fef13110698a452a2696572a784110cb25c123d051a81130319a98186e431e"} Jun 02 18:51:59.648824 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:59.648773 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7d697878ff-r9grx" podStartSLOduration=1.2767663439999999 podStartE2EDuration="1.648758126s" podCreationTimestamp="2026-06-02 18:51:58 +0000 UTC" firstStartedPulling="2026-06-02 18:51:58.710409774 +0000 UTC m=+731.374247893" lastFinishedPulling="2026-06-02 18:51:59.082401551 +0000 UTC m=+731.746239675" observedRunningTime="2026-06-02 18:51:59.646272729 +0000 UTC m=+732.310110870" watchObservedRunningTime="2026-06-02 18:51:59.648758126 +0000 UTC m=+732.312596265" Jun 02 18:51:59.694249 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:59.694208 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-668b466cb5-nvlf7"] Jun 02 18:51:59.694507 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:59.694479 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-668b466cb5-nvlf7" podUID="faf520d0-9549-4b88-acb3-4c4656188df2" containerName="authorino" containerID="cri-o://e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5" gracePeriod=30 Jun 02 18:51:59.955747 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:51:59.955714 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:52:00.091149 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.091117 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf520d0-9549-4b88-acb3-4c4656188df2-tls-cert\") pod \"faf520d0-9549-4b88-acb3-4c4656188df2\" (UID: \"faf520d0-9549-4b88-acb3-4c4656188df2\") " Jun 02 18:52:00.091315 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.091195 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5zrh\" (UniqueName: \"kubernetes.io/projected/faf520d0-9549-4b88-acb3-4c4656188df2-kube-api-access-n5zrh\") pod \"faf520d0-9549-4b88-acb3-4c4656188df2\" (UID: \"faf520d0-9549-4b88-acb3-4c4656188df2\") " Jun 02 18:52:00.093615 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.093573 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf520d0-9549-4b88-acb3-4c4656188df2-kube-api-access-n5zrh" (OuterVolumeSpecName: "kube-api-access-n5zrh") pod "faf520d0-9549-4b88-acb3-4c4656188df2" (UID: "faf520d0-9549-4b88-acb3-4c4656188df2"). InnerVolumeSpecName "kube-api-access-n5zrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:52:00.101981 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.101955 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faf520d0-9549-4b88-acb3-4c4656188df2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "faf520d0-9549-4b88-acb3-4c4656188df2" (UID: "faf520d0-9549-4b88-acb3-4c4656188df2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:52:00.192851 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.192745 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/faf520d0-9549-4b88-acb3-4c4656188df2-tls-cert\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:52:00.192851 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.192781 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5zrh\" (UniqueName: \"kubernetes.io/projected/faf520d0-9549-4b88-acb3-4c4656188df2-kube-api-access-n5zrh\") on node \"ip-10-0-130-211.ec2.internal\" DevicePath \"\"" Jun 02 18:52:00.631679 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.631645 2561 generic.go:358] "Generic (PLEG): container finished" podID="faf520d0-9549-4b88-acb3-4c4656188df2" containerID="e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5" exitCode=0 Jun 02 18:52:00.632121 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.631708 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668b466cb5-nvlf7" Jun 02 18:52:00.632121 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.631730 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668b466cb5-nvlf7" event={"ID":"faf520d0-9549-4b88-acb3-4c4656188df2","Type":"ContainerDied","Data":"e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5"} Jun 02 18:52:00.632121 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.631781 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668b466cb5-nvlf7" event={"ID":"faf520d0-9549-4b88-acb3-4c4656188df2","Type":"ContainerDied","Data":"5d7d94917d2e20f22606bfe9159315937417af4bcd21266f89964bb823da4a08"} Jun 02 18:52:00.632121 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.631797 2561 scope.go:117] "RemoveContainer" containerID="e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5" Jun 02 18:52:00.641068 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.641048 2561 scope.go:117] "RemoveContainer" containerID="e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5" Jun 02 18:52:00.641398 ip-10-0-130-211 kubenswrapper[2561]: E0602 18:52:00.641372 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5\": container with ID starting with e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5 not found: ID does not exist" containerID="e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5" Jun 02 18:52:00.641487 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.641406 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5"} err="failed to get container status \"e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5\": rpc error: code = NotFound desc = could not find container \"e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5\": container with ID starting with e6e1041170d97a94fd5b3b9b7294c8d8faf7d0108f64f8ceae0f6c5e89ae51e5 not found: ID does not exist" Jun 02 18:52:00.653724 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.653698 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-668b466cb5-nvlf7"] Jun 02 18:52:00.657560 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:00.657537 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-668b466cb5-nvlf7"] Jun 02 18:52:01.874963 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:01.874932 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf520d0-9549-4b88-acb3-4c4656188df2" path="/var/lib/kubelet/pods/faf520d0-9549-4b88-acb3-4c4656188df2/volumes" Jun 02 18:52:07.016396 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.016367 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh"] Jun 02 18:52:07.016779 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.016712 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf520d0-9549-4b88-acb3-4c4656188df2" containerName="authorino" Jun 02 18:52:07.016779 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.016723 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf520d0-9549-4b88-acb3-4c4656188df2" containerName="authorino" Jun 02 18:52:07.016880 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.016786 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="faf520d0-9549-4b88-acb3-4c4656188df2" containerName="authorino" Jun 02 18:52:07.027113 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.027082 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.028667 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.028644 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh"] Jun 02 18:52:07.029704 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.029679 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 18:52:07.029807 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.029716 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 18:52:07.031024 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.031002 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qgnlc\"" Jun 02 18:52:07.031294 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.031271 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 18:52:07.158429 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.158392 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.158429 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.158425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.158686 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.158458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p42kp\" (UniqueName: \"kubernetes.io/projected/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-kube-api-access-p42kp\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.158686 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.158581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.158686 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.158649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.158821 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.158702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.260020 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.259976 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.260020 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.260015 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.260225 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.260140 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p42kp\" (UniqueName: \"kubernetes.io/projected/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-kube-api-access-p42kp\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.260225 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.260196 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.260386 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.260367 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.260449 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.260398 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.260505 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.260442 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.260712 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.260687 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.261005 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.260719 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.262427 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.262407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.262763 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.262747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.267904 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.267821 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p42kp\" (UniqueName: \"kubernetes.io/projected/cfe98dfd-48fe-4089-a9bb-b14fdaa8e546-kube-api-access-p42kp\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh\" (UID: \"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.341854 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.341787 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:07.478909 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.478884 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh"] Jun 02 18:52:07.482437 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:52:07.482407 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe98dfd_48fe_4089_a9bb_b14fdaa8e546.slice/crio-3900f2f820b2a7cc19befc80d28ce76a2e1088d865b6c450370a5ba397d0a937 WatchSource:0}: Error finding container 3900f2f820b2a7cc19befc80d28ce76a2e1088d865b6c450370a5ba397d0a937: Status 404 returned error can't find the container with id 3900f2f820b2a7cc19befc80d28ce76a2e1088d865b6c450370a5ba397d0a937 Jun 02 18:52:07.483298 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.483272 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:52:07.661931 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:07.661822 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" event={"ID":"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546","Type":"ContainerStarted","Data":"3900f2f820b2a7cc19befc80d28ce76a2e1088d865b6c450370a5ba397d0a937"} Jun 02 18:52:11.683271 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:11.683232 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" event={"ID":"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546","Type":"ContainerStarted","Data":"dd1b1303d687c0846b8728b1aa1fd1ee491772512cb6e1af3b259766bbf9d463"} Jun 02 18:52:12.688131 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:12.688093 2561 generic.go:358] "Generic (PLEG): container finished" podID="cfe98dfd-48fe-4089-a9bb-b14fdaa8e546" containerID="dd1b1303d687c0846b8728b1aa1fd1ee491772512cb6e1af3b259766bbf9d463" exitCode=0 Jun 02 18:52:12.688516 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:12.688176 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" event={"ID":"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546","Type":"ContainerDied","Data":"dd1b1303d687c0846b8728b1aa1fd1ee491772512cb6e1af3b259766bbf9d463"} Jun 02 18:52:14.699187 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:14.699150 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" event={"ID":"cfe98dfd-48fe-4089-a9bb-b14fdaa8e546","Type":"ContainerStarted","Data":"54f676e843d56b094a6aa64859b0834f7496f7fc5b1c60b7dda481b29fc3c2e0"} Jun 02 18:52:14.719234 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:14.719180 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" podStartSLOduration=2.42257978 podStartE2EDuration="8.719165142s" podCreationTimestamp="2026-06-02 18:52:06 +0000 UTC" firstStartedPulling="2026-06-02 18:52:07.484304748 +0000 UTC m=+740.148142869" lastFinishedPulling="2026-06-02 18:52:13.780890111 +0000 UTC m=+746.444728231" observedRunningTime="2026-06-02 18:52:14.716282332 +0000 UTC m=+747.380120475" watchObservedRunningTime="2026-06-02 18:52:14.719165142 +0000 UTC m=+747.383003283" Jun 02 18:52:17.342388 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:17.342346 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:17.342388 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:17.342387 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:17.355536 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:17.355507 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:17.722813 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:17.722785 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh" Jun 02 18:52:30.119110 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.119072 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn"] Jun 02 18:52:30.144695 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.144659 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn"] Jun 02 18:52:30.144912 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.144790 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.147730 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.147708 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 18:52:30.272900 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.272861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.273089 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.272918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.273089 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.273006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33551e8a-f0e8-49e5-b978-7993a4ded1b1-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.273191 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.273097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.273191 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.273128 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.273191 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.273153 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgqzc\" (UniqueName: \"kubernetes.io/projected/33551e8a-f0e8-49e5-b978-7993a4ded1b1-kube-api-access-sgqzc\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.373842 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.373732 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.373842 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.373787 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33551e8a-f0e8-49e5-b978-7993a4ded1b1-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.374053 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.373878 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.374053 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.373912 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.374053 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.373931 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgqzc\" (UniqueName: \"kubernetes.io/projected/33551e8a-f0e8-49e5-b978-7993a4ded1b1-kube-api-access-sgqzc\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.374053 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.373964 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.374268 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.374160 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.374268 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.374207 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.374469 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.374289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.376366 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.376343 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33551e8a-f0e8-49e5-b978-7993a4ded1b1-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.376554 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.376538 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33551e8a-f0e8-49e5-b978-7993a4ded1b1-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.383461 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.383437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgqzc\" (UniqueName: \"kubernetes.io/projected/33551e8a-f0e8-49e5-b978-7993a4ded1b1-kube-api-access-sgqzc\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn\" (UID: \"33551e8a-f0e8-49e5-b978-7993a4ded1b1\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.454646 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.454606 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:52:30.595175 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.595144 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn"] Jun 02 18:52:30.596811 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:52:30.596784 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33551e8a_f0e8_49e5_b978_7993a4ded1b1.slice/crio-8e1553632305fb877003d44bd72208be344b21c421b008e4fa8531f11eff7dcf WatchSource:0}: Error finding container 8e1553632305fb877003d44bd72208be344b21c421b008e4fa8531f11eff7dcf: Status 404 returned error can't find the container with id 8e1553632305fb877003d44bd72208be344b21c421b008e4fa8531f11eff7dcf Jun 02 18:52:30.761757 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.761724 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" event={"ID":"33551e8a-f0e8-49e5-b978-7993a4ded1b1","Type":"ContainerStarted","Data":"30872e681372e235530b85a5c33fc169d6ea84c7e36f84f10dca32ccc09492cf"} Jun 02 18:52:30.761951 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.761765 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" event={"ID":"33551e8a-f0e8-49e5-b978-7993a4ded1b1","Type":"ContainerStarted","Data":"8e1553632305fb877003d44bd72208be344b21c421b008e4fa8531f11eff7dcf"} Jun 02 18:52:30.883791 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:30.883761 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:52:44.587186 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:44.587144 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:52:51.080699 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:52:51.080655 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:53:01.744589 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.744554 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk"] Jun 02 18:53:01.749483 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.749466 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.751949 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.751927 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 18:53:01.757593 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.757566 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk"] Jun 02 18:53:01.864076 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.864035 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae06848-beef-451a-a546-4402763ca18a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.864262 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.864112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vng4s\" (UniqueName: \"kubernetes.io/projected/eae06848-beef-451a-a546-4402763ca18a-kube-api-access-vng4s\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.864262 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.864149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.864262 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.864169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.864372 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.864254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.864372 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.864308 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.965819 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.965769 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae06848-beef-451a-a546-4402763ca18a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.966060 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.965888 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vng4s\" (UniqueName: \"kubernetes.io/projected/eae06848-beef-451a-a546-4402763ca18a-kube-api-access-vng4s\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.966060 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.965935 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.966060 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.965963 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.966060 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.965999 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.966060 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.966044 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.966439 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.966410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.966507 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.966434 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.966507 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.966462 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.968400 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.968377 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eae06848-beef-451a-a546-4402763ca18a-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.968514 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.968471 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae06848-beef-451a-a546-4402763ca18a-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:01.974317 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:01.974296 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vng4s\" (UniqueName: \"kubernetes.io/projected/eae06848-beef-451a-a546-4402763ca18a-kube-api-access-vng4s\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk\" (UID: \"eae06848-beef-451a-a546-4402763ca18a\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:02.060813 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:02.060715 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:02.198640 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:02.198603 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk"] Jun 02 18:53:02.202270 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:53:02.202240 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae06848_beef_451a_a546_4402763ca18a.slice/crio-656266c0f6afb63ac30c9fd50c2baa260361e77789bc0f3827b05f683f147c17 WatchSource:0}: Error finding container 656266c0f6afb63ac30c9fd50c2baa260361e77789bc0f3827b05f683f147c17: Status 404 returned error can't find the container with id 656266c0f6afb63ac30c9fd50c2baa260361e77789bc0f3827b05f683f147c17 Jun 02 18:53:02.891433 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:02.891401 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" event={"ID":"eae06848-beef-451a-a546-4402763ca18a","Type":"ContainerStarted","Data":"745a3002204c6113ee0dfaca04506b59c628734a545cd833fd696f56fba7e2e7"} Jun 02 18:53:02.891433 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:02.891438 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" event={"ID":"eae06848-beef-451a-a546-4402763ca18a","Type":"ContainerStarted","Data":"656266c0f6afb63ac30c9fd50c2baa260361e77789bc0f3827b05f683f147c17"} Jun 02 18:53:03.579986 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:03.579939 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:53:03.897668 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:03.897571 2561 generic.go:358] "Generic (PLEG): container finished" podID="eae06848-beef-451a-a546-4402763ca18a" containerID="745a3002204c6113ee0dfaca04506b59c628734a545cd833fd696f56fba7e2e7" exitCode=0 Jun 02 18:53:03.898060 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:03.897658 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" event={"ID":"eae06848-beef-451a-a546-4402763ca18a","Type":"ContainerDied","Data":"745a3002204c6113ee0dfaca04506b59c628734a545cd833fd696f56fba7e2e7"} Jun 02 18:53:04.903116 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:04.903024 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" event={"ID":"eae06848-beef-451a-a546-4402763ca18a","Type":"ContainerStarted","Data":"205ee636db0234455b67b32c95f93fa5125608d337ba3eed305c4cae2f4af209"} Jun 02 18:53:04.924376 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:04.924327 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" podStartSLOduration=3.666603924 podStartE2EDuration="3.924313298s" podCreationTimestamp="2026-06-02 18:53:01 +0000 UTC" firstStartedPulling="2026-06-02 18:53:03.898396002 +0000 UTC m=+796.562234137" lastFinishedPulling="2026-06-02 18:53:04.15610539 +0000 UTC m=+796.819943511" observedRunningTime="2026-06-02 18:53:04.921221547 +0000 UTC m=+797.585059690" watchObservedRunningTime="2026-06-02 18:53:04.924313298 +0000 UTC m=+797.588151434" Jun 02 18:53:12.061231 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:12.061189 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:12.061231 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:12.061230 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:12.073853 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:12.073812 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:12.943101 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:12.943071 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk" Jun 02 18:53:16.362520 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.362482 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr"] Jun 02 18:53:16.367145 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.367123 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.369884 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.369862 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 18:53:16.376713 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.376686 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr"] Jun 02 18:53:16.509323 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.509282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvj2g\" (UniqueName: \"kubernetes.io/projected/38eb4a11-f473-4d1f-a932-08be3de37547-kube-api-access-xvj2g\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.509323 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.509336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.509536 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.509367 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.509536 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.509428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.509536 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.509486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.509536 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.509509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38eb4a11-f473-4d1f-a932-08be3de37547-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610047 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610015 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvj2g\" (UniqueName: \"kubernetes.io/projected/38eb4a11-f473-4d1f-a932-08be3de37547-kube-api-access-xvj2g\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610234 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610057 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610234 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610078 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610234 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610143 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610410 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610274 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610410 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610319 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38eb4a11-f473-4d1f-a932-08be3de37547-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610532 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610420 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610532 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610465 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.610689 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.610658 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.613030 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.612967 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/38eb4a11-f473-4d1f-a932-08be3de37547-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.613111 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.613033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38eb4a11-f473-4d1f-a932-08be3de37547-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.618626 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.618607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvj2g\" (UniqueName: \"kubernetes.io/projected/38eb4a11-f473-4d1f-a932-08be3de37547-kube-api-access-xvj2g\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr\" (UID: \"38eb4a11-f473-4d1f-a932-08be3de37547\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.677756 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.677722 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" Jun 02 18:53:16.816259 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.816229 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr"] Jun 02 18:53:16.817334 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:53:16.817308 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38eb4a11_f473_4d1f_a932_08be3de37547.slice/crio-b0ed1b8aafa4903858daff106bf738e70ccbe0a25f98b6be618baf3e7e425a1e WatchSource:0}: Error finding container b0ed1b8aafa4903858daff106bf738e70ccbe0a25f98b6be618baf3e7e425a1e: Status 404 returned error can't find the container with id b0ed1b8aafa4903858daff106bf738e70ccbe0a25f98b6be618baf3e7e425a1e Jun 02 18:53:16.948983 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.948948 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" event={"ID":"38eb4a11-f473-4d1f-a932-08be3de37547","Type":"ContainerStarted","Data":"827322c6e1077ba49f2baab885129051b04874cfe408be3279f83fc45ce139da"} Jun 02 18:53:16.948983 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:16.948983 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr" event={"ID":"38eb4a11-f473-4d1f-a932-08be3de37547","Type":"ContainerStarted","Data":"b0ed1b8aafa4903858daff106bf738e70ccbe0a25f98b6be618baf3e7e425a1e"} Jun 02 18:53:18.193735 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:18.193691 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-vhscb"] Jun 02 18:53:23.976811 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:23.976776 2561 generic.go:358] "Generic (PLEG): container finished" podID="33551e8a-f0e8-49e5-b978-7993a4ded1b1" containerID="30872e681372e235530b85a5c33fc169d6ea84c7e36f84f10dca32ccc09492cf" exitCode=0 Jun 02 18:53:23.977235 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:23.976858 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" event={"ID":"33551e8a-f0e8-49e5-b978-7993a4ded1b1","Type":"ContainerDied","Data":"30872e681372e235530b85a5c33fc169d6ea84c7e36f84f10dca32ccc09492cf"} Jun 02 18:53:24.982763 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:24.982723 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" event={"ID":"33551e8a-f0e8-49e5-b978-7993a4ded1b1","Type":"ContainerStarted","Data":"a23bd19e058b526136aa869814e1ec19e9956a5a1d8effb28a205424cdeff892"} Jun 02 18:53:25.002380 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:25.002330 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" podStartSLOduration=54.787541796 podStartE2EDuration="55.002316344s" podCreationTimestamp="2026-06-02 18:52:30 +0000 UTC" firstStartedPulling="2026-06-02 18:53:23.977561495 +0000 UTC m=+816.641399615" lastFinishedPulling="2026-06-02 18:53:24.19233604 +0000 UTC m=+816.856174163" observedRunningTime="2026-06-02 18:53:24.99971635 +0000 UTC m=+817.663554492" watchObservedRunningTime="2026-06-02 18:53:25.002316344 +0000 UTC m=+817.666154534" Jun 02 18:53:30.455733 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:30.455681 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:53:30.456213 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:30.455746 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:53:30.468646 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:30.468615 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:53:31.018008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:53:31.017982 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn" Jun 02 18:54:47.982023 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:54:47.981994 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:54:47.984441 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:54:47.983453 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:59:15.013461 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:15.013379 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr_38eb4a11-f473-4d1f-a932-08be3de37547/storage-initializer/0.log" Jun 02 18:59:16.006021 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:16.005986 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d697878ff-r9grx_c5e4d091-e5b7-4845-9656-aee7d07f100c/authorino/0.log" Jun 02 18:59:20.502764 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:20.502705 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8d496bf45-w24mr_ca2e9a74-bda1-4d7d-ab25-2e7664118229/nginx/0.log" Jun 02 18:59:21.531407 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:21.531372 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-qpggk_2a5b684f-668b-4ab8-961d-3667b3f3b29c/copy-manifests/0.log" Jun 02 18:59:21.538008 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:21.537972 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-qpggk_2a5b684f-668b-4ab8-961d-3667b3f3b29c/manager/0.log" Jun 02 18:59:22.402762 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.402729 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt_ec8e0c8f-50a9-4f69-aef3-f9a02638a608/util/0.log" Jun 02 18:59:22.409488 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.409459 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt_ec8e0c8f-50a9-4f69-aef3-f9a02638a608/pull/0.log" Jun 02 18:59:22.415435 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.415417 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt_ec8e0c8f-50a9-4f69-aef3-f9a02638a608/extract/0.log" Jun 02 18:59:22.520706 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.520679 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5_fc274027-e193-46eb-a267-50482e6d3ab8/util/0.log" Jun 02 18:59:22.530066 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.530046 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5_fc274027-e193-46eb-a267-50482e6d3ab8/pull/0.log" Jun 02 18:59:22.536424 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.536403 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5_fc274027-e193-46eb-a267-50482e6d3ab8/extract/0.log" Jun 02 18:59:22.646285 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.646262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2_7b1e5553-fef8-48ab-8ef8-9fb5b950a538/pull/0.log" Jun 02 18:59:22.652143 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.652125 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2_7b1e5553-fef8-48ab-8ef8-9fb5b950a538/extract/0.log" Jun 02 18:59:22.658013 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.657970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2_7b1e5553-fef8-48ab-8ef8-9fb5b950a538/util/0.log" Jun 02 18:59:22.764162 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.764140 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp_626f9246-c2f0-4df7-a26d-bc747f01ae4c/util/0.log" Jun 02 18:59:22.769941 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.769926 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp_626f9246-c2f0-4df7-a26d-bc747f01ae4c/pull/0.log" Jun 02 18:59:22.775726 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.775711 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp_626f9246-c2f0-4df7-a26d-bc747f01ae4c/extract/0.log" Jun 02 18:59:22.882245 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.882215 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d697878ff-r9grx_c5e4d091-e5b7-4845-9656-aee7d07f100c/authorino/0.log" Jun 02 18:59:22.992371 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:22.992344 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-tq5cv_5b4c4e90-57e6-4739-8cd4-f720056a62be/manager/0.log" Jun 02 18:59:23.204764 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:23.204735 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-kxj4s_07a2ca65-74e6-4cad-804a-7bdd5f7f1220/kuadrant-console-plugin/0.log" Jun 02 18:59:23.315579 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:23.315512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r2tqk_627f8696-98b6-48d5-bd53-28132b7f4e95/registry-server/0.log" Jun 02 18:59:23.542225 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:23.542193 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-vhscb_c85fde3d-d1f3-467c-bf39-1d25d7511b5c/limitador/0.log" Jun 02 18:59:24.002452 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:24.002420 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg_57c573be-749d-4f76-850a-3103f1df9517/istio-proxy/0.log" Jun 02 18:59:24.979291 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:24.979262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh_cfe98dfd-48fe-4089-a9bb-b14fdaa8e546/storage-initializer/0.log" Jun 02 18:59:24.985746 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:24.985718 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-ndbmh_cfe98dfd-48fe-4089-a9bb-b14fdaa8e546/main/0.log" Jun 02 18:59:25.096056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:25.096031 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn_33551e8a-f0e8-49e5-b978-7993a4ded1b1/storage-initializer/0.log" Jun 02 18:59:25.103339 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:25.103316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-xkmkn_33551e8a-f0e8-49e5-b978-7993a4ded1b1/main/0.log" Jun 02 18:59:25.441887 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:25.441799 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk_eae06848-beef-451a-a546-4402763ca18a/storage-initializer/0.log" Jun 02 18:59:25.448692 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:25.448670 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-pqjgk_eae06848-beef-451a-a546-4402763ca18a/main/0.log" Jun 02 18:59:25.554926 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:25.554901 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-zb6dr_38eb4a11-f473-4d1f-a932-08be3de37547/storage-initializer/0.log" Jun 02 18:59:32.752056 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:32.752022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7lcdg_23815455-f102-4734-9bf4-1ed7356ef1f8/global-pull-secret-syncer/0.log" Jun 02 18:59:32.892729 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:32.892697 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rfmlk_952fbca6-9a28-487e-a267-3c6ee61f4597/konnectivity-agent/0.log" Jun 02 18:59:32.935541 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:32.935512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-211.ec2.internal_cb6c1697b89e1de2aeda12f919933a09/haproxy/0.log" Jun 02 18:59:36.675587 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.675557 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt_ec8e0c8f-50a9-4f69-aef3-f9a02638a608/extract/0.log" Jun 02 18:59:36.700726 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.700697 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt_ec8e0c8f-50a9-4f69-aef3-f9a02638a608/util/0.log" Jun 02 18:59:36.726533 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.725251 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z9zgt_ec8e0c8f-50a9-4f69-aef3-f9a02638a608/pull/0.log" Jun 02 18:59:36.765662 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.765639 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5_fc274027-e193-46eb-a267-50482e6d3ab8/extract/0.log" Jun 02 18:59:36.794284 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.794262 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5_fc274027-e193-46eb-a267-50482e6d3ab8/util/0.log" Jun 02 18:59:36.817993 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.817973 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lkzd5_fc274027-e193-46eb-a267-50482e6d3ab8/pull/0.log" Jun 02 18:59:36.851492 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.851466 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2_7b1e5553-fef8-48ab-8ef8-9fb5b950a538/extract/0.log" Jun 02 18:59:36.876892 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.876865 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2_7b1e5553-fef8-48ab-8ef8-9fb5b950a538/util/0.log" Jun 02 18:59:36.900057 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.900041 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73rz6g2_7b1e5553-fef8-48ab-8ef8-9fb5b950a538/pull/0.log" Jun 02 18:59:36.926354 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.926296 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp_626f9246-c2f0-4df7-a26d-bc747f01ae4c/extract/0.log" Jun 02 18:59:36.958669 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.958649 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp_626f9246-c2f0-4df7-a26d-bc747f01ae4c/util/0.log" Jun 02 18:59:36.986307 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:36.986287 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18dsjp_626f9246-c2f0-4df7-a26d-bc747f01ae4c/pull/0.log" Jun 02 18:59:37.017906 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:37.017888 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7d697878ff-r9grx_c5e4d091-e5b7-4845-9656-aee7d07f100c/authorino/0.log" Jun 02 18:59:37.054890 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:37.054873 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-tq5cv_5b4c4e90-57e6-4739-8cd4-f720056a62be/manager/0.log" Jun 02 18:59:37.152440 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:37.152421 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-kxj4s_07a2ca65-74e6-4cad-804a-7bdd5f7f1220/kuadrant-console-plugin/0.log" Jun 02 18:59:37.185035 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:37.184970 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r2tqk_627f8696-98b6-48d5-bd53-28132b7f4e95/registry-server/0.log" Jun 02 18:59:37.274691 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:37.274668 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-vhscb_c85fde3d-d1f3-467c-bf39-1d25d7511b5c/limitador/0.log" Jun 02 18:59:38.681991 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:38.681950 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a045aca0-8bd5-46c9-8d8e-24af5aefd2e1/alertmanager/0.log" Jun 02 18:59:38.709364 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:38.709335 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a045aca0-8bd5-46c9-8d8e-24af5aefd2e1/config-reloader/0.log" Jun 02 18:59:38.732068 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:38.732045 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a045aca0-8bd5-46c9-8d8e-24af5aefd2e1/kube-rbac-proxy-web/0.log" Jun 02 18:59:38.760212 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:38.760187 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a045aca0-8bd5-46c9-8d8e-24af5aefd2e1/kube-rbac-proxy/0.log" Jun 02 18:59:38.784256 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:38.784231 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a045aca0-8bd5-46c9-8d8e-24af5aefd2e1/kube-rbac-proxy-metric/0.log" Jun 02 18:59:38.816110 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:38.816088 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a045aca0-8bd5-46c9-8d8e-24af5aefd2e1/prom-label-proxy/0.log" Jun 02 18:59:38.853065 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:38.853045 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a045aca0-8bd5-46c9-8d8e-24af5aefd2e1/init-config-reloader/0.log" Jun 02 18:59:39.085880 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:39.085850 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-x2cf8_33869f3a-4048-490c-a289-51f29f69080e/monitoring-plugin/0.log" Jun 02 18:59:39.311031 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:39.310998 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rd29n_5c0070db-1f73-489b-8006-77143b9144c4/node-exporter/0.log" Jun 02 18:59:39.342645 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:39.342561 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rd29n_5c0070db-1f73-489b-8006-77143b9144c4/kube-rbac-proxy/0.log" Jun 02 18:59:39.372902 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:39.372879 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rd29n_5c0070db-1f73-489b-8006-77143b9144c4/init-textfile/0.log" Jun 02 18:59:39.773356 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:39.773317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bbf556589-hp8tt_1e2f795a-7fb8-46e6-a941-af9b522af0db/telemeter-client/0.log" Jun 02 18:59:39.794666 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:39.794637 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bbf556589-hp8tt_1e2f795a-7fb8-46e6-a941-af9b522af0db/reload/0.log" Jun 02 18:59:39.819612 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:39.819588 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bbf556589-hp8tt_1e2f795a-7fb8-46e6-a941-af9b522af0db/kube-rbac-proxy/0.log" Jun 02 18:59:42.122993 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.122968 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6885c9f4dc-xfxl5_05198e5e-07bf-48d6-b467-50eb1308996d/console/0.log" Jun 02 18:59:42.574312 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.574279 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj"] Jun 02 18:59:42.577797 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.577775 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.580154 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.580136 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w4k8q\"/\"kube-root-ca.crt\"" Jun 02 18:59:42.581195 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.581182 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w4k8q\"/\"openshift-service-ca.crt\"" Jun 02 18:59:42.581251 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.581211 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w4k8q\"/\"default-dockercfg-tfwvc\"" Jun 02 18:59:42.588495 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.588474 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj"] Jun 02 18:59:42.713646 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.713623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-proc\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.713775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.713659 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvnhb\" (UniqueName: \"kubernetes.io/projected/e46c4023-5d7a-43e2-a202-6297c3886a3b-kube-api-access-mvnhb\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.713775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.713689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-sys\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.713775 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.713747 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-podres\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.713921 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.713802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-lib-modules\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.725592 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.725576 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-q8x69_1b9bea92-8313-40f3-954e-4e638eeaead9/volume-data-source-validator/0.log" Jun 02 18:59:42.814938 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.814916 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-lib-modules\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.815036 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.814969 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-proc\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.815036 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.815001 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvnhb\" (UniqueName: \"kubernetes.io/projected/e46c4023-5d7a-43e2-a202-6297c3886a3b-kube-api-access-mvnhb\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.815036 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.815020 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-sys\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.815157 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.815051 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-podres\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.815157 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.815087 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-lib-modules\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.815157 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.815119 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-sys\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.815157 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.815137 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-proc\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.815294 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.815186 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e46c4023-5d7a-43e2-a202-6297c3886a3b-podres\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.822998 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.822974 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvnhb\" (UniqueName: \"kubernetes.io/projected/e46c4023-5d7a-43e2-a202-6297c3886a3b-kube-api-access-mvnhb\") pod \"perf-node-gather-daemonset-ll2jj\" (UID: \"e46c4023-5d7a-43e2-a202-6297c3886a3b\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:42.888197 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:42.888148 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:43.018287 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.018252 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj"] Jun 02 18:59:43.019296 ip-10-0-130-211 kubenswrapper[2561]: W0602 18:59:43.019267 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode46c4023_5d7a_43e2_a202_6297c3886a3b.slice/crio-f85047859e1c3808ae105f4c4b0991be218f91560d624d2a0ae2bfb55977c59a WatchSource:0}: Error finding container f85047859e1c3808ae105f4c4b0991be218f91560d624d2a0ae2bfb55977c59a: Status 404 returned error can't find the container with id f85047859e1c3808ae105f4c4b0991be218f91560d624d2a0ae2bfb55977c59a Jun 02 18:59:43.020893 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.020875 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:59:43.481314 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.481274 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" event={"ID":"e46c4023-5d7a-43e2-a202-6297c3886a3b","Type":"ContainerStarted","Data":"076df6cb7efccdd9912609dd70ff5ecff71649034ce3508fa680f101ae013bf8"} Jun 02 18:59:43.481683 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.481321 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" event={"ID":"e46c4023-5d7a-43e2-a202-6297c3886a3b","Type":"ContainerStarted","Data":"f85047859e1c3808ae105f4c4b0991be218f91560d624d2a0ae2bfb55977c59a"} Jun 02 18:59:43.481683 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.481342 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:43.498884 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.498816 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" podStartSLOduration=1.498803032 podStartE2EDuration="1.498803032s" podCreationTimestamp="2026-06-02 18:59:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:59:43.497428602 +0000 UTC m=+1196.161266744" watchObservedRunningTime="2026-06-02 18:59:43.498803032 +0000 UTC m=+1196.162641174" Jun 02 18:59:43.559749 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.559725 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9tvm7_a7123799-65fa-4a33-84fe-d00ff80098d9/dns/0.log" Jun 02 18:59:43.580541 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.580520 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9tvm7_a7123799-65fa-4a33-84fe-d00ff80098d9/kube-rbac-proxy/0.log" Jun 02 18:59:43.693151 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:43.693129 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gb49h_3ed06e64-fde1-40e3-b574-f7b61df73947/dns-node-resolver/0.log" Jun 02 18:59:44.232648 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:44.232614 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c8b788444-8qtnf_4ee72458-9ab4-43c3-b0be-806ed6a9746a/registry/0.log" Jun 02 18:59:44.236266 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:44.236247 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c8b788444-8qtnf_4ee72458-9ab4-43c3-b0be-806ed6a9746a/registry/1.log" Jun 02 18:59:44.312394 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:44.312371 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pb92x_f8d846e1-b9ad-4bdf-b7d1-087d08220a80/node-ca/0.log" Jun 02 18:59:45.142991 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:45.142959 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bbjqqg_57c573be-749d-4f76-850a-3103f1df9517/istio-proxy/0.log" Jun 02 18:59:45.882646 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:45.882614 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rlbvb_55d18e74-ad37-4eae-ade7-44fc72b9c248/serve-healthcheck-canary/0.log" Jun 02 18:59:46.321464 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:46.321435 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-n9nc2_a39c406c-09fe-4dcc-9e79-76b82302919f/insights-operator/0.log" Jun 02 18:59:46.321889 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:46.321686 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-n9nc2_a39c406c-09fe-4dcc-9e79-76b82302919f/insights-operator/1.log" Jun 02 18:59:46.340042 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:46.340019 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27kp4_1dd7a622-33dd-4597-8e7b-83fdc82c73b1/kube-rbac-proxy/0.log" Jun 02 18:59:46.359537 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:46.359512 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27kp4_1dd7a622-33dd-4597-8e7b-83fdc82c73b1/exporter/0.log" Jun 02 18:59:46.378998 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:46.378974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27kp4_1dd7a622-33dd-4597-8e7b-83fdc82c73b1/extractor/0.log" Jun 02 18:59:48.017768 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:48.017655 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:59:48.021797 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:48.019947 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:59:48.550705 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:48.550675 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8d496bf45-w24mr_ca2e9a74-bda1-4d7d-ab25-2e7664118229/nginx/0.log" Jun 02 18:59:48.930940 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:48.930817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-qpggk_2a5b684f-668b-4ab8-961d-3667b3f3b29c/manager/0.log" Jun 02 18:59:48.954667 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:48.954642 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-qpggk_2a5b684f-668b-4ab8-961d-3667b3f3b29c/copy-manifests/0.log" Jun 02 18:59:49.496106 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:49.496080 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-ll2jj" Jun 02 18:59:50.273988 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:50.273949 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-655df48c9-2wmhj_bcdfa942-88c9-423e-bd08-ff62f91cd55b/manager/0.log" Jun 02 18:59:55.534677 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:55.534606 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-zcx5n_9a4541d6-1ce2-4bed-b745-bd9967e91458/kube-storage-version-migrator-operator/1.log" Jun 02 18:59:55.535301 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:55.535278 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-zcx5n_9a4541d6-1ce2-4bed-b745-bd9967e91458/kube-storage-version-migrator-operator/0.log" Jun 02 18:59:56.571307 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:56.571279 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lvfw_5fb7747a-366d-4c39-a1ca-9af3670ba925/kube-multus-additional-cni-plugins/0.log" Jun 02 18:59:56.592437 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:56.592413 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lvfw_5fb7747a-366d-4c39-a1ca-9af3670ba925/egress-router-binary-copy/0.log" Jun 02 18:59:56.613063 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:56.613042 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lvfw_5fb7747a-366d-4c39-a1ca-9af3670ba925/cni-plugins/0.log" Jun 02 18:59:56.634679 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:56.634662 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lvfw_5fb7747a-366d-4c39-a1ca-9af3670ba925/bond-cni-plugin/0.log" Jun 02 18:59:56.654390 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:56.654368 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lvfw_5fb7747a-366d-4c39-a1ca-9af3670ba925/routeoverride-cni/0.log" Jun 02 18:59:56.673641 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:56.673622 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lvfw_5fb7747a-366d-4c39-a1ca-9af3670ba925/whereabouts-cni-bincopy/0.log" Jun 02 18:59:56.692605 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:56.692587 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6lvfw_5fb7747a-366d-4c39-a1ca-9af3670ba925/whereabouts-cni/0.log" Jun 02 18:59:57.051180 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:57.051149 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j6tg9_b250934f-ca67-4400-87df-aec0dc6db304/kube-multus/0.log" Jun 02 18:59:57.097126 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:57.097094 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b9m7z_16f8406c-d799-4759-9860-fd9fb129b8a2/network-metrics-daemon/0.log" Jun 02 18:59:57.115435 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:57.115411 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b9m7z_16f8406c-d799-4759-9860-fd9fb129b8a2/kube-rbac-proxy/0.log" Jun 02 18:59:58.717979 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.717948 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-controller/0.log" Jun 02 18:59:58.740803 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.740775 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/0.log" Jun 02 18:59:58.746178 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.746161 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovn-acl-logging/1.log" Jun 02 18:59:58.767430 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.767406 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/kube-rbac-proxy-node/0.log" Jun 02 18:59:58.792166 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.792144 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 18:59:58.813374 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.813353 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/northd/0.log" Jun 02 18:59:58.846642 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.846622 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/nbdb/0.log" Jun 02 18:59:58.867765 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.867746 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/sbdb/0.log" Jun 02 18:59:58.966566 ip-10-0-130-211 kubenswrapper[2561]: I0602 18:59:58.966541 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-sftvp_ee95d5c1-acea-42fb-907b-6c41b37b0cd5/ovnkube-controller/0.log"