Jun 02 16:41:16.575947 ip-10-0-130-253 systemd[1]: Starting Kubernetes Kubelet... Jun 02 16:41:17.060683 ip-10-0-130-253 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:17.060683 ip-10-0-130-253 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 16:41:17.060683 ip-10-0-130-253 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:17.060683 ip-10-0-130-253 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 16:41:17.060683 ip-10-0-130-253 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:41:17.063117 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.063033 2555 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 16:41:17.068817 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068787 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:17.068817 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068807 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:17.068817 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068811 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:17.068817 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068815 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:17.068817 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068820 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:17.068817 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068824 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:17.068817 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068828 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068832 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068835 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068838 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068841 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068844 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068847 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068849 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068852 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068854 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068857 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068859 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068862 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068864 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068867 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068870 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068873 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068875 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068878 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068881 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:17.069071 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068884 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068889 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068892 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068895 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068897 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068900 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068902 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068905 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068907 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068910 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068913 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068915 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068918 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068920 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068923 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068926 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068928 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068931 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068934 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068936 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:17.069546 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068939 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068941 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068944 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068946 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068949 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068952 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068956 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068958 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068960 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068963 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068966 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068969 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068972 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068975 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068978 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068981 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068985 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068988 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068991 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:17.070046 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068994 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068996 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.068999 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069001 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069004 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069006 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069009 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069013 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069016 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069018 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069021 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069024 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069027 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069031 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069034 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069036 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069039 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069042 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069044 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069047 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:17.070493 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.069049 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:17.071237 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071225 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:17.071237 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071237 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071240 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071245 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071250 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071253 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071255 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071258 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071261 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071264 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071266 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071269 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071271 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071274 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071277 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071279 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071282 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071284 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071287 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071289 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071292 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:17.071297 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071295 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071297 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071301 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071306 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071309 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071312 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071315 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071318 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071321 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071324 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071326 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071328 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071331 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071333 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071336 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071338 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071341 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071343 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071346 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:17.071798 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071349 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071351 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071354 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071356 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071359 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071361 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071364 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071367 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071369 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071372 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071374 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071377 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071379 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071382 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071385 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071388 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071391 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071394 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071396 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071398 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:17.072267 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071401 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071403 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071406 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071408 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071411 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071413 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071416 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071418 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071421 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071423 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071426 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071428 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071431 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071434 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071436 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071439 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071441 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071444 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071446 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071449 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:17.072816 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071453 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071456 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071459 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071461 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071464 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.071467 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071551 2555 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071559 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071566 2555 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071571 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071576 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071579 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071584 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071588 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071591 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071594 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071598 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071601 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071604 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071607 2555 flags.go:64] FLAG: --cgroup-root="" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071610 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071613 2555 flags.go:64] FLAG: --client-ca-file="" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071615 2555 flags.go:64] FLAG: --cloud-config="" Jun 02 16:41:17.073321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071618 2555 flags.go:64] FLAG: --cloud-provider="external" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071621 2555 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071626 2555 flags.go:64] FLAG: --cluster-domain="" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071628 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071632 2555 flags.go:64] FLAG: --config-dir="" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071634 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071638 2555 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071641 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071644 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071648 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071667 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071670 2555 flags.go:64] FLAG: --contention-profiling="false" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071673 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071676 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071680 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071683 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071687 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071690 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071693 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071696 2555 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071700 2555 flags.go:64] FLAG: --enable-server="true" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071703 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071708 2555 flags.go:64] FLAG: --event-burst="100" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071711 2555 flags.go:64] FLAG: --event-qps="50" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071714 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 16:41:17.073882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071717 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071720 2555 flags.go:64] FLAG: --eviction-hard="" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071724 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071727 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071730 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071733 2555 flags.go:64] FLAG: --eviction-soft="" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071736 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071739 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071741 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071744 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071747 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071750 2555 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071753 2555 flags.go:64] FLAG: --feature-gates="" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071757 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071760 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071765 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071768 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071772 2555 flags.go:64] FLAG: --healthz-port="10248" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071775 2555 flags.go:64] FLAG: --help="false" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071778 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071781 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071784 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071787 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071791 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 16:41:17.074477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071795 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071798 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071801 2555 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071804 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071807 2555 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071811 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071823 2555 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071826 2555 flags.go:64] FLAG: --kube-reserved="" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071829 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071832 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071835 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071838 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071840 2555 flags.go:64] FLAG: --lock-file="" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071843 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071846 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071849 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071867 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071870 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071873 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071876 2555 flags.go:64] FLAG: --logging-format="text" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071879 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071882 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071885 2555 flags.go:64] FLAG: --manifest-url="" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071888 2555 flags.go:64] FLAG: --manifest-url-header="" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071893 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 16:41:17.075107 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071896 2555 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071901 2555 flags.go:64] FLAG: --max-pods="110" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071904 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071907 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071910 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071913 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071916 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071918 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071921 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071928 2555 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071931 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071934 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071938 2555 flags.go:64] FLAG: --pod-cidr="" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071941 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071946 2555 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071949 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071952 2555 flags.go:64] FLAG: --pods-per-core="0" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071955 2555 flags.go:64] FLAG: --port="10250" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071958 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071961 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e6a2b5ec0c11c5a" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071964 2555 flags.go:64] FLAG: --qos-reserved="" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071966 2555 flags.go:64] FLAG: --read-only-port="10255" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071969 2555 flags.go:64] FLAG: --register-node="true" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071972 2555 flags.go:64] FLAG: --register-schedulable="true" Jun 02 16:41:17.075753 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071975 2555 flags.go:64] FLAG: --register-with-taints="" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071978 2555 flags.go:64] FLAG: --registry-burst="10" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071981 2555 flags.go:64] FLAG: --registry-qps="5" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071984 2555 flags.go:64] FLAG: --reserved-cpus="" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071987 2555 flags.go:64] FLAG: --reserved-memory="" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071990 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071994 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071997 2555 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.071999 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072002 2555 flags.go:64] FLAG: --runonce="false" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072005 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072008 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072011 2555 flags.go:64] FLAG: --seccomp-default="false" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072014 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072017 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072021 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072024 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072027 2555 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072029 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072033 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072035 2555 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072039 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072042 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072045 2555 flags.go:64] FLAG: --system-cgroups="" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072048 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 16:41:17.076369 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072053 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072056 2555 flags.go:64] FLAG: --tls-cert-file="" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072058 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072063 2555 flags.go:64] FLAG: --tls-min-version="" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072066 2555 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072069 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072072 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072074 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072077 2555 flags.go:64] FLAG: --v="2" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072081 2555 flags.go:64] FLAG: --version="false" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072085 2555 flags.go:64] FLAG: --vmodule="" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072089 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.072093 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072182 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072185 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072189 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072192 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072195 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072199 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072201 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072204 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072207 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072210 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:17.076977 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072213 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072216 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072218 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072221 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072223 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072227 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072230 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072232 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072235 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072237 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072240 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072242 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072245 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072247 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072250 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072252 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072255 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072257 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072260 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:17.077517 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072262 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072265 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072267 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072270 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072273 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072276 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072278 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072281 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072285 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072287 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072290 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072292 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072295 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072297 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072300 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072302 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072305 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072307 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072309 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072312 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:17.078011 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072320 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072323 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072325 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072328 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072330 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072333 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072336 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072338 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072342 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072346 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072349 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072352 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072355 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072357 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072360 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072362 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072365 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072367 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072373 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072376 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:17.078508 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072378 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072383 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072386 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072389 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072392 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072395 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072398 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072401 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072404 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072407 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072410 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072413 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072416 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072420 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072423 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072425 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:17.079012 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.072428 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:17.079402 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.073198 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:17.079636 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.079617 2555 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 16:41:17.079719 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.079637 2555 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 16:41:17.079719 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079702 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:17.079719 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079708 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:17.079719 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079712 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:17.079719 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079715 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:17.079719 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079717 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:17.079719 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079720 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:17.079719 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079723 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079726 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079729 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079732 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079734 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079737 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079739 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079742 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079744 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079747 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079750 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079753 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079755 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079760 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079764 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079767 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079770 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079774 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079776 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:17.079939 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079779 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079782 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079785 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079789 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079793 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079796 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079800 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079803 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079806 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079808 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079817 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079821 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079823 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079826 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079829 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079832 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079835 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079838 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079840 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079843 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:17.080395 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079845 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079848 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079851 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079853 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079856 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079858 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079861 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079864 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079866 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079869 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079871 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079874 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079876 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079879 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079881 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079883 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079886 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079888 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079891 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079894 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:17.080889 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079896 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079899 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079901 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079904 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079906 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079909 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079911 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079914 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079917 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079920 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079922 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079925 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079927 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079930 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079933 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079935 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079937 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079940 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079943 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079945 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:17.081384 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.079948 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.079953 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080057 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080062 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080065 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080068 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080070 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080073 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080075 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080078 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080081 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080083 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080086 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080088 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080091 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080093 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:41:17.081884 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080096 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080098 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080101 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080104 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080107 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080109 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080112 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080115 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080117 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080120 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080122 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080125 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080127 2555 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080130 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080133 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080135 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080138 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080140 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080143 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080146 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:41:17.082274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080148 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080150 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080153 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080155 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080158 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080160 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080162 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080165 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080168 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080170 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080173 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080176 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080178 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080180 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080183 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080186 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080189 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080192 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080194 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080196 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:41:17.082768 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080199 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080201 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080204 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080206 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080208 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080211 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080213 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080216 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080218 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080221 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080223 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080227 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080231 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080234 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080236 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080239 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080242 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080245 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080248 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:41:17.083287 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080251 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080254 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080256 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080259 2555 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080262 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080264 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080267 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080270 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080273 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080275 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080278 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080280 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:17.080283 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.080288 2555 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.081083 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 16:41:17.083807 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.083142 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 16:41:17.084228 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.084217 2555 server.go:1019] "Starting client certificate rotation" Jun 02 16:41:17.084331 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.084318 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:41:17.084364 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.084347 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:41:17.109624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.109608 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:41:17.113039 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.113021 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:41:17.137923 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.137903 2555 log.go:25] "Validated CRI v1 runtime API" Jun 02 16:41:17.142057 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.142041 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:41:17.143457 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.143435 2555 log.go:25] "Validated CRI v1 image API" Jun 02 16:41:17.144641 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.144629 2555 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 16:41:17.146987 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.146964 2555 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 83c7e41e-edf2-4d79-bc13-2e6b05ef3dfa:/dev/nvme0n1p3 96d58d54-aea3-48d2-a454-1f6d4b658982:/dev/nvme0n1p4] Jun 02 16:41:17.147046 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.146987 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 16:41:17.152109 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.152002 2555 manager.go:217] Machine: {Timestamp:2026-06-02 16:41:17.151482559 +0000 UTC m=+0.436761288 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089277 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2663397e9225090f137cf78975e070 SystemUUID:ec266339-7e92-2509-0f13-7cf78975e070 BootID:5f34a1f0-718a-4469-b417-24e7c7c02e77 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fd:67:c2:eb:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fd:67:c2:eb:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:d5:c6:38:b6:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 16:41:17.152970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.152960 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 16:41:17.153051 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.153039 2555 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 16:41:17.156761 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.156733 2555 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 16:41:17.156923 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.156764 2555 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 16:41:17.157005 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.156938 2555 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 16:41:17.157005 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.156951 2555 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 16:41:17.157005 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.156961 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:41:17.157739 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.157726 2555 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:41:17.158566 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.158554 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:41:17.158716 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.158705 2555 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 16:41:17.161041 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.161030 2555 kubelet.go:491] "Attempting to sync node with API server" Jun 02 16:41:17.161108 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.161048 2555 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 16:41:17.161108 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.161065 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 16:41:17.161108 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.161079 2555 kubelet.go:397] "Adding apiserver pod source" Jun 02 16:41:17.161108 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.161101 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 16:41:17.162814 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.162800 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:41:17.162877 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.162830 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:41:17.166289 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.166271 2555 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 16:41:17.168223 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.168207 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mqgf5" Jun 02 16:41:17.168537 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.168524 2555 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 16:41:17.170615 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170592 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 16:41:17.170615 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170610 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 16:41:17.170615 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170616 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170622 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170633 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170640 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170645 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170668 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170676 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170682 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170696 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 16:41:17.170758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.170702 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 16:41:17.171578 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.171569 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 16:41:17.171578 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.171577 2555 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 16:41:17.174668 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.174636 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mqgf5" Jun 02 16:41:17.174757 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.174745 2555 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 16:41:17.174791 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.174777 2555 server.go:1295] "Started kubelet" Jun 02 16:41:17.174867 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.174830 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 16:41:17.178091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.178069 2555 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 16:41:17.178264 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.178242 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 16:41:17.178374 ip-10-0-130-253 systemd[1]: Started Kubernetes Kubelet. Jun 02 16:41:17.178470 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.178378 2555 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 16:41:17.178630 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.174873 2555 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 16:41:17.178693 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.178678 2555 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 16:41:17.180484 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.180444 2555 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 16:41:17.181141 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.181126 2555 server.go:317] "Adding debug handlers to kubelet server" Jun 02 16:41:17.186636 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.186616 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 16:41:17.186746 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.186621 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 16:41:17.186746 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.186700 2555 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 16:41:17.186746 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.186711 2555 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 16:41:17.186907 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.186784 2555 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 16:41:17.186907 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.186856 2555 reconstruct.go:97] "Volume reconstruction finished" Jun 02 16:41:17.186907 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.186865 2555 reconciler.go:26] "Reconciler: start to sync state" Jun 02 16:41:17.187306 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.187290 2555 factory.go:55] Registering systemd factory Jun 02 16:41:17.187306 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.187308 2555 factory.go:223] Registration of the systemd container factory successfully Jun 02 16:41:17.187422 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.187291 2555 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 16:41:17.187499 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.187477 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.187555 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.187482 2555 factory.go:153] Registering CRI-O factory Jun 02 16:41:17.187555 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.187519 2555 factory.go:223] Registration of the crio container factory successfully Jun 02 16:41:17.187648 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.187571 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 16:41:17.187648 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.187589 2555 factory.go:103] Registering Raw factory Jun 02 16:41:17.187648 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.187601 2555 manager.go:1196] Started watching for new ooms in manager Jun 02 16:41:17.188251 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.188226 2555 manager.go:319] Starting recovery of all containers Jun 02 16:41:17.189199 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.189172 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:17.193167 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.193139 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.199473 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.199335 2555 manager.go:324] Recovery completed Jun 02 16:41:17.203739 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.203727 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:17.205777 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.205762 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:17.205838 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.205789 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:17.205838 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.205799 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:17.206211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.206201 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 16:41:17.206211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.206210 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 16:41:17.206287 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.206225 2555 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:41:17.208519 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.208508 2555 policy_none.go:49] "None policy: Start" Jun 02 16:41:17.208570 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.208523 2555 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 16:41:17.208570 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.208533 2555 state_mem.go:35] "Initializing new in-memory state store" Jun 02 16:41:17.243192 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.243177 2555 manager.go:341] "Starting Device Plugin manager" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.243203 2555 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.243212 2555 server.go:85] "Starting device plugin registration server" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.243423 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.243435 2555 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.243530 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.243603 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.243610 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.244431 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 16:41:17.262759 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.244485 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.287705 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.287683 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 16:41:17.288997 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.288975 2555 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 16:41:17.289071 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.289005 2555 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 16:41:17.289071 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.289020 2555 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 16:41:17.289071 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.289026 2555 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 16:41:17.289071 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.289059 2555 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 16:41:17.291006 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.290991 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:17.344593 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.344543 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:17.345234 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.345220 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:17.345293 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.345248 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:17.345293 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.345258 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:17.345293 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.345277 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.353515 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.353501 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.353569 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.353521 2555 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-253.ec2.internal\": node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.366969 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.366952 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.389711 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.389692 2555 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal"] Jun 02 16:41:17.389767 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.389742 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:17.390508 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.390494 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:17.390556 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.390519 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:17.390556 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.390529 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:17.391708 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.391696 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:17.391864 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.391851 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.391902 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.391877 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:17.392333 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.392318 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:17.392397 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.392340 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:17.392397 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.392349 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:17.392397 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.392367 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:17.392397 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.392385 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:17.392397 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.392395 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:17.393523 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.393510 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.393574 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.393533 2555 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:41:17.394177 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.394159 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:41:17.394258 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.394187 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:41:17.394258 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.394201 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:41:17.421204 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.421182 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.425373 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.425357 2555 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-253.ec2.internal\" not found" node="ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.467306 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.467289 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.567857 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.567833 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.587643 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.587627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff136f17b76b94f95c918aaff70c823a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"ff136f17b76b94f95c918aaff70c823a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.587701 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.587663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff136f17b76b94f95c918aaff70c823a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"ff136f17b76b94f95c918aaff70c823a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.587701 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.587681 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46dd9cce261ef3bdca75d784ca677c02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"46dd9cce261ef3bdca75d784ca677c02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.668563 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.668511 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.688780 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.688763 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff136f17b76b94f95c918aaff70c823a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"ff136f17b76b94f95c918aaff70c823a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.688831 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.688786 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff136f17b76b94f95c918aaff70c823a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"ff136f17b76b94f95c918aaff70c823a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.688831 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.688803 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46dd9cce261ef3bdca75d784ca677c02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"46dd9cce261ef3bdca75d784ca677c02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.688891 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.688841 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46dd9cce261ef3bdca75d784ca677c02-config\") pod \"kube-apiserver-proxy-ip-10-0-130-253.ec2.internal\" (UID: \"46dd9cce261ef3bdca75d784ca677c02\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.688891 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.688863 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff136f17b76b94f95c918aaff70c823a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"ff136f17b76b94f95c918aaff70c823a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.688891 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.688866 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff136f17b76b94f95c918aaff70c823a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal\" (UID: \"ff136f17b76b94f95c918aaff70c823a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.723878 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.723860 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.728267 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:17.728245 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jun 02 16:41:17.768851 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.768831 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.869328 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.869300 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:17.969805 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:17.969753 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:18.070194 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:18.070176 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:18.084353 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.084329 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 16:41:18.084477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.084461 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:41:18.084535 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.084495 2555 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:41:18.171278 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:18.171252 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:18.178607 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.178577 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 16:36:17 +0000 UTC" deadline="2027-12-20 15:02:19.901373171 +0000 UTC" Jun 02 16:41:18.178705 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.178607 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13582h21m1.722769629s" Jun 02 16:41:18.187130 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.187115 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 16:41:18.197140 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.197123 2555 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:41:18.219184 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:18.219163 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff136f17b76b94f95c918aaff70c823a.slice/crio-f06603814c61dc2ba1d4e1cf2bd0d6c97d512f5c6ccbf32e52dbc58bf413c0fe WatchSource:0}: Error finding container f06603814c61dc2ba1d4e1cf2bd0d6c97d512f5c6ccbf32e52dbc58bf413c0fe: Status 404 returned error can't find the container with id f06603814c61dc2ba1d4e1cf2bd0d6c97d512f5c6ccbf32e52dbc58bf413c0fe Jun 02 16:41:18.219376 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:18.219350 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46dd9cce261ef3bdca75d784ca677c02.slice/crio-7bc3e63676b2ad345edc893853845d194d6c5fdcdc513230aff7575651411117 WatchSource:0}: Error finding container 7bc3e63676b2ad345edc893853845d194d6c5fdcdc513230aff7575651411117: Status 404 returned error can't find the container with id 7bc3e63676b2ad345edc893853845d194d6c5fdcdc513230aff7575651411117 Jun 02 16:41:18.221997 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.221924 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qgsfd" Jun 02 16:41:18.223114 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.223101 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:41:18.231666 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.231636 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qgsfd" Jun 02 16:41:18.271965 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:18.271944 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:18.291996 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.291960 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" event={"ID":"46dd9cce261ef3bdca75d784ca677c02","Type":"ContainerStarted","Data":"7bc3e63676b2ad345edc893853845d194d6c5fdcdc513230aff7575651411117"} Jun 02 16:41:18.292908 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.292887 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"ff136f17b76b94f95c918aaff70c823a","Type":"ContainerStarted","Data":"f06603814c61dc2ba1d4e1cf2bd0d6c97d512f5c6ccbf32e52dbc58bf413c0fe"} Jun 02 16:41:18.372056 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:18.372036 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:18.393691 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.393667 2555 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:18.473129 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:18.473084 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:18.573559 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:18.573534 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:18.674308 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:18.674273 2555 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-253.ec2.internal\" not found" Jun 02 16:41:18.739017 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.738814 2555 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:18.787802 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.787771 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" Jun 02 16:41:18.799844 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.799820 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:41:18.800960 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.800944 2555 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" Jun 02 16:41:18.810514 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:18.810439 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:41:19.162949 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.162919 2555 apiserver.go:52] "Watching apiserver" Jun 02 16:41:19.173638 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.173608 2555 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 16:41:19.175644 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.175615 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ljv9r","openshift-dns/node-resolver-52tqs","openshift-image-registry/node-ca-7s97n","openshift-multus/multus-nmh8p","openshift-multus/network-metrics-daemon-mvmcg","openshift-network-operator/iptables-alerter-dz5vd","kube-system/konnectivity-agent-vjmfh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal","openshift-multus/multus-additional-cni-plugins-c9xgw","openshift-network-diagnostics/network-check-target-tsrc6","openshift-ovn-kubernetes/ovnkube-node-2dmbr"] Jun 02 16:41:19.178185 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.178159 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.179253 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.179228 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.180556 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.180529 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.181190 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.180958 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:41:19.181190 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.181040 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 16:41:19.181190 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.181067 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q44vt\"" Jun 02 16:41:19.181190 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.181040 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 16:41:19.181998 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.181679 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:41:19.181998 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.181727 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.181998 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.181818 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.182211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.182197 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wxgbl\"" Jun 02 16:41:19.182496 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.182326 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 16:41:19.183162 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.183020 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-76rfd\"" Jun 02 16:41:19.183162 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.183039 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 16:41:19.183162 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.183054 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 16:41:19.183908 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.183890 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 16:41:19.184217 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.184202 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 16:41:19.184288 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.184276 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 16:41:19.184773 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.184538 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 16:41:19.184773 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.184546 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:19.184773 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.184638 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:19.184945 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.184800 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xwzzd\"" Jun 02 16:41:19.185489 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.185418 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-49tn4\"" Jun 02 16:41:19.185489 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.185435 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 16:41:19.185489 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.185485 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 16:41:19.185489 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.185490 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 16:41:19.185772 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.185680 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:19.185772 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.185739 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.187110 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.187089 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.188262 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.188226 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 16:41:19.188262 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.188260 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s276\"" Jun 02 16:41:19.188428 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.188413 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 16:41:19.188485 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.188473 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 16:41:19.189114 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.188723 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sg5dx\"" Jun 02 16:41:19.189114 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.188733 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:19.189114 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.188789 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:19.189114 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.188925 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 16:41:19.189114 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.188927 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 16:41:19.189530 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.189514 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 16:41:19.189600 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.189558 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 16:41:19.189798 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.189783 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7kjf4\"" Jun 02 16:41:19.190283 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.190263 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.194124 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.193999 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 16:41:19.194124 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.194076 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 16:41:19.194124 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.194082 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 16:41:19.194445 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.194418 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.194733 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6jxj7\"" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.195093 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.195481 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.195905 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-os-release\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.195941 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-modprobe-d\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.195973 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh8vq\" (UniqueName: \"kubernetes.io/projected/bf515160-61bc-4906-b919-e9dea45bb156-kube-api-access-gh8vq\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196003 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-host\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-system-cni-dir\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196060 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysconfig\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196089 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysctl-d\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196167 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-lib-modules\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.196211 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-socket-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2664832-ce41-46a2-806b-e2176632c5be-tmp-dir\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf515160-61bc-4906-b919-e9dea45bb156-etc-tuned\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-cni-binary-copy\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196469 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196525 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-run\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196558 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-sys\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196674 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-system-cni-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-sys-fs\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-serviceca\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.196893 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196874 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-k8s-cni-cncf-io\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196932 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-daemon-config\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.196965 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-device-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f31ce27-211a-471f-883d-2693635c0cf1-iptables-alerter-script\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzcqp\" (UniqueName: \"kubernetes.io/projected/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-kube-api-access-gzcqp\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzbgm\" (UniqueName: \"kubernetes.io/projected/9497fe5b-b10b-4958-9709-91518d7712ee-kube-api-access-zzbgm\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197168 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-cni-multus\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197207 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-conf-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-cnibin\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-var-lib-kubelet\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197321 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-kubelet\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197368 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197348 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-hostroot\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197375 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-etc-kubernetes\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197424 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-systemd\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197454 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-os-release\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197488 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-netns\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197518 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9wrf\" (UniqueName: \"kubernetes.io/projected/b3afa3b8-5caf-4480-a5ce-a4b275e61205-kube-api-access-d9wrf\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197562 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2664832-ce41-46a2-806b-e2176632c5be-hosts-file\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197607 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-multus-certs\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197718 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6chxp\" (UniqueName: \"kubernetes.io/projected/3f31ce27-211a-471f-883d-2693635c0cf1-kube-api-access-6chxp\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197767 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdxnp\" (UniqueName: \"kubernetes.io/projected/e2664832-ce41-46a2-806b-e2176632c5be-kube-api-access-mdxnp\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197793 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysctl-conf\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.197843 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf515160-61bc-4906-b919-e9dea45bb156-tmp\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.198370 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197872 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f31ce27-211a-471f-883d-2693635c0cf1-host-slash\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.198370 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:19.198370 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-kubernetes\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.198370 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.197986 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-host\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.198557 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.198018 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-cni-bin\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.198619 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.198602 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.198694 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.198643 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-cni-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.198746 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.198695 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2f858e67-8261-4a28-9c6e-df5cc3150ee5-konnectivity-ca\") pod \"konnectivity-agent-vjmfh\" (UID: \"2f858e67-8261-4a28-9c6e-df5cc3150ee5\") " pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:19.198851 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.198745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-cnibin\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.198851 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.198789 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-socket-dir-parent\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.198851 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.198837 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc58c\" (UniqueName: \"kubernetes.io/projected/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-kube-api-access-wc58c\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.198989 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.198876 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.199468 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.199417 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2f858e67-8261-4a28-9c6e-df5cc3150ee5-agent-certs\") pod \"konnectivity-agent-vjmfh\" (UID: \"2f858e67-8261-4a28-9c6e-df5cc3150ee5\") " pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:19.199468 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.199459 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.199626 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.199491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dct4x\" (UniqueName: \"kubernetes.io/projected/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-kube-api-access-dct4x\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.199626 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.199537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-registration-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.232228 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.232197 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:36:18 +0000 UTC" deadline="2028-01-11 03:21:19.544520303 +0000 UTC" Jun 02 16:41:19.232228 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.232228 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14098h40m0.312295287s" Jun 02 16:41:19.287990 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.287934 2555 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 16:41:19.299921 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.299891 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f31ce27-211a-471f-883d-2693635c0cf1-iptables-alerter-script\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.300040 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.299933 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzcqp\" (UniqueName: \"kubernetes.io/projected/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-kube-api-access-gzcqp\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:19.300040 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.299963 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzbgm\" (UniqueName: \"kubernetes.io/projected/9497fe5b-b10b-4958-9709-91518d7712ee-kube-api-access-zzbgm\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.300040 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.299988 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-cni-multus\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300040 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300013 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-conf-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300042 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-kubelet\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.300233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300093 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-ovn\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.300233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300095 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-cni-multus\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300140 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-cnibin\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.300233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300183 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-cnibin\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.300233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300205 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-var-lib-kubelet\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.300233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300221 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-conf-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300242 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-kubelet\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300281 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-hostroot\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-var-lib-kubelet\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300309 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-etc-kubernetes\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300334 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-kubelet\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300346 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-hostroot\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-etc-kubernetes\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300382 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3f31ce27-211a-471f-883d-2693635c0cf1-iptables-alerter-script\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-var-lib-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.300480 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300481 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-systemd\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300506 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-os-release\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300529 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-netns\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300566 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9wrf\" (UniqueName: \"kubernetes.io/projected/b3afa3b8-5caf-4480-a5ce-a4b275e61205-kube-api-access-d9wrf\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300594 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-os-release\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-cni-netd\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300624 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2664832-ce41-46a2-806b-e2176632c5be-hosts-file\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300632 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-systemd\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300674 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-systemd\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300700 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-etc-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300726 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-multus-certs\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300753 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.300806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300777 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovn-node-metrics-cert\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300815 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-netns\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300824 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6chxp\" (UniqueName: \"kubernetes.io/projected/3f31ce27-211a-471f-883d-2693635c0cf1-kube-api-access-6chxp\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300873 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2664832-ce41-46a2-806b-e2176632c5be-hosts-file\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300870 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdxnp\" (UniqueName: \"kubernetes.io/projected/e2664832-ce41-46a2-806b-e2176632c5be-kube-api-access-mdxnp\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300900 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-multus-certs\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300932 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysctl-conf\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300950 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf515160-61bc-4906-b919-e9dea45bb156-tmp\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.300969 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-slash\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301008 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301076 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f31ce27-211a-471f-883d-2693635c0cf1-host-slash\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301179 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:19.301201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301190 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f31ce27-211a-471f-883d-2693635c0cf1-host-slash\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301207 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysctl-conf\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301217 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-kubernetes\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301276 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-kubernetes\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.301291 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.301365 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:19.80132361 +0000 UTC m=+3.086602324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301361 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301386 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-host\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301428 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-host\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301460 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-cni-bin\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovnkube-config\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301524 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-var-lib-cni-bin\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301551 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301573 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-cni-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301624 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-cni-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301665 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2f858e67-8261-4a28-9c6e-df5cc3150ee5-konnectivity-ca\") pod \"konnectivity-agent-vjmfh\" (UID: \"2f858e67-8261-4a28-9c6e-df5cc3150ee5\") " pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:19.301720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301719 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-cnibin\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301746 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-socket-dir-parent\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301769 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wc58c\" (UniqueName: \"kubernetes.io/projected/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-kube-api-access-wc58c\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301819 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-cnibin\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301831 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-socket-dir-parent\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301854 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301887 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-run-netns\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-node-log\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301940 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2f858e67-8261-4a28-9c6e-df5cc3150ee5-agent-certs\") pod \"konnectivity-agent-vjmfh\" (UID: \"2f858e67-8261-4a28-9c6e-df5cc3150ee5\") " pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301978 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.301983 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-etc-selinux\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302022 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dct4x\" (UniqueName: \"kubernetes.io/projected/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-kube-api-access-dct4x\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302048 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-registration-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302078 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302106 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-cni-bin\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302132 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-os-release\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302137 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.302396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302139 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2f858e67-8261-4a28-9c6e-df5cc3150ee5-konnectivity-ca\") pod \"konnectivity-agent-vjmfh\" (UID: \"2f858e67-8261-4a28-9c6e-df5cc3150ee5\") " pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302160 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-modprobe-d\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302200 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-registration-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302254 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gh8vq\" (UniqueName: \"kubernetes.io/projected/bf515160-61bc-4906-b919-e9dea45bb156-kube-api-access-gh8vq\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302286 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-host\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302299 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-os-release\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302356 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-host\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302354 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-modprobe-d\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302389 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-system-cni-dir\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302420 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysconfig\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302444 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9497fe5b-b10b-4958-9709-91518d7712ee-system-cni-dir\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302483 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysctl-d\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302520 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysconfig\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302571 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-lib-modules\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302607 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-socket-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302640 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-etc-sysctl-d\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302668 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-lib-modules\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302672 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-env-overrides\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302711 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwt57\" (UniqueName: \"kubernetes.io/projected/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-kube-api-access-rwt57\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302755 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2664832-ce41-46a2-806b-e2176632c5be-tmp-dir\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302808 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-socket-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302881 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302897 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.302900 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf515160-61bc-4906-b919-e9dea45bb156-etc-tuned\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303022 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-cni-binary-copy\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303055 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303103 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-run\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303127 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-sys\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303151 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-system-cni-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303174 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2664832-ce41-46a2-806b-e2176632c5be-tmp-dir\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303242 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-sys-fs\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303177 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-sys-fs\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303281 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-log-socket\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.303628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303322 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovnkube-script-lib\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303351 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-serviceca\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303378 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-k8s-cni-cncf-io\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303406 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-daemon-config\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303459 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-host-run-k8s-cni-cncf-io\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303469 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-device-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303505 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-systemd-units\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303509 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-run\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.303992 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.304000 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-serviceca\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.304067 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-system-cni-dir\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.304114 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf515160-61bc-4906-b919-e9dea45bb156-sys\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.304464 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.304161 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3afa3b8-5caf-4480-a5ce-a4b275e61205-device-dir\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.305051 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.304504 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-multus-daemon-config\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.305051 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.304677 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf515160-61bc-4906-b919-e9dea45bb156-tmp\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.305051 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.304706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9497fe5b-b10b-4958-9709-91518d7712ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.305051 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.304992 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-cni-binary-copy\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.305330 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.305308 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2f858e67-8261-4a28-9c6e-df5cc3150ee5-agent-certs\") pod \"konnectivity-agent-vjmfh\" (UID: \"2f858e67-8261-4a28-9c6e-df5cc3150ee5\") " pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:19.305408 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.305393 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf515160-61bc-4906-b919-e9dea45bb156-etc-tuned\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.313431 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.313405 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzbgm\" (UniqueName: \"kubernetes.io/projected/9497fe5b-b10b-4958-9709-91518d7712ee-kube-api-access-zzbgm\") pod \"multus-additional-cni-plugins-c9xgw\" (UID: \"9497fe5b-b10b-4958-9709-91518d7712ee\") " pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.314670 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.314630 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh8vq\" (UniqueName: \"kubernetes.io/projected/bf515160-61bc-4906-b919-e9dea45bb156-kube-api-access-gh8vq\") pod \"tuned-ljv9r\" (UID: \"bf515160-61bc-4906-b919-e9dea45bb156\") " pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.315315 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.315291 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dct4x\" (UniqueName: \"kubernetes.io/projected/fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4-kube-api-access-dct4x\") pod \"node-ca-7s97n\" (UID: \"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4\") " pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.319011 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.318981 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdxnp\" (UniqueName: \"kubernetes.io/projected/e2664832-ce41-46a2-806b-e2176632c5be-kube-api-access-mdxnp\") pod \"node-resolver-52tqs\" (UID: \"e2664832-ce41-46a2-806b-e2176632c5be\") " pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.319138 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.319047 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9wrf\" (UniqueName: \"kubernetes.io/projected/b3afa3b8-5caf-4480-a5ce-a4b275e61205-kube-api-access-d9wrf\") pod \"aws-ebs-csi-driver-node-kp6lt\" (UID: \"b3afa3b8-5caf-4480-a5ce-a4b275e61205\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.319881 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.319854 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6chxp\" (UniqueName: \"kubernetes.io/projected/3f31ce27-211a-471f-883d-2693635c0cf1-kube-api-access-6chxp\") pod \"iptables-alerter-dz5vd\" (UID: \"3f31ce27-211a-471f-883d-2693635c0cf1\") " pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.320613 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.320585 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc58c\" (UniqueName: \"kubernetes.io/projected/6982aada-4303-48a9-bb2a-d2d1e2a3c1a0-kube-api-access-wc58c\") pod \"multus-nmh8p\" (UID: \"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0\") " pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.321070 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.321039 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzcqp\" (UniqueName: \"kubernetes.io/projected/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-kube-api-access-gzcqp\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:19.404388 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404354 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-var-lib-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404400 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404427 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-cni-netd\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404451 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-systemd\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404459 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-var-lib-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404473 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-etc-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404515 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovn-node-metrics-cert\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-systemd\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404525 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-cni-netd\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404546 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404516 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-etc-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404576 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-slash\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404544 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-slash\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404619 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404670 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovnkube-config\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404700 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-run-netns\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404709 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-openvswitch\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404725 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-node-log\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404749 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-run-netns\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404755 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404782 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-cni-bin\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404787 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-node-log\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404810 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404820 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-run-ovn-kubernetes\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404839 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-env-overrides\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.404942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404857 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-cni-bin\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.404866 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwt57\" (UniqueName: \"kubernetes.io/projected/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-kube-api-access-rwt57\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405028 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-log-socket\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405071 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovnkube-script-lib\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405116 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-systemd-units\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405117 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-log-socket\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405152 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-kubelet\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405179 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-ovn\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405178 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-systemd-units\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405211 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-host-kubelet\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405241 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovnkube-config\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405247 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-run-ovn\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.405744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405579 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovnkube-script-lib\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.406200 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.405877 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-env-overrides\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.407032 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.407011 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-ovn-node-metrics-cert\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.411534 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.411514 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:19.411534 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.411537 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:19.411691 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.411552 2555 projected.go:194] Error preparing data for projected volume kube-api-access-7ztc7 for pod openshift-network-diagnostics/network-check-target-tsrc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:19.411691 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.411624 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7 podName:5f240b59-1910-4ad3-a70e-f4e004d60bc5 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:19.911607131 +0000 UTC m=+3.196885859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7ztc7" (UniqueName: "kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7") pod "network-check-target-tsrc6" (UID: "5f240b59-1910-4ad3-a70e-f4e004d60bc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:19.413209 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.413186 2555 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:19.414248 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.414230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwt57\" (UniqueName: \"kubernetes.io/projected/8aa0ee3e-c79d-4bea-82b9-16712ccb1d21-kube-api-access-rwt57\") pod \"ovnkube-node-2dmbr\" (UID: \"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21\") " pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.491591 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.491563 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dz5vd" Jun 02 16:41:19.499400 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.499376 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" Jun 02 16:41:19.507046 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.507028 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52tqs" Jun 02 16:41:19.511551 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.511534 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7s97n" Jun 02 16:41:19.518105 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.518085 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nmh8p" Jun 02 16:41:19.523562 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.523546 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:19.530051 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.530025 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" Jun 02 16:41:19.537543 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.537529 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" Jun 02 16:41:19.542160 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.542113 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:19.609723 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.609698 2555 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:41:19.772184 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.772140 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9497fe5b_b10b_4958_9709_91518d7712ee.slice/crio-c553a3bd061d4906e0668c97765c68c99c1a3002bc2769143be9f3b3c03e4f6b WatchSource:0}: Error finding container c553a3bd061d4906e0668c97765c68c99c1a3002bc2769143be9f3b3c03e4f6b: Status 404 returned error can't find the container with id c553a3bd061d4906e0668c97765c68c99c1a3002bc2769143be9f3b3c03e4f6b Jun 02 16:41:19.773840 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.773816 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbb3cf6_c5dd_4472_b02a_7359fb1a01e4.slice/crio-0e74e51d731bc66b59bb1e59bd06c336519a679f1784cbc63a1357bdc09442b5 WatchSource:0}: Error finding container 0e74e51d731bc66b59bb1e59bd06c336519a679f1784cbc63a1357bdc09442b5: Status 404 returned error can't find the container with id 0e74e51d731bc66b59bb1e59bd06c336519a679f1784cbc63a1357bdc09442b5 Jun 02 16:41:19.774511 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.774330 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f858e67_8261_4a28_9c6e_df5cc3150ee5.slice/crio-ed452966e8699488e4e1a2d417cbf4a79e124b6919d9acc63fec194b7bd141fb WatchSource:0}: Error finding container ed452966e8699488e4e1a2d417cbf4a79e124b6919d9acc63fec194b7bd141fb: Status 404 returned error can't find the container with id ed452966e8699488e4e1a2d417cbf4a79e124b6919d9acc63fec194b7bd141fb Jun 02 16:41:19.777035 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.777017 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2664832_ce41_46a2_806b_e2176632c5be.slice/crio-2cf5fe7c07e4c216628e023e3c56e4408db17dc36e2803d5361dbbde84963c13 WatchSource:0}: Error finding container 2cf5fe7c07e4c216628e023e3c56e4408db17dc36e2803d5361dbbde84963c13: Status 404 returned error can't find the container with id 2cf5fe7c07e4c216628e023e3c56e4408db17dc36e2803d5361dbbde84963c13 Jun 02 16:41:19.777835 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.777814 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa0ee3e_c79d_4bea_82b9_16712ccb1d21.slice/crio-40f53aa2e47bb93a67a254225f5ee352013370a309435cb5d309cd4da4e832bb WatchSource:0}: Error finding container 40f53aa2e47bb93a67a254225f5ee352013370a309435cb5d309cd4da4e832bb: Status 404 returned error can't find the container with id 40f53aa2e47bb93a67a254225f5ee352013370a309435cb5d309cd4da4e832bb Jun 02 16:41:19.778747 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.778724 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf515160_61bc_4906_b919_e9dea45bb156.slice/crio-f5add5561e6c728a1150d0eaeca61e66beb17d95025d7ee6752ed62ee3009f13 WatchSource:0}: Error finding container f5add5561e6c728a1150d0eaeca61e66beb17d95025d7ee6752ed62ee3009f13: Status 404 returned error can't find the container with id f5add5561e6c728a1150d0eaeca61e66beb17d95025d7ee6752ed62ee3009f13 Jun 02 16:41:19.779780 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.779555 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3afa3b8_5caf_4480_a5ce_a4b275e61205.slice/crio-b213920be470a386e68c542bc2ff95b9e005fe32a60bf5455b865d35e89fa96c WatchSource:0}: Error finding container b213920be470a386e68c542bc2ff95b9e005fe32a60bf5455b865d35e89fa96c: Status 404 returned error can't find the container with id b213920be470a386e68c542bc2ff95b9e005fe32a60bf5455b865d35e89fa96c Jun 02 16:41:19.780911 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.780807 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6982aada_4303_48a9_bb2a_d2d1e2a3c1a0.slice/crio-7f45c45eee770d5e1d265ad6b7b0aee465b976e6616c294f1888d7bedfd45578 WatchSource:0}: Error finding container 7f45c45eee770d5e1d265ad6b7b0aee465b976e6616c294f1888d7bedfd45578: Status 404 returned error can't find the container with id 7f45c45eee770d5e1d265ad6b7b0aee465b976e6616c294f1888d7bedfd45578 Jun 02 16:41:19.781625 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:19.781527 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f31ce27_211a_471f_883d_2693635c0cf1.slice/crio-9fefdf080f60118241c4d89fe4b1fc6bab1c9a8506f8e951173fa0b2efdd8808 WatchSource:0}: Error finding container 9fefdf080f60118241c4d89fe4b1fc6bab1c9a8506f8e951173fa0b2efdd8808: Status 404 returned error can't find the container with id 9fefdf080f60118241c4d89fe4b1fc6bab1c9a8506f8e951173fa0b2efdd8808 Jun 02 16:41:19.809208 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:19.809053 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:19.809208 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.809204 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:19.809327 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:19.809266 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:20.80924647 +0000 UTC m=+4.094525199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:20.011622 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.011510 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:20.011622 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.011616 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:20.011715 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.011628 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:20.011715 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.011638 2555 projected.go:194] Error preparing data for projected volume kube-api-access-7ztc7 for pod openshift-network-diagnostics/network-check-target-tsrc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:20.011715 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.011701 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7 podName:5f240b59-1910-4ad3-a70e-f4e004d60bc5 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:21.011687118 +0000 UTC m=+4.296965832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7ztc7" (UniqueName: "kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7") pod "network-check-target-tsrc6" (UID: "5f240b59-1910-4ad3-a70e-f4e004d60bc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:20.232689 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.232598 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:36:18 +0000 UTC" deadline="2027-11-06 17:40:51.423910723 +0000 UTC" Jun 02 16:41:20.232689 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.232642 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12528h59m31.191272302s" Jun 02 16:41:20.290723 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.290165 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:20.290723 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.290308 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:20.311258 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.310950 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" event={"ID":"b3afa3b8-5caf-4480-a5ce-a4b275e61205","Type":"ContainerStarted","Data":"b213920be470a386e68c542bc2ff95b9e005fe32a60bf5455b865d35e89fa96c"} Jun 02 16:41:20.315970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.315904 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7s97n" event={"ID":"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4","Type":"ContainerStarted","Data":"0e74e51d731bc66b59bb1e59bd06c336519a679f1784cbc63a1357bdc09442b5"} Jun 02 16:41:20.330318 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.330261 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" event={"ID":"46dd9cce261ef3bdca75d784ca677c02","Type":"ContainerStarted","Data":"2f8729b993bba531ddf8d8047b700ad940fbd7cb618f476a7707876c8b7a20ba"} Jun 02 16:41:20.340864 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.340831 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nmh8p" event={"ID":"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0","Type":"ContainerStarted","Data":"7f45c45eee770d5e1d265ad6b7b0aee465b976e6616c294f1888d7bedfd45578"} Jun 02 16:41:20.346534 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.346505 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" event={"ID":"bf515160-61bc-4906-b919-e9dea45bb156","Type":"ContainerStarted","Data":"f5add5561e6c728a1150d0eaeca61e66beb17d95025d7ee6752ed62ee3009f13"} Jun 02 16:41:20.355003 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.354976 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"40f53aa2e47bb93a67a254225f5ee352013370a309435cb5d309cd4da4e832bb"} Jun 02 16:41:20.357668 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.357625 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52tqs" event={"ID":"e2664832-ce41-46a2-806b-e2176632c5be","Type":"ContainerStarted","Data":"2cf5fe7c07e4c216628e023e3c56e4408db17dc36e2803d5361dbbde84963c13"} Jun 02 16:41:20.364877 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.364851 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vjmfh" event={"ID":"2f858e67-8261-4a28-9c6e-df5cc3150ee5","Type":"ContainerStarted","Data":"ed452966e8699488e4e1a2d417cbf4a79e124b6919d9acc63fec194b7bd141fb"} Jun 02 16:41:20.369553 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.369525 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" event={"ID":"9497fe5b-b10b-4958-9709-91518d7712ee","Type":"ContainerStarted","Data":"c553a3bd061d4906e0668c97765c68c99c1a3002bc2769143be9f3b3c03e4f6b"} Jun 02 16:41:20.373317 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.372696 2555 generic.go:358] "Generic (PLEG): container finished" podID="ff136f17b76b94f95c918aaff70c823a" containerID="1e2b2cccb079591140848c1880e19d2ed00d37f7d096ef435c464468dd3c53ce" exitCode=0 Jun 02 16:41:20.373317 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.372775 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"ff136f17b76b94f95c918aaff70c823a","Type":"ContainerDied","Data":"1e2b2cccb079591140848c1880e19d2ed00d37f7d096ef435c464468dd3c53ce"} Jun 02 16:41:20.378172 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.378149 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dz5vd" event={"ID":"3f31ce27-211a-471f-883d-2693635c0cf1","Type":"ContainerStarted","Data":"9fefdf080f60118241c4d89fe4b1fc6bab1c9a8506f8e951173fa0b2efdd8808"} Jun 02 16:41:20.388761 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.388613 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-253.ec2.internal" podStartSLOduration=2.388595943 podStartE2EDuration="2.388595943s" podCreationTimestamp="2026-06-02 16:41:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:41:20.345922496 +0000 UTC m=+3.631201234" watchObservedRunningTime="2026-06-02 16:41:20.388595943 +0000 UTC m=+3.673874680" Jun 02 16:41:20.762445 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.762413 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-62jdn"] Jun 02 16:41:20.764829 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.764398 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.764829 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.764469 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:20.817839 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.817206 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:20.817839 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.817260 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b9840e4-9fde-4598-a167-ed011b54a1d3-dbus\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.817839 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.817287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.817839 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.817333 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b9840e4-9fde-4598-a167-ed011b54a1d3-kubelet-config\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.817839 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.817461 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:20.817839 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.817516 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:22.817496553 +0000 UTC m=+6.102775271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:20.918757 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.917980 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b9840e4-9fde-4598-a167-ed011b54a1d3-dbus\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.918757 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.918027 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.918757 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.918067 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b9840e4-9fde-4598-a167-ed011b54a1d3-kubelet-config\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.918757 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.918176 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7b9840e4-9fde-4598-a167-ed011b54a1d3-kubelet-config\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.918757 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:20.918331 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7b9840e4-9fde-4598-a167-ed011b54a1d3-dbus\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:20.918757 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.918427 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:20.918757 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:20.918482 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret podName:7b9840e4-9fde-4598-a167-ed011b54a1d3 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:21.41846371 +0000 UTC m=+4.703742429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret") pod "global-pull-secret-syncer-62jdn" (UID: "7b9840e4-9fde-4598-a167-ed011b54a1d3") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:21.022700 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:21.019455 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:21.022700 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:21.019623 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:21.022700 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:21.019645 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:21.022700 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:21.019674 2555 projected.go:194] Error preparing data for projected volume kube-api-access-7ztc7 for pod openshift-network-diagnostics/network-check-target-tsrc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:21.022700 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:21.019732 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7 podName:5f240b59-1910-4ad3-a70e-f4e004d60bc5 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:23.019713355 +0000 UTC m=+6.304992073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7ztc7" (UniqueName: "kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7") pod "network-check-target-tsrc6" (UID: "5f240b59-1910-4ad3-a70e-f4e004d60bc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:21.290001 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:21.289782 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:21.290001 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:21.289910 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:21.397717 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:21.397632 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" event={"ID":"ff136f17b76b94f95c918aaff70c823a","Type":"ContainerStarted","Data":"975694f5b10266ec65ff8c57a71f9ae1d10307aeba6f45abe42e8d92b97d9644"} Jun 02 16:41:21.412616 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:21.412306 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-253.ec2.internal" podStartSLOduration=3.412287834 podStartE2EDuration="3.412287834s" podCreationTimestamp="2026-06-02 16:41:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:41:21.411884339 +0000 UTC m=+4.697163076" watchObservedRunningTime="2026-06-02 16:41:21.412287834 +0000 UTC m=+4.697566572" Jun 02 16:41:21.424552 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:21.424072 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:21.424552 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:21.424202 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:21.424552 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:21.424266 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret podName:7b9840e4-9fde-4598-a167-ed011b54a1d3 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:22.424248568 +0000 UTC m=+5.709527287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret") pod "global-pull-secret-syncer-62jdn" (UID: "7b9840e4-9fde-4598-a167-ed011b54a1d3") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:22.290299 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:22.290114 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:22.290299 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:22.290258 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:22.290907 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:22.290641 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:22.290907 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:22.290743 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:22.432208 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:22.432146 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:22.432386 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:22.432282 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:22.432386 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:22.432339 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret podName:7b9840e4-9fde-4598-a167-ed011b54a1d3 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:24.43231991 +0000 UTC m=+7.717598631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret") pod "global-pull-secret-syncer-62jdn" (UID: "7b9840e4-9fde-4598-a167-ed011b54a1d3") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:22.835913 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:22.835298 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:22.835913 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:22.835445 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:22.835913 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:22.835505 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:26.835485756 +0000 UTC m=+10.120764473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:23.037329 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:23.037298 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:23.037517 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:23.037478 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:23.037517 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:23.037496 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:23.037517 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:23.037507 2555 projected.go:194] Error preparing data for projected volume kube-api-access-7ztc7 for pod openshift-network-diagnostics/network-check-target-tsrc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:23.037683 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:23.037566 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7 podName:5f240b59-1910-4ad3-a70e-f4e004d60bc5 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:27.037547772 +0000 UTC m=+10.322826489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7ztc7" (UniqueName: "kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7") pod "network-check-target-tsrc6" (UID: "5f240b59-1910-4ad3-a70e-f4e004d60bc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:23.292089 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:23.290720 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:23.292089 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:23.290852 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:24.290125 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:24.289843 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:24.290125 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:24.289976 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:24.290125 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:24.289983 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:24.290125 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:24.290085 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:24.449490 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:24.449449 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:24.449995 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:24.449633 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:24.449995 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:24.449731 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret podName:7b9840e4-9fde-4598-a167-ed011b54a1d3 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:28.449709463 +0000 UTC m=+11.734988183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret") pod "global-pull-secret-syncer-62jdn" (UID: "7b9840e4-9fde-4598-a167-ed011b54a1d3") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:25.289764 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:25.289731 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:25.289947 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:25.289861 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:26.290144 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:26.290109 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:26.290613 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:26.290247 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:26.290613 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:26.290394 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:26.290613 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:26.290505 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:26.867831 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:26.867786 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:26.868017 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:26.867958 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:26.868097 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:26.868033 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:34.868012274 +0000 UTC m=+18.153290991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:27.069739 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:27.069686 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:27.069917 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:27.069828 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:27.069917 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:27.069848 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:27.069917 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:27.069861 2555 projected.go:194] Error preparing data for projected volume kube-api-access-7ztc7 for pod openshift-network-diagnostics/network-check-target-tsrc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:27.069917 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:27.069917 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7 podName:5f240b59-1910-4ad3-a70e-f4e004d60bc5 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:35.069900538 +0000 UTC m=+18.355179266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7ztc7" (UniqueName: "kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7") pod "network-check-target-tsrc6" (UID: "5f240b59-1910-4ad3-a70e-f4e004d60bc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:27.290367 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:27.290181 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:27.290367 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:27.290283 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:28.289418 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:28.289371 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:28.289418 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:28.289394 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:28.289698 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:28.289500 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:28.289698 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:28.289646 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:28.480491 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:28.480442 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:28.480981 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:28.480632 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:28.480981 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:28.480739 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret podName:7b9840e4-9fde-4598-a167-ed011b54a1d3 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:36.480718871 +0000 UTC m=+19.765997598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret") pod "global-pull-secret-syncer-62jdn" (UID: "7b9840e4-9fde-4598-a167-ed011b54a1d3") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:29.289829 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:29.289791 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:29.290012 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:29.289937 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:30.289590 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:30.289517 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:30.290026 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:30.289523 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:30.290026 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:30.289627 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:30.290026 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:30.289732 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:31.289268 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:31.289230 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:31.289445 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:31.289392 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:32.290086 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:32.290048 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:32.290549 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:32.290178 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:32.290549 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:32.290241 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:32.290549 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:32.290371 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:33.290026 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:33.289996 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:33.290214 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:33.290120 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:34.289741 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:34.289708 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:34.289976 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:34.289707 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:34.289976 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:34.289855 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:34.289976 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:34.289907 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:34.927356 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:34.927320 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:34.927805 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:34.927523 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:34.927805 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:34.927593 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:50.927576127 +0000 UTC m=+34.212854840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:35.129102 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:35.129063 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:35.129264 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:35.129213 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:35.129264 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:35.129235 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:35.129264 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:35.129247 2555 projected.go:194] Error preparing data for projected volume kube-api-access-7ztc7 for pod openshift-network-diagnostics/network-check-target-tsrc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:35.129423 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:35.129316 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7 podName:5f240b59-1910-4ad3-a70e-f4e004d60bc5 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:51.129297071 +0000 UTC m=+34.414575787 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7ztc7" (UniqueName: "kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7") pod "network-check-target-tsrc6" (UID: "5f240b59-1910-4ad3-a70e-f4e004d60bc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:35.289565 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:35.289482 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:35.289725 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:35.289596 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:36.289218 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:36.289188 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:36.289624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:36.289188 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:36.289624 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:36.289316 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:36.289624 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:36.289347 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:36.539763 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:36.539647 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:36.539928 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:36.539819 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:36.539928 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:36.539898 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret podName:7b9840e4-9fde-4598-a167-ed011b54a1d3 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:52.539879548 +0000 UTC m=+35.825158280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret") pod "global-pull-secret-syncer-62jdn" (UID: "7b9840e4-9fde-4598-a167-ed011b54a1d3") : object "kube-system"/"original-pull-secret" not registered Jun 02 16:41:37.290906 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:37.290856 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:37.291328 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:37.290958 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:38.290177 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.289957 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:38.290276 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.290099 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:38.290344 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:38.290265 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:38.290403 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:38.290340 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:38.433862 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.433603 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nmh8p" event={"ID":"6982aada-4303-48a9-bb2a-d2d1e2a3c1a0","Type":"ContainerStarted","Data":"cc5bc29dee2d213e1870427c6b197d30230783a07407c4c2a90110164291e641"} Jun 02 16:41:38.435605 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.435579 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" event={"ID":"bf515160-61bc-4906-b919-e9dea45bb156","Type":"ContainerStarted","Data":"4f6e82713a0f16e54ccccd4876e18e6d3f01d26e314085358f7607be826d462e"} Jun 02 16:41:38.437715 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.437687 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"ccb4211258f8c3f42f243f9a46e8e28ceaffeee75702c1f431298bc777efcc1a"} Jun 02 16:41:38.437812 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.437721 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"7c2e9c2e7df9fbba8e026afcaac0b6169496ba7355a03e999d7c837ac60f9779"} Jun 02 16:41:38.437812 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.437734 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"5909f12c4770e1d6b519ddfa74ea8ef5d20e091c88dc3469b80d441195423c64"} Jun 02 16:41:38.438938 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.438913 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52tqs" event={"ID":"e2664832-ce41-46a2-806b-e2176632c5be","Type":"ContainerStarted","Data":"50069f62ff8c73025ef567aba7dec5c16aa83c1adff2739cec1b6e1d414848a0"} Jun 02 16:41:38.440133 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.440113 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vjmfh" event={"ID":"2f858e67-8261-4a28-9c6e-df5cc3150ee5","Type":"ContainerStarted","Data":"d01afd9ebc46d1ee605875a76be543839db6bbd316f17f0d856936ecf8da7f44"} Jun 02 16:41:38.441505 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.441480 2555 generic.go:358] "Generic (PLEG): container finished" podID="9497fe5b-b10b-4958-9709-91518d7712ee" containerID="4f9cd2a7ea63bd6664add1c90b01dd5bff4aa7b241d2e3d96c1e9ef86fcc044f" exitCode=0 Jun 02 16:41:38.441593 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.441552 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" event={"ID":"9497fe5b-b10b-4958-9709-91518d7712ee","Type":"ContainerDied","Data":"4f9cd2a7ea63bd6664add1c90b01dd5bff4aa7b241d2e3d96c1e9ef86fcc044f"} Jun 02 16:41:38.442848 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.442824 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" event={"ID":"b3afa3b8-5caf-4480-a5ce-a4b275e61205","Type":"ContainerStarted","Data":"da7b480fdc2a30ecea93a897efc2443c46cd6aade9519be609b059fc330733da"} Jun 02 16:41:38.444266 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.444143 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7s97n" event={"ID":"fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4","Type":"ContainerStarted","Data":"23c1611f3685692a71d05d7190a7734b7fc8e92970781ba49da3fd0e70baa1b9"} Jun 02 16:41:38.453206 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.453153 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-nmh8p" podStartSLOduration=3.085142835 podStartE2EDuration="21.453137066s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.783204848 +0000 UTC m=+3.068483562" lastFinishedPulling="2026-06-02 16:41:38.151199064 +0000 UTC m=+21.436477793" observedRunningTime="2026-06-02 16:41:38.452782421 +0000 UTC m=+21.738061157" watchObservedRunningTime="2026-06-02 16:41:38.453137066 +0000 UTC m=+21.738415803" Jun 02 16:41:38.467980 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.467937 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ljv9r" podStartSLOduration=3.14785978 podStartE2EDuration="21.467925096s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.781012352 +0000 UTC m=+3.066291072" lastFinishedPulling="2026-06-02 16:41:38.101077671 +0000 UTC m=+21.386356388" observedRunningTime="2026-06-02 16:41:38.467713024 +0000 UTC m=+21.752991762" watchObservedRunningTime="2026-06-02 16:41:38.467925096 +0000 UTC m=+21.753203832" Jun 02 16:41:38.496888 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.496843 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-52tqs" podStartSLOduration=3.176140172 podStartE2EDuration="21.496829721s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.778603382 +0000 UTC m=+3.063882101" lastFinishedPulling="2026-06-02 16:41:38.099292919 +0000 UTC m=+21.384571650" observedRunningTime="2026-06-02 16:41:38.482914637 +0000 UTC m=+21.768193488" watchObservedRunningTime="2026-06-02 16:41:38.496829721 +0000 UTC m=+21.782108457" Jun 02 16:41:38.497153 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.496916 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7s97n" podStartSLOduration=3.173155707 podStartE2EDuration="21.496910451s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.77596708 +0000 UTC m=+3.061245798" lastFinishedPulling="2026-06-02 16:41:38.099721814 +0000 UTC m=+21.385000542" observedRunningTime="2026-06-02 16:41:38.49675251 +0000 UTC m=+21.782031263" watchObservedRunningTime="2026-06-02 16:41:38.496910451 +0000 UTC m=+21.782189188" Jun 02 16:41:38.531164 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.531131 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vjmfh" podStartSLOduration=11.261612554 podStartE2EDuration="21.531119526s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.776235353 +0000 UTC m=+3.061514084" lastFinishedPulling="2026-06-02 16:41:30.045742323 +0000 UTC m=+13.331021056" observedRunningTime="2026-06-02 16:41:38.53107624 +0000 UTC m=+21.816354975" watchObservedRunningTime="2026-06-02 16:41:38.531119526 +0000 UTC m=+21.816398262" Jun 02 16:41:38.810823 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.810759 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:38.811517 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:38.811420 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:39.289848 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.289818 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:39.289985 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:39.289912 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:39.451739 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.451700 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dz5vd" event={"ID":"3f31ce27-211a-471f-883d-2693635c0cf1","Type":"ContainerStarted","Data":"49daee0610f1a5c9f5976dbdfa32672f324ad615ef169253e2f5409771cc8d0e"} Jun 02 16:41:39.455415 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.455367 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"82aa0b8be8d4c7ca591a3d9075107da2d37bb301cb8018356ea2037d03ab1919"} Jun 02 16:41:39.455415 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.455400 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"dffb6d10df38d7ae7873b36c15575bfef5fa88137895ee10c4bcc2b8ca2c34a7"} Jun 02 16:41:39.455415 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.455412 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"ae689972e31b608ba0d5d84402d316a271218dffd989a1828aee69fc3b1ecc8a"} Jun 02 16:41:39.456111 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.456060 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:39.456585 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.456563 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vjmfh" Jun 02 16:41:39.489278 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.489234 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dz5vd" podStartSLOduration=4.175974271 podStartE2EDuration="22.48921897s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.783895075 +0000 UTC m=+3.069173790" lastFinishedPulling="2026-06-02 16:41:38.09713976 +0000 UTC m=+21.382418489" observedRunningTime="2026-06-02 16:41:39.471544327 +0000 UTC m=+22.756823059" watchObservedRunningTime="2026-06-02 16:41:39.48921897 +0000 UTC m=+22.774497706" Jun 02 16:41:39.526108 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:39.526063 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 16:41:40.255910 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:40.255725 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T16:41:39.526076614Z","UUID":"e9840449-53e0-45bb-a285-ee4a1ded61ef","Handler":null,"Name":"","Endpoint":""} Jun 02 16:41:40.257955 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:40.257699 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 16:41:40.257955 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:40.257733 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 16:41:40.289342 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:40.289315 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:40.289462 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:40.289322 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:40.289462 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:40.289435 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:40.289578 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:40.289529 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:40.459201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:40.459162 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" event={"ID":"b3afa3b8-5caf-4480-a5ce-a4b275e61205","Type":"ContainerStarted","Data":"3e7ac8567c3292a355c555920fd7c70ee5d7d1f07b0e709408d5515b0201142a"} Jun 02 16:41:41.289784 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:41.289756 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:41.289937 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:41.289844 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:41.462984 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:41.462772 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" event={"ID":"b3afa3b8-5caf-4480-a5ce-a4b275e61205","Type":"ContainerStarted","Data":"1d6d2a70a7e8f806ea08effd6950e13ec65f41bf594efb2c23806e3c7840fd69"} Jun 02 16:41:41.465540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:41.465515 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"b7967303dd554efffc5f2f6bb04ed13bbbebe317dd82bc2ba9c1b9ac895b5468"} Jun 02 16:41:42.290223 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:42.290196 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:42.290394 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:42.290196 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:42.290448 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:42.290407 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:42.290448 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:42.290293 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:43.289939 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:43.289865 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:43.290480 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:43.290032 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:44.290068 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.289241 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:44.290068 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.289242 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:44.290068 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:44.289519 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:44.290068 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:44.289634 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:44.473614 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.473544 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" event={"ID":"8aa0ee3e-c79d-4bea-82b9-16712ccb1d21","Type":"ContainerStarted","Data":"f1fd567fe7782ceb82d281ff1e42c03f06ad43617062f5302447dac1f95bf5cf"} Jun 02 16:41:44.473960 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.473933 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:44.474076 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.473972 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:44.474076 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.473986 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:44.475223 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.475200 2555 generic.go:358] "Generic (PLEG): container finished" podID="9497fe5b-b10b-4958-9709-91518d7712ee" containerID="77541265fde5a73aa3ea07c962401a645a6828ffcf7b92016eee35b71fe08617" exitCode=0 Jun 02 16:41:44.475311 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.475233 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" event={"ID":"9497fe5b-b10b-4958-9709-91518d7712ee","Type":"ContainerDied","Data":"77541265fde5a73aa3ea07c962401a645a6828ffcf7b92016eee35b71fe08617"} Jun 02 16:41:44.488841 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.488822 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:44.488928 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.488879 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:41:44.505010 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.504974 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kp6lt" podStartSLOduration=6.612482803 podStartE2EDuration="27.504964676s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.782047482 +0000 UTC m=+3.067326199" lastFinishedPulling="2026-06-02 16:41:40.674529342 +0000 UTC m=+23.959808072" observedRunningTime="2026-06-02 16:41:41.49683093 +0000 UTC m=+24.782109666" watchObservedRunningTime="2026-06-02 16:41:44.504964676 +0000 UTC m=+27.790243454" Jun 02 16:41:44.505198 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:44.505178 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" podStartSLOduration=9.117672058 podStartE2EDuration="27.505173913s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.779804781 +0000 UTC m=+3.065083498" lastFinishedPulling="2026-06-02 16:41:38.16730664 +0000 UTC m=+21.452585353" observedRunningTime="2026-06-02 16:41:44.50350829 +0000 UTC m=+27.788787026" watchObservedRunningTime="2026-06-02 16:41:44.505173913 +0000 UTC m=+27.790452648" Jun 02 16:41:45.289300 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.289251 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:45.289438 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:45.289351 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:45.478471 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.478405 2555 generic.go:358] "Generic (PLEG): container finished" podID="9497fe5b-b10b-4958-9709-91518d7712ee" containerID="f282b7596aa61e4c37598f407ab56808358a641e9d043c4ff49b4e89fcd3768f" exitCode=0 Jun 02 16:41:45.478964 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.478487 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" event={"ID":"9497fe5b-b10b-4958-9709-91518d7712ee","Type":"ContainerDied","Data":"f282b7596aa61e4c37598f407ab56808358a641e9d043c4ff49b4e89fcd3768f"} Jun 02 16:41:45.837135 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.837065 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mvmcg"] Jun 02 16:41:45.837274 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.837183 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:45.837337 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:45.837269 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:45.839922 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.839895 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-62jdn"] Jun 02 16:41:45.840046 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.839988 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:45.840116 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:45.840054 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:45.849482 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.849460 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tsrc6"] Jun 02 16:41:45.849582 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:45.849539 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:45.849624 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:45.849603 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:46.481852 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:46.481638 2555 generic.go:358] "Generic (PLEG): container finished" podID="9497fe5b-b10b-4958-9709-91518d7712ee" containerID="2d3b27b798b8a91936b449606d3772f12a033e75a834a5036ff4d91506aeb212" exitCode=0 Jun 02 16:41:46.481852 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:46.481741 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" event={"ID":"9497fe5b-b10b-4958-9709-91518d7712ee","Type":"ContainerDied","Data":"2d3b27b798b8a91936b449606d3772f12a033e75a834a5036ff4d91506aeb212"} Jun 02 16:41:47.290326 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:47.290256 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:47.290493 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:47.290368 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:47.290564 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:47.290497 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:47.290614 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:47.290575 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:47.290678 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:47.290629 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:47.290736 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:47.290681 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:49.289964 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:49.289935 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:49.290505 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:49.289939 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:49.290505 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:49.290024 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tsrc6" podUID="5f240b59-1910-4ad3-a70e-f4e004d60bc5" Jun 02 16:41:49.290505 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:49.289949 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:49.290505 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:49.290094 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-62jdn" podUID="7b9840e4-9fde-4598-a167-ed011b54a1d3" Jun 02 16:41:49.290505 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:49.290207 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:41:50.959069 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:50.958994 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:50.959580 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:50.959124 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:50.959580 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:50.959187 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:22.959167679 +0000 UTC m=+66.244446414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:41:50.964732 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:50.964710 2555 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-253.ec2.internal" event="NodeReady" Jun 02 16:41:50.964902 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:50.964838 2555 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 16:41:51.010523 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.010487 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p6tqb"] Jun 02 16:41:51.059763 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.059723 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f7mv2"] Jun 02 16:41:51.059889 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.059863 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.062914 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.062893 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 16:41:51.063030 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.062899 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qcz2w\"" Jun 02 16:41:51.063228 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.063214 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 16:41:51.079634 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.079617 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p6tqb"] Jun 02 16:41:51.079634 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.079637 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f7mv2"] Jun 02 16:41:51.079817 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.079741 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:51.083264 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.083232 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 16:41:51.083374 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.083316 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vq24k\"" Jun 02 16:41:51.083374 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.083316 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 16:41:51.083579 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.083562 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 16:41:51.160694 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.160649 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:51.160877 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.160707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f9rp\" (UniqueName: \"kubernetes.io/projected/61567aca-4523-4e65-b0b9-1e41ab678400-kube-api-access-6f9rp\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.160877 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.160732 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdmfq\" (UniqueName: \"kubernetes.io/projected/29e15dd3-c0af-4a23-aca4-d572bf1ede24-kube-api-access-pdmfq\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:51.160877 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.160756 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/61567aca-4523-4e65-b0b9-1e41ab678400-config-volume\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.160877 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.160795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.160877 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.160814 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:41:51.160877 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.160839 2555 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:41:51.160877 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.160854 2555 projected.go:194] Error preparing data for projected volume kube-api-access-7ztc7 for pod openshift-network-diagnostics/network-check-target-tsrc6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:51.161157 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.160906 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7 podName:5f240b59-1910-4ad3-a70e-f4e004d60bc5 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:23.160889026 +0000 UTC m=+66.446167755 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7ztc7" (UniqueName: "kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7") pod "network-check-target-tsrc6" (UID: "5f240b59-1910-4ad3-a70e-f4e004d60bc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:41:51.161157 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.160936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:51.161157 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.160954 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61567aca-4523-4e65-b0b9-1e41ab678400-tmp-dir\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.261928 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.261853 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:51.261928 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.261894 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61567aca-4523-4e65-b0b9-1e41ab678400-tmp-dir\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.262125 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.262017 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:51.262125 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.262058 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6f9rp\" (UniqueName: \"kubernetes.io/projected/61567aca-4523-4e65-b0b9-1e41ab678400-kube-api-access-6f9rp\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.262125 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.262085 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:51.762066896 +0000 UTC m=+35.047345610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:41:51.262125 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.262118 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdmfq\" (UniqueName: \"kubernetes.io/projected/29e15dd3-c0af-4a23-aca4-d572bf1ede24-kube-api-access-pdmfq\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:51.262327 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.262144 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/61567aca-4523-4e65-b0b9-1e41ab678400-config-volume\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.262327 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.262184 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.262327 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.262222 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61567aca-4523-4e65-b0b9-1e41ab678400-tmp-dir\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.262327 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.262273 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:51.262327 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.262319 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:51.762305047 +0000 UTC m=+35.047583760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:41:51.262687 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.262669 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/61567aca-4523-4e65-b0b9-1e41ab678400-config-volume\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.277026 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.277003 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f9rp\" (UniqueName: \"kubernetes.io/projected/61567aca-4523-4e65-b0b9-1e41ab678400-kube-api-access-6f9rp\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.277172 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.277139 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdmfq\" (UniqueName: \"kubernetes.io/projected/29e15dd3-c0af-4a23-aca4-d572bf1ede24-kube-api-access-pdmfq\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:51.289324 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.289303 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:41:51.289437 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.289419 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:41:51.289686 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.289582 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:51.292544 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.292470 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:41:51.292544 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.292534 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 16:41:51.292783 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.292534 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:41:51.292862 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.292794 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:41:51.292918 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.292883 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f4pj7\"" Jun 02 16:41:51.292918 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.292900 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-729km\"" Jun 02 16:41:51.765247 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.765211 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:51.765420 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:51.765292 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:51.765420 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.765371 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:51.765420 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.765411 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:51.765532 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.765454 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:52.765431738 +0000 UTC m=+36.050710464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:41:51.765532 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:51.765470 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:52.765463928 +0000 UTC m=+36.050742642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:41:52.572340 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:52.572308 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:52.575089 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:52.575066 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7b9840e4-9fde-4598-a167-ed011b54a1d3-original-pull-secret\") pod \"global-pull-secret-syncer-62jdn\" (UID: \"7b9840e4-9fde-4598-a167-ed011b54a1d3\") " pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:52.773513 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:52.773475 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:52.773713 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:52.773629 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:52.773713 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:52.773637 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:52.773821 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:52.773729 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.773706785 +0000 UTC m=+38.058985502 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:41:52.773821 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:52.773731 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:52.773821 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:52.773766 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:54.77375696 +0000 UTC m=+38.059035689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:41:52.813499 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:52.813471 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-62jdn" Jun 02 16:41:53.812796 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:53.812612 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-62jdn"] Jun 02 16:41:53.884531 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:41:53.884498 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9840e4_9fde_4598_a167_ed011b54a1d3.slice/crio-d929ee2592a6d2adcb02b92c6fb392f4840ac1f68f41c2e6e0423f735f8db0b4 WatchSource:0}: Error finding container d929ee2592a6d2adcb02b92c6fb392f4840ac1f68f41c2e6e0423f735f8db0b4: Status 404 returned error can't find the container with id d929ee2592a6d2adcb02b92c6fb392f4840ac1f68f41c2e6e0423f735f8db0b4 Jun 02 16:41:54.497126 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:54.497090 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-62jdn" event={"ID":"7b9840e4-9fde-4598-a167-ed011b54a1d3","Type":"ContainerStarted","Data":"d929ee2592a6d2adcb02b92c6fb392f4840ac1f68f41c2e6e0423f735f8db0b4"} Jun 02 16:41:54.499457 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:54.499429 2555 generic.go:358] "Generic (PLEG): container finished" podID="9497fe5b-b10b-4958-9709-91518d7712ee" containerID="93af22e3dea1e59a8ba34d1c167dd278a2b5e0e095daefb1a54a915f64dd0b4f" exitCode=0 Jun 02 16:41:54.499588 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:54.499479 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" event={"ID":"9497fe5b-b10b-4958-9709-91518d7712ee","Type":"ContainerDied","Data":"93af22e3dea1e59a8ba34d1c167dd278a2b5e0e095daefb1a54a915f64dd0b4f"} Jun 02 16:41:54.787793 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:54.787761 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:54.787979 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:54.787831 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:54.787979 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:54.787935 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:54.788071 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:54.787991 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:58.787975452 +0000 UTC m=+42.073254165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:41:54.788071 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:54.787935 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:54.788154 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:54.788081 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:41:58.788057285 +0000 UTC m=+42.073336015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:41:55.503877 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:55.503838 2555 generic.go:358] "Generic (PLEG): container finished" podID="9497fe5b-b10b-4958-9709-91518d7712ee" containerID="899195422b09383c93d37c10b1368d6da8a70924c2b0bd6c7f259f06307e873c" exitCode=0 Jun 02 16:41:55.504248 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:55.503881 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" event={"ID":"9497fe5b-b10b-4958-9709-91518d7712ee","Type":"ContainerDied","Data":"899195422b09383c93d37c10b1368d6da8a70924c2b0bd6c7f259f06307e873c"} Jun 02 16:41:56.508846 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:56.508668 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" event={"ID":"9497fe5b-b10b-4958-9709-91518d7712ee","Type":"ContainerStarted","Data":"0c5f15a29b2fd8b9262ad5249cc0ef1d2fc77988b8a078953886fb07945a8451"} Jun 02 16:41:56.537491 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:56.537443 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c9xgw" podStartSLOduration=5.398842346 podStartE2EDuration="39.537429543s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:41:19.774002917 +0000 UTC m=+3.059281632" lastFinishedPulling="2026-06-02 16:41:53.9125901 +0000 UTC m=+37.197868829" observedRunningTime="2026-06-02 16:41:56.535765947 +0000 UTC m=+39.821044684" watchObservedRunningTime="2026-06-02 16:41:56.537429543 +0000 UTC m=+39.822708315" Jun 02 16:41:58.815670 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:58.815627 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:41:58.816026 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:58.815704 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:41:58.816026 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:58.815783 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:41:58.816026 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:58.815849 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:06.815833659 +0000 UTC m=+50.101112372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:41:58.816026 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:58.815787 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:41:58.816026 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:41:58.815926 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:06.81591359 +0000 UTC m=+50.101192303 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:41:59.515862 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:59.515832 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-62jdn" event={"ID":"7b9840e4-9fde-4598-a167-ed011b54a1d3","Type":"ContainerStarted","Data":"ca9e1bf05bcf223ed0be2ff482fa367cec75776670327732e85dea89f5c56739"} Jun 02 16:41:59.544665 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:41:59.544608 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-62jdn" podStartSLOduration=34.206566112 podStartE2EDuration="39.54459592s" podCreationTimestamp="2026-06-02 16:41:20 +0000 UTC" firstStartedPulling="2026-06-02 16:41:53.889756854 +0000 UTC m=+37.175035580" lastFinishedPulling="2026-06-02 16:41:59.227786671 +0000 UTC m=+42.513065388" observedRunningTime="2026-06-02 16:41:59.544180051 +0000 UTC m=+42.829458788" watchObservedRunningTime="2026-06-02 16:41:59.54459592 +0000 UTC m=+42.829874655" Jun 02 16:42:06.866764 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:06.866727 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:42:06.867178 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:06.866782 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:42:06.867178 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:06.866867 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:06.867178 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:06.866942 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:22.866924805 +0000 UTC m=+66.152203518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:42:06.867178 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:06.866872 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:06.867178 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:06.867021 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:22.867007368 +0000 UTC m=+66.152286101 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:42:16.501541 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:16.501509 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2dmbr" Jun 02 16:42:22.872435 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:22.872395 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:42:22.872850 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:22.872450 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:42:22.872850 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:22.872538 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:22.872850 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:22.872544 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:22.872850 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:22.872592 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:54.872576554 +0000 UTC m=+98.157855268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:42:22.872850 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:22.872605 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:42:54.872598733 +0000 UTC m=+98.157877447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:42:22.972714 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:22.972681 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:42:22.975826 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:22.975811 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:42:22.983388 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:22.983372 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 16:42:22.983438 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:22.983429 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:26.983414522 +0000 UTC m=+130.268693241 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : secret "metrics-daemon-secret" not found Jun 02 16:42:23.174605 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:23.174537 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:42:23.178112 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:23.178096 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:42:23.188705 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:23.188689 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:42:23.200524 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:23.200503 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ztc7\" (UniqueName: \"kubernetes.io/projected/5f240b59-1910-4ad3-a70e-f4e004d60bc5-kube-api-access-7ztc7\") pod \"network-check-target-tsrc6\" (UID: \"5f240b59-1910-4ad3-a70e-f4e004d60bc5\") " pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:42:23.410760 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:23.410729 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-729km\"" Jun 02 16:42:23.418324 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:23.418307 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:42:23.556373 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:23.556342 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tsrc6"] Jun 02 16:42:23.559399 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:42:23.559373 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f240b59_1910_4ad3_a70e_f4e004d60bc5.slice/crio-695597d84ead04ecf6831ede9043fd1721c09f331a3fea9e007c04ee27250186 WatchSource:0}: Error finding container 695597d84ead04ecf6831ede9043fd1721c09f331a3fea9e007c04ee27250186: Status 404 returned error can't find the container with id 695597d84ead04ecf6831ede9043fd1721c09f331a3fea9e007c04ee27250186 Jun 02 16:42:24.562630 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:24.562590 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tsrc6" event={"ID":"5f240b59-1910-4ad3-a70e-f4e004d60bc5","Type":"ContainerStarted","Data":"695597d84ead04ecf6831ede9043fd1721c09f331a3fea9e007c04ee27250186"} Jun 02 16:42:28.572313 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:28.572279 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tsrc6" event={"ID":"5f240b59-1910-4ad3-a70e-f4e004d60bc5","Type":"ContainerStarted","Data":"7af61628383c72e1585471ee6e662f00c2bab904be4d67875f1524e471dd8545"} Jun 02 16:42:28.572700 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:28.572418 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:42:33.954321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.954261 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tsrc6" podStartSLOduration=72.684808248 podStartE2EDuration="1m16.954243738s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:42:23.561188677 +0000 UTC m=+66.846467395" lastFinishedPulling="2026-06-02 16:42:27.830624157 +0000 UTC m=+71.115902885" observedRunningTime="2026-06-02 16:42:28.59063732 +0000 UTC m=+71.875916056" watchObservedRunningTime="2026-06-02 16:42:33.954243738 +0000 UTC m=+77.239522475" Jun 02 16:42:33.955190 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.955167 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw"] Jun 02 16:42:33.957079 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.957060 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" Jun 02 16:42:33.961147 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.961126 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 16:42:33.961257 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.961169 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 16:42:33.961257 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.961188 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 16:42:33.961257 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.961169 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 16:42:33.961498 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.961485 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-r66m7\"" Jun 02 16:42:33.967863 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:33.967844 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw"] Jun 02 16:42:34.032080 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.032057 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm"] Jun 02 16:42:34.033940 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.033924 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.036817 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.036792 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 16:42:34.036903 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.036840 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 16:42:34.036903 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.036793 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 16:42:34.036992 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.036929 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 16:42:34.044274 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.044255 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a13765ad-6d94-422a-9c42-886a6d24b224-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67586966db-bbxvw\" (UID: \"a13765ad-6d94-422a-9c42-886a6d24b224\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" Jun 02 16:42:34.044360 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.044284 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-ca\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.044360 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.044302 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.044360 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.044347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcvh5\" (UniqueName: \"kubernetes.io/projected/a13765ad-6d94-422a-9c42-886a6d24b224-kube-api-access-tcvh5\") pod \"managed-serviceaccount-addon-agent-67586966db-bbxvw\" (UID: \"a13765ad-6d94-422a-9c42-886a6d24b224\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" Jun 02 16:42:34.044569 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.044392 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxzdg\" (UniqueName: \"kubernetes.io/projected/d6fd5754-a634-4586-8e1c-0f9aefa955b3-kube-api-access-rxzdg\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.044569 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.044413 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.044569 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.044428 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-hub\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.044569 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.044442 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd5754-a634-4586-8e1c-0f9aefa955b3-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.045465 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.045445 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm"] Jun 02 16:42:34.145272 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.145243 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcvh5\" (UniqueName: \"kubernetes.io/projected/a13765ad-6d94-422a-9c42-886a6d24b224-kube-api-access-tcvh5\") pod \"managed-serviceaccount-addon-agent-67586966db-bbxvw\" (UID: \"a13765ad-6d94-422a-9c42-886a6d24b224\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" Jun 02 16:42:34.145404 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.145296 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxzdg\" (UniqueName: \"kubernetes.io/projected/d6fd5754-a634-4586-8e1c-0f9aefa955b3-kube-api-access-rxzdg\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.145404 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.145330 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.145404 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.145352 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-hub\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.145404 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.145376 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd5754-a634-4586-8e1c-0f9aefa955b3-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.145606 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.145446 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a13765ad-6d94-422a-9c42-886a6d24b224-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67586966db-bbxvw\" (UID: \"a13765ad-6d94-422a-9c42-886a6d24b224\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" Jun 02 16:42:34.145606 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.145473 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-ca\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.145606 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.145498 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.146264 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.146238 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d6fd5754-a634-4586-8e1c-0f9aefa955b3-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.147958 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.147937 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-hub\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.147958 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.147957 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.148185 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.148166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a13765ad-6d94-422a-9c42-886a6d24b224-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-67586966db-bbxvw\" (UID: \"a13765ad-6d94-422a-9c42-886a6d24b224\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" Jun 02 16:42:34.148437 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.148420 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-ca\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.148482 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.148472 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6fd5754-a634-4586-8e1c-0f9aefa955b3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.156067 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.156044 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcvh5\" (UniqueName: \"kubernetes.io/projected/a13765ad-6d94-422a-9c42-886a6d24b224-kube-api-access-tcvh5\") pod \"managed-serviceaccount-addon-agent-67586966db-bbxvw\" (UID: \"a13765ad-6d94-422a-9c42-886a6d24b224\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" Jun 02 16:42:34.156189 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.156169 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxzdg\" (UniqueName: \"kubernetes.io/projected/d6fd5754-a634-4586-8e1c-0f9aefa955b3-kube-api-access-rxzdg\") pod \"cluster-proxy-proxy-agent-5b7966697f-q7tfm\" (UID: \"d6fd5754-a634-4586-8e1c-0f9aefa955b3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.278181 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.278157 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" Jun 02 16:42:34.341602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.341571 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:42:34.396367 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.396335 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw"] Jun 02 16:42:34.399416 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:42:34.399388 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda13765ad_6d94_422a_9c42_886a6d24b224.slice/crio-919c190c3932c1deb91548fe1a152708770aa96b1dc224a33020e803865d8b8b WatchSource:0}: Error finding container 919c190c3932c1deb91548fe1a152708770aa96b1dc224a33020e803865d8b8b: Status 404 returned error can't find the container with id 919c190c3932c1deb91548fe1a152708770aa96b1dc224a33020e803865d8b8b Jun 02 16:42:34.464179 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.464147 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm"] Jun 02 16:42:34.469177 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:42:34.469149 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6fd5754_a634_4586_8e1c_0f9aefa955b3.slice/crio-79009c81cde32dc9ebd48bc2a2772f0a40114c0ed0ac815a892428cab6b2b07d WatchSource:0}: Error finding container 79009c81cde32dc9ebd48bc2a2772f0a40114c0ed0ac815a892428cab6b2b07d: Status 404 returned error can't find the container with id 79009c81cde32dc9ebd48bc2a2772f0a40114c0ed0ac815a892428cab6b2b07d Jun 02 16:42:34.584822 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.584746 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" event={"ID":"d6fd5754-a634-4586-8e1c-0f9aefa955b3","Type":"ContainerStarted","Data":"79009c81cde32dc9ebd48bc2a2772f0a40114c0ed0ac815a892428cab6b2b07d"} Jun 02 16:42:34.585718 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:34.585690 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" event={"ID":"a13765ad-6d94-422a-9c42-886a6d24b224","Type":"ContainerStarted","Data":"919c190c3932c1deb91548fe1a152708770aa96b1dc224a33020e803865d8b8b"} Jun 02 16:42:39.598542 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:39.598499 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" event={"ID":"d6fd5754-a634-4586-8e1c-0f9aefa955b3","Type":"ContainerStarted","Data":"3c85a9955ecd639e878f5917e7a9d556dd9abd830efcd39aa8f77e0eca235efa"} Jun 02 16:42:39.599635 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:39.599610 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" event={"ID":"a13765ad-6d94-422a-9c42-886a6d24b224","Type":"ContainerStarted","Data":"f37ce0616476106307f11c9a656d95acb413cf30f893bfd63dc4bce1cd4ee1ee"} Jun 02 16:42:39.619160 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:39.619114 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" podStartSLOduration=2.204406403 podStartE2EDuration="6.619100019s" podCreationTimestamp="2026-06-02 16:42:33 +0000 UTC" firstStartedPulling="2026-06-02 16:42:34.401366226 +0000 UTC m=+77.686644942" lastFinishedPulling="2026-06-02 16:42:38.816059844 +0000 UTC m=+82.101338558" observedRunningTime="2026-06-02 16:42:39.618309248 +0000 UTC m=+82.903587985" watchObservedRunningTime="2026-06-02 16:42:39.619100019 +0000 UTC m=+82.904378755" Jun 02 16:42:42.607545 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:42.607513 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" event={"ID":"d6fd5754-a634-4586-8e1c-0f9aefa955b3","Type":"ContainerStarted","Data":"f9ceba5b456efb6c64c02d881f4e7f3a0b70eb7b428b0263538fb9741af84b79"} Jun 02 16:42:42.607545 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:42.607549 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" event={"ID":"d6fd5754-a634-4586-8e1c-0f9aefa955b3","Type":"ContainerStarted","Data":"041c5eb315bc1a2f70b25ac668eee211bc3de7e55976a69af23066bf8259a78a"} Jun 02 16:42:42.635770 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:42.635716 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" podStartSLOduration=1.428529099 podStartE2EDuration="8.63570343s" podCreationTimestamp="2026-06-02 16:42:34 +0000 UTC" firstStartedPulling="2026-06-02 16:42:34.471018393 +0000 UTC m=+77.756297107" lastFinishedPulling="2026-06-02 16:42:41.678192723 +0000 UTC m=+84.963471438" observedRunningTime="2026-06-02 16:42:42.635285453 +0000 UTC m=+85.920564188" watchObservedRunningTime="2026-06-02 16:42:42.63570343 +0000 UTC m=+85.920982166" Jun 02 16:42:54.890325 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:54.890267 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:42:54.890325 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:54.890342 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:42:54.890934 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:54.890429 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:42:54.890934 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:54.890430 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:42:54.890934 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:54.890479 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:58.890465457 +0000 UTC m=+162.175744171 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:42:54.890934 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:42:54.890498 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:43:58.890484013 +0000 UTC m=+162.175762727 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:42:59.576179 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:42:59.576147 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tsrc6" Jun 02 16:43:27.005523 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:43:27.005449 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:43:27.006095 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:27.005599 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 16:43:27.006095 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:27.005707 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs podName:eef1fcdf-cbb3-4ab9-ae11-086fc3357517 nodeName:}" failed. No retries permitted until 2026-06-02 16:45:29.005686622 +0000 UTC m=+252.290965337 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs") pod "network-metrics-daemon-mvmcg" (UID: "eef1fcdf-cbb3-4ab9-ae11-086fc3357517") : secret "metrics-daemon-secret" not found Jun 02 16:43:54.068643 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:54.068597 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p6tqb" podUID="61567aca-4523-4e65-b0b9-1e41ab678400" Jun 02 16:43:54.089888 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:54.089849 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-f7mv2" podUID="29e15dd3-c0af-4a23-aca4-d572bf1ede24" Jun 02 16:43:54.301301 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:54.301257 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mvmcg" podUID="eef1fcdf-cbb3-4ab9-ae11-086fc3357517" Jun 02 16:43:54.783294 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:43:54.783263 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6tqb" Jun 02 16:43:58.918911 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:43:58.918870 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:43:58.919348 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:43:58.918930 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:43:58.919348 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:58.919024 2555 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:43:58.919348 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:58.919098 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert podName:29e15dd3-c0af-4a23-aca4-d572bf1ede24 nodeName:}" failed. No retries permitted until 2026-06-02 16:46:00.919082438 +0000 UTC m=+284.204361158 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert") pod "ingress-canary-f7mv2" (UID: "29e15dd3-c0af-4a23-aca4-d572bf1ede24") : secret "canary-serving-cert" not found Jun 02 16:43:58.919348 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:58.919024 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:43:58.919348 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:43:58.919152 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls podName:61567aca-4523-4e65-b0b9-1e41ab678400 nodeName:}" failed. No retries permitted until 2026-06-02 16:46:00.919140931 +0000 UTC m=+284.204419646 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls") pod "dns-default-p6tqb" (UID: "61567aca-4523-4e65-b0b9-1e41ab678400") : secret "dns-default-metrics-tls" not found Jun 02 16:44:05.888449 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:05.888411 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52tqs_e2664832-ce41-46a2-806b-e2176632c5be/dns-node-resolver/0.log" Jun 02 16:44:06.886127 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:06.886033 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7s97n_fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4/node-ca/0.log" Jun 02 16:44:08.289754 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:08.289724 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:44:08.290114 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:08.289895 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:44:27.222489 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.222456 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-twsrw"] Jun 02 16:44:27.225246 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.225231 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.228059 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.228031 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 16:44:27.229370 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.229348 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 16:44:27.229478 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.229378 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 16:44:27.229478 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.229398 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 16:44:27.229478 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.229409 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8m8cx\"" Jun 02 16:44:27.238459 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.238437 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-twsrw"] Jun 02 16:44:27.400928 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.400909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4d49\" (UniqueName: \"kubernetes.io/projected/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-kube-api-access-l4d49\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.401028 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.400960 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.401028 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.401002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.401110 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.401034 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-crio-socket\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.401110 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.401079 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-data-volume\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.501908 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.501860 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-crio-socket\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.501908 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.501897 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-data-volume\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.502023 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.501916 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4d49\" (UniqueName: \"kubernetes.io/projected/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-kube-api-access-l4d49\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.502023 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.501954 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.502023 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.501969 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.502023 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.501968 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-crio-socket\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.502238 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.502211 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-data-volume\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.502393 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.502379 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.504133 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.504118 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.513947 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.513930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4d49\" (UniqueName: \"kubernetes.io/projected/3c5cb5ac-7252-4ee8-bba7-93581e6aa287-kube-api-access-l4d49\") pod \"insights-runtime-extractor-twsrw\" (UID: \"3c5cb5ac-7252-4ee8-bba7-93581e6aa287\") " pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.534449 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.534434 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-twsrw" Jun 02 16:44:27.653983 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.653956 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-twsrw"] Jun 02 16:44:27.861339 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.861242 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-twsrw" event={"ID":"3c5cb5ac-7252-4ee8-bba7-93581e6aa287","Type":"ContainerStarted","Data":"25ca20400632c87888de8bb53198c3970d7a3f30b83628890dd33750568f2a44"} Jun 02 16:44:27.861339 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:27.861284 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-twsrw" event={"ID":"3c5cb5ac-7252-4ee8-bba7-93581e6aa287","Type":"ContainerStarted","Data":"f75810b76fb32f3822c5f22418fe8587ea2572a66b2fb223b9ca5c59ba7b86fd"} Jun 02 16:44:28.865062 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:28.865032 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-twsrw" event={"ID":"3c5cb5ac-7252-4ee8-bba7-93581e6aa287","Type":"ContainerStarted","Data":"d46bb4a4fc9f479398ccb86104456db4ab363a17952d933b857998abc7bc6748"} Jun 02 16:44:30.871743 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:30.871705 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-twsrw" event={"ID":"3c5cb5ac-7252-4ee8-bba7-93581e6aa287","Type":"ContainerStarted","Data":"8992f175c6a0ed0a4f6cdf8d0df89a02fa04d8d0bbee25f0ac246919337cfe28"} Jun 02 16:44:30.889258 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:30.889214 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-twsrw" podStartSLOduration=1.399874308 podStartE2EDuration="3.889198813s" podCreationTimestamp="2026-06-02 16:44:27 +0000 UTC" firstStartedPulling="2026-06-02 16:44:27.713471492 +0000 UTC m=+190.998750206" lastFinishedPulling="2026-06-02 16:44:30.202795996 +0000 UTC m=+193.488074711" observedRunningTime="2026-06-02 16:44:30.888436412 +0000 UTC m=+194.173715152" watchObservedRunningTime="2026-06-02 16:44:30.889198813 +0000 UTC m=+194.174477550" Jun 02 16:44:34.056414 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.056385 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x"] Jun 02 16:44:34.059195 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.059180 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" Jun 02 16:44:34.062395 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.062370 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 16:44:34.062518 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.062456 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9zpks\"" Jun 02 16:44:34.067389 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.067369 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x"] Jun 02 16:44:34.145829 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.145801 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4b50dc3-ed39-44a8-ad0d-75c6afb62d33-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9tj7x\" (UID: \"c4b50dc3-ed39-44a8-ad0d-75c6afb62d33\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" Jun 02 16:44:34.246529 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.246495 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4b50dc3-ed39-44a8-ad0d-75c6afb62d33-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9tj7x\" (UID: \"c4b50dc3-ed39-44a8-ad0d-75c6afb62d33\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" Jun 02 16:44:34.246644 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:44:34.246629 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 16:44:34.246713 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:44:34.246702 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4b50dc3-ed39-44a8-ad0d-75c6afb62d33-tls-certificates podName:c4b50dc3-ed39-44a8-ad0d-75c6afb62d33 nodeName:}" failed. No retries permitted until 2026-06-02 16:44:34.746686749 +0000 UTC m=+198.031965484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c4b50dc3-ed39-44a8-ad0d-75c6afb62d33-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-9tj7x" (UID: "c4b50dc3-ed39-44a8-ad0d-75c6afb62d33") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 16:44:34.751690 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.750108 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4b50dc3-ed39-44a8-ad0d-75c6afb62d33-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9tj7x\" (UID: \"c4b50dc3-ed39-44a8-ad0d-75c6afb62d33\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" Jun 02 16:44:34.753428 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.753303 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c4b50dc3-ed39-44a8-ad0d-75c6afb62d33-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9tj7x\" (UID: \"c4b50dc3-ed39-44a8-ad0d-75c6afb62d33\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" Jun 02 16:44:34.967597 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:34.967543 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" Jun 02 16:44:35.082024 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:35.081996 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x"] Jun 02 16:44:35.084911 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:44:35.084881 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b50dc3_ed39_44a8_ad0d_75c6afb62d33.slice/crio-47c60ea34c3234c6c4b0fd4d5c2382112335f4c4f35da335b5f479307e2e8675 WatchSource:0}: Error finding container 47c60ea34c3234c6c4b0fd4d5c2382112335f4c4f35da335b5f479307e2e8675: Status 404 returned error can't find the container with id 47c60ea34c3234c6c4b0fd4d5c2382112335f4c4f35da335b5f479307e2e8675 Jun 02 16:44:35.884285 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:35.884248 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" event={"ID":"c4b50dc3-ed39-44a8-ad0d-75c6afb62d33","Type":"ContainerStarted","Data":"47c60ea34c3234c6c4b0fd4d5c2382112335f4c4f35da335b5f479307e2e8675"} Jun 02 16:44:36.887769 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:36.887733 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" event={"ID":"c4b50dc3-ed39-44a8-ad0d-75c6afb62d33","Type":"ContainerStarted","Data":"24ac8cca6f9632c4e866baf65e3b90d82921851116208e03b3aeecc948c0b791"} Jun 02 16:44:36.888259 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:36.887930 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" Jun 02 16:44:36.892781 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:36.892760 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" Jun 02 16:44:36.907001 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:36.906967 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9tj7x" podStartSLOduration=1.594328733 podStartE2EDuration="2.906955913s" podCreationTimestamp="2026-06-02 16:44:34 +0000 UTC" firstStartedPulling="2026-06-02 16:44:35.086860299 +0000 UTC m=+198.372139014" lastFinishedPulling="2026-06-02 16:44:36.39948748 +0000 UTC m=+199.684766194" observedRunningTime="2026-06-02 16:44:36.90675959 +0000 UTC m=+200.192038318" watchObservedRunningTime="2026-06-02 16:44:36.906955913 +0000 UTC m=+200.192234648" Jun 02 16:44:39.896403 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:39.896368 2555 generic.go:358] "Generic (PLEG): container finished" podID="a13765ad-6d94-422a-9c42-886a6d24b224" containerID="f37ce0616476106307f11c9a656d95acb413cf30f893bfd63dc4bce1cd4ee1ee" exitCode=255 Jun 02 16:44:39.896803 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:39.896417 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" event={"ID":"a13765ad-6d94-422a-9c42-886a6d24b224","Type":"ContainerDied","Data":"f37ce0616476106307f11c9a656d95acb413cf30f893bfd63dc4bce1cd4ee1ee"} Jun 02 16:44:39.896803 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:39.896703 2555 scope.go:117] "RemoveContainer" containerID="f37ce0616476106307f11c9a656d95acb413cf30f893bfd63dc4bce1cd4ee1ee" Jun 02 16:44:40.900555 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:40.900516 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-67586966db-bbxvw" event={"ID":"a13765ad-6d94-422a-9c42-886a6d24b224","Type":"ContainerStarted","Data":"1ff28a221daf3acbcfeadda49e4f12b218c78801c06d096b502b4c22b3250577"} Jun 02 16:44:41.502539 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.502511 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-9n8h4"] Jun 02 16:44:41.505610 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.505592 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.508892 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.508868 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 16:44:41.508987 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.508950 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 16:44:41.509095 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.509079 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 16:44:41.510063 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.510045 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 16:44:41.510249 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.510234 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 16:44:41.510249 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.510243 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4gbcd\"" Jun 02 16:44:41.521286 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.521267 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-9n8h4"] Jun 02 16:44:41.522101 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.522082 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-khhtl"] Jun 02 16:44:41.525138 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.525118 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.527604 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.527584 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sx4bp\"" Jun 02 16:44:41.527604 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.527600 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 16:44:41.527802 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.527639 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 16:44:41.527802 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.527688 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 16:44:41.596567 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596544 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-root\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.596673 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596575 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-textfile\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.596673 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596639 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-sys\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.596755 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596680 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-wtmp\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.596755 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-accelerators-collector-config\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.596817 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596758 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.596817 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596780 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0473480-9722-4d12-9519-7ea61bd7ae60-metrics-client-ca\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.596817 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.596911 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596815 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-tls\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.596911 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596841 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn4jm\" (UniqueName: \"kubernetes.io/projected/ec01728e-a012-498c-a46e-84627326651c-kube-api-access-xn4jm\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.596911 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4556\" (UniqueName: \"kubernetes.io/projected/f0473480-9722-4d12-9519-7ea61bd7ae60-kube-api-access-b4556\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.596911 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec01728e-a012-498c-a46e-84627326651c-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.597027 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.596948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.697703 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.697680 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.697776 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.697707 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0473480-9722-4d12-9519-7ea61bd7ae60-metrics-client-ca\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.697776 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.697724 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.697776 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.697740 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-tls\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.697776 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.697758 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn4jm\" (UniqueName: \"kubernetes.io/projected/ec01728e-a012-498c-a46e-84627326651c-kube-api-access-xn4jm\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.697976 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.697791 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4556\" (UniqueName: \"kubernetes.io/projected/f0473480-9722-4d12-9519-7ea61bd7ae60-kube-api-access-b4556\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.697976 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:44:41.697833 2555 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 16:44:41.697976 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:44:41.697881 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-tls podName:ec01728e-a012-498c-a46e-84627326651c nodeName:}" failed. No retries permitted until 2026-06-02 16:44:42.197864143 +0000 UTC m=+205.483142857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-9n8h4" (UID: "ec01728e-a012-498c-a46e-84627326651c") : secret "openshift-state-metrics-tls" not found Jun 02 16:44:41.698133 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698120 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec01728e-a012-498c-a46e-84627326651c-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.698189 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698165 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698232 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698194 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-root\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698269 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698231 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-textfile\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698324 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698296 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-sys\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698380 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698330 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-wtmp\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698431 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698377 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-accelerators-collector-config\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698585 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698560 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-textfile\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698585 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698571 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-wtmp\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698786 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698625 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-sys\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698786 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698330 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0473480-9722-4d12-9519-7ea61bd7ae60-metrics-client-ca\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698786 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698639 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0473480-9722-4d12-9519-7ea61bd7ae60-root\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.698951 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698811 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec01728e-a012-498c-a46e-84627326651c-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.698951 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.698839 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-accelerators-collector-config\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.700383 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.700365 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.700714 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.700697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-tls\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.700765 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.700723 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0473480-9722-4d12-9519-7ea61bd7ae60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.707305 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.707274 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4556\" (UniqueName: \"kubernetes.io/projected/f0473480-9722-4d12-9519-7ea61bd7ae60-kube-api-access-b4556\") pod \"node-exporter-khhtl\" (UID: \"f0473480-9722-4d12-9519-7ea61bd7ae60\") " pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.707734 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.707712 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn4jm\" (UniqueName: \"kubernetes.io/projected/ec01728e-a012-498c-a46e-84627326651c-kube-api-access-xn4jm\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:41.833744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.833718 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-khhtl" Jun 02 16:44:41.841199 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:44:41.841173 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0473480_9722_4d12_9519_7ea61bd7ae60.slice/crio-cba1029a577da2f711abe3f3a5b1317d5c74b64963a476576b6245e738d9d902 WatchSource:0}: Error finding container cba1029a577da2f711abe3f3a5b1317d5c74b64963a476576b6245e738d9d902: Status 404 returned error can't find the container with id cba1029a577da2f711abe3f3a5b1317d5c74b64963a476576b6245e738d9d902 Jun 02 16:44:41.903533 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:41.903500 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-khhtl" event={"ID":"f0473480-9722-4d12-9519-7ea61bd7ae60","Type":"ContainerStarted","Data":"cba1029a577da2f711abe3f3a5b1317d5c74b64963a476576b6245e738d9d902"} Jun 02 16:44:42.202351 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:42.202293 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:42.204462 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:42.204445 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec01728e-a012-498c-a46e-84627326651c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-9n8h4\" (UID: \"ec01728e-a012-498c-a46e-84627326651c\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:42.414313 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:42.414288 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" Jun 02 16:44:42.546186 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:42.546155 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-9n8h4"] Jun 02 16:44:42.743073 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:44:42.742996 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec01728e_a012_498c_a46e_84627326651c.slice/crio-3f15d68e2a07a3e2253651f145a5fb74d92381b0b40ead04df70121c754daf40 WatchSource:0}: Error finding container 3f15d68e2a07a3e2253651f145a5fb74d92381b0b40ead04df70121c754daf40: Status 404 returned error can't find the container with id 3f15d68e2a07a3e2253651f145a5fb74d92381b0b40ead04df70121c754daf40 Jun 02 16:44:42.907756 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:42.907726 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-khhtl" event={"ID":"f0473480-9722-4d12-9519-7ea61bd7ae60","Type":"ContainerStarted","Data":"5fd411d79889c6fe5919599235e30a2dec7ea3b20007025fd3a4bbbf72ad3d10"} Jun 02 16:44:42.909827 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:42.909803 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" event={"ID":"ec01728e-a012-498c-a46e-84627326651c","Type":"ContainerStarted","Data":"977979d2f1e11ed0968cbf24411b888fa9b60dd2ee00f220fbf7ad135a3934b4"} Jun 02 16:44:42.909934 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:42.909834 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" event={"ID":"ec01728e-a012-498c-a46e-84627326651c","Type":"ContainerStarted","Data":"430237e40249047424135a205c633cefa6e86ecab48983fc98f52ce1a8b88edc"} Jun 02 16:44:42.909934 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:42.909848 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" event={"ID":"ec01728e-a012-498c-a46e-84627326651c","Type":"ContainerStarted","Data":"3f15d68e2a07a3e2253651f145a5fb74d92381b0b40ead04df70121c754daf40"} Jun 02 16:44:43.914099 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:43.914074 2555 generic.go:358] "Generic (PLEG): container finished" podID="f0473480-9722-4d12-9519-7ea61bd7ae60" containerID="5fd411d79889c6fe5919599235e30a2dec7ea3b20007025fd3a4bbbf72ad3d10" exitCode=0 Jun 02 16:44:43.914444 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:43.914157 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-khhtl" event={"ID":"f0473480-9722-4d12-9519-7ea61bd7ae60","Type":"ContainerDied","Data":"5fd411d79889c6fe5919599235e30a2dec7ea3b20007025fd3a4bbbf72ad3d10"} Jun 02 16:44:43.916159 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:43.916133 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" event={"ID":"ec01728e-a012-498c-a46e-84627326651c","Type":"ContainerStarted","Data":"28144f7b96999616d64a73cd4cb7d1784a061072720c82c9703c6d6fe6b470da"} Jun 02 16:44:43.954823 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:43.954758 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-9n8h4" podStartSLOduration=1.9872940460000001 podStartE2EDuration="2.954744866s" podCreationTimestamp="2026-06-02 16:44:41 +0000 UTC" firstStartedPulling="2026-06-02 16:44:42.867482745 +0000 UTC m=+206.152761459" lastFinishedPulling="2026-06-02 16:44:43.834933556 +0000 UTC m=+207.120212279" observedRunningTime="2026-06-02 16:44:43.953894386 +0000 UTC m=+207.239173122" watchObservedRunningTime="2026-06-02 16:44:43.954744866 +0000 UTC m=+207.240023601" Jun 02 16:44:44.920572 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:44.920529 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-khhtl" event={"ID":"f0473480-9722-4d12-9519-7ea61bd7ae60","Type":"ContainerStarted","Data":"59b1133e08135284ad0929efb15419607fcea4052baa024f91b7456dc23dcc53"} Jun 02 16:44:44.920978 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:44.920578 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-khhtl" event={"ID":"f0473480-9722-4d12-9519-7ea61bd7ae60","Type":"ContainerStarted","Data":"cc58c8b34c7c0c9890a9c35fa7077c4e3267aae26bb5b97fc7b57486fae8a992"} Jun 02 16:44:44.942511 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:44:44.942465 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-khhtl" podStartSLOduration=2.991245465 podStartE2EDuration="3.942451032s" podCreationTimestamp="2026-06-02 16:44:41 +0000 UTC" firstStartedPulling="2026-06-02 16:44:41.843174824 +0000 UTC m=+205.128453538" lastFinishedPulling="2026-06-02 16:44:42.794380377 +0000 UTC m=+206.079659105" observedRunningTime="2026-06-02 16:44:44.940591916 +0000 UTC m=+208.225870655" watchObservedRunningTime="2026-06-02 16:44:44.942451032 +0000 UTC m=+208.227729804" Jun 02 16:45:13.017593 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.017555 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cd598fc56-jszg7"] Jun 02 16:45:13.021923 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.021900 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.024810 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.024784 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 16:45:13.024932 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.024839 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 16:45:13.024932 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.024849 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 16:45:13.024932 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.024853 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gbszc\"" Jun 02 16:45:13.026105 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.026085 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 16:45:13.026105 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.026105 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 16:45:13.026271 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.026163 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 16:45:13.026271 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.026232 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 16:45:13.034612 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.034592 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd598fc56-jszg7"] Jun 02 16:45:13.125430 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.125396 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-service-ca\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.125536 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.125437 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wch7\" (UniqueName: \"kubernetes.io/projected/fd364ebe-453e-4559-a510-f91405bc9686-kube-api-access-2wch7\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.125536 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.125473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-oauth-config\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.125536 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.125518 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-serving-cert\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.125691 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.125562 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-console-config\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.125691 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.125596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-oauth-serving-cert\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.226300 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.226270 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-oauth-config\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.226460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.226349 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-serving-cert\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.226460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.226384 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-console-config\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.226460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.226427 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-oauth-serving-cert\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.226460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.226457 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-service-ca\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.226686 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.226485 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wch7\" (UniqueName: \"kubernetes.io/projected/fd364ebe-453e-4559-a510-f91405bc9686-kube-api-access-2wch7\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.227145 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.227123 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-oauth-serving-cert\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.227260 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.227203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-console-config\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.227260 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.227203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-service-ca\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.228711 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.228685 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-oauth-config\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.228810 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.228795 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-serving-cert\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.236876 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.236859 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wch7\" (UniqueName: \"kubernetes.io/projected/fd364ebe-453e-4559-a510-f91405bc9686-kube-api-access-2wch7\") pod \"console-6cd598fc56-jszg7\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.330587 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.330508 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:13.455689 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.455646 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cd598fc56-jszg7"] Jun 02 16:45:13.458155 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:45:13.458129 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd364ebe_453e_4559_a510_f91405bc9686.slice/crio-9c8cd3721cd8dedcd70ec9f25da1533a179aca863543454e6e34f962137aa663 WatchSource:0}: Error finding container 9c8cd3721cd8dedcd70ec9f25da1533a179aca863543454e6e34f962137aa663: Status 404 returned error can't find the container with id 9c8cd3721cd8dedcd70ec9f25da1533a179aca863543454e6e34f962137aa663 Jun 02 16:45:13.992404 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:13.992371 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd598fc56-jszg7" event={"ID":"fd364ebe-453e-4559-a510-f91405bc9686","Type":"ContainerStarted","Data":"9c8cd3721cd8dedcd70ec9f25da1533a179aca863543454e6e34f962137aa663"} Jun 02 16:45:14.343486 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:14.343429 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" podUID="d6fd5754-a634-4586-8e1c-0f9aefa955b3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 16:45:15.426328 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.426293 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8fcdc96c-mhnjb"] Jun 02 16:45:15.431776 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.431755 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.441775 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.441751 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 16:45:15.446079 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.446052 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8fcdc96c-mhnjb"] Jun 02 16:45:15.545561 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.545523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-oauth-serving-cert\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.545763 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.545579 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-trusted-ca-bundle\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.545763 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.545665 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-config\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.545889 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.545765 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-oauth-config\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.545889 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.545807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-serving-cert\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.545889 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.545829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-service-ca\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.546045 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.545906 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5dw2\" (UniqueName: \"kubernetes.io/projected/8ff3edbc-e56b-4286-b677-b7e154f5cca6-kube-api-access-m5dw2\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.647187 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.647151 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-serving-cert\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.647187 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.647185 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-service-ca\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.647388 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.647214 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5dw2\" (UniqueName: \"kubernetes.io/projected/8ff3edbc-e56b-4286-b677-b7e154f5cca6-kube-api-access-m5dw2\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.647388 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.647270 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-oauth-serving-cert\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.647388 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.647323 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-trusted-ca-bundle\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.647388 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.647352 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-config\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.647579 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.647400 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-oauth-config\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.648059 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.648007 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-service-ca\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.648187 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.648086 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-oauth-serving-cert\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.648187 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.648104 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-config\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.648299 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.648246 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-trusted-ca-bundle\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.649897 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.649877 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-oauth-config\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.650801 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.650779 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-serving-cert\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.658189 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.658164 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5dw2\" (UniqueName: \"kubernetes.io/projected/8ff3edbc-e56b-4286-b677-b7e154f5cca6-kube-api-access-m5dw2\") pod \"console-7d8fcdc96c-mhnjb\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:15.740889 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:15.740819 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:16.868072 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:16.868045 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8fcdc96c-mhnjb"] Jun 02 16:45:16.871274 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:45:16.871250 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff3edbc_e56b_4286_b677_b7e154f5cca6.slice/crio-f9892893e2f6daed6d0db91f7903ac00539f240affd90928f92f61d69232910c WatchSource:0}: Error finding container f9892893e2f6daed6d0db91f7903ac00539f240affd90928f92f61d69232910c: Status 404 returned error can't find the container with id f9892893e2f6daed6d0db91f7903ac00539f240affd90928f92f61d69232910c Jun 02 16:45:17.001430 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:17.001343 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd598fc56-jszg7" event={"ID":"fd364ebe-453e-4559-a510-f91405bc9686","Type":"ContainerStarted","Data":"bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2"} Jun 02 16:45:17.002635 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:17.002611 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8fcdc96c-mhnjb" event={"ID":"8ff3edbc-e56b-4286-b677-b7e154f5cca6","Type":"ContainerStarted","Data":"b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a"} Jun 02 16:45:17.002757 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:17.002639 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8fcdc96c-mhnjb" event={"ID":"8ff3edbc-e56b-4286-b677-b7e154f5cca6","Type":"ContainerStarted","Data":"f9892893e2f6daed6d0db91f7903ac00539f240affd90928f92f61d69232910c"} Jun 02 16:45:17.025449 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:17.025405 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6cd598fc56-jszg7" podStartSLOduration=0.685459935 podStartE2EDuration="4.025393614s" podCreationTimestamp="2026-06-02 16:45:13 +0000 UTC" firstStartedPulling="2026-06-02 16:45:13.461430092 +0000 UTC m=+236.746708807" lastFinishedPulling="2026-06-02 16:45:16.801363736 +0000 UTC m=+240.086642486" observedRunningTime="2026-06-02 16:45:17.023526093 +0000 UTC m=+240.308804820" watchObservedRunningTime="2026-06-02 16:45:17.025393614 +0000 UTC m=+240.310672351" Jun 02 16:45:17.046427 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:17.046388 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7d8fcdc96c-mhnjb" podStartSLOduration=2.046374808 podStartE2EDuration="2.046374808s" podCreationTimestamp="2026-06-02 16:45:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:45:17.045534093 +0000 UTC m=+240.330812830" watchObservedRunningTime="2026-06-02 16:45:17.046374808 +0000 UTC m=+240.331653543" Jun 02 16:45:23.331027 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:23.330992 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:23.331027 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:23.331029 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:45:23.332446 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:23.332422 2555 patch_prober.go:28] interesting pod/console-6cd598fc56-jszg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 02 16:45:23.332548 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:23.332464 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cd598fc56-jszg7" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 02 16:45:24.343563 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:24.343521 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" podUID="d6fd5754-a634-4586-8e1c-0f9aefa955b3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 16:45:25.741783 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:25.741730 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:25.741783 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:25.741786 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:45:25.743399 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:25.743369 2555 patch_prober.go:28] interesting pod/console-7d8fcdc96c-mhnjb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 02 16:45:25.743547 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:25.743430 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d8fcdc96c-mhnjb" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 02 16:45:29.047428 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:29.047391 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:45:29.049990 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:29.049963 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eef1fcdf-cbb3-4ab9-ae11-086fc3357517-metrics-certs\") pod \"network-metrics-daemon-mvmcg\" (UID: \"eef1fcdf-cbb3-4ab9-ae11-086fc3357517\") " pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:45:29.294273 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:29.294243 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f4pj7\"" Jun 02 16:45:29.301931 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:29.301874 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mvmcg" Jun 02 16:45:29.449097 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:29.449072 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mvmcg"] Jun 02 16:45:29.451331 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:45:29.451303 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef1fcdf_cbb3_4ab9_ae11_086fc3357517.slice/crio-0d6b98a7876bf076885cd520296fff943dd91039925ed361d3083f6a1eaec4e4 WatchSource:0}: Error finding container 0d6b98a7876bf076885cd520296fff943dd91039925ed361d3083f6a1eaec4e4: Status 404 returned error can't find the container with id 0d6b98a7876bf076885cd520296fff943dd91039925ed361d3083f6a1eaec4e4 Jun 02 16:45:30.041754 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:30.041718 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mvmcg" event={"ID":"eef1fcdf-cbb3-4ab9-ae11-086fc3357517","Type":"ContainerStarted","Data":"0d6b98a7876bf076885cd520296fff943dd91039925ed361d3083f6a1eaec4e4"} Jun 02 16:45:31.047684 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:31.047631 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mvmcg" event={"ID":"eef1fcdf-cbb3-4ab9-ae11-086fc3357517","Type":"ContainerStarted","Data":"719207a8e0a3ddff22a3292691d25aae1aca6ed2ed0f5b317ef441af2d253b63"} Jun 02 16:45:31.047684 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:31.047683 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mvmcg" event={"ID":"eef1fcdf-cbb3-4ab9-ae11-086fc3357517","Type":"ContainerStarted","Data":"47b091dcbbd98166e96cacd4e3add3973201be780d9cb0c2aa259c55099f1151"} Jun 02 16:45:31.065588 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:31.065541 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mvmcg" podStartSLOduration=253.216129847 podStartE2EDuration="4m14.065527921s" podCreationTimestamp="2026-06-02 16:41:17 +0000 UTC" firstStartedPulling="2026-06-02 16:45:29.453057439 +0000 UTC m=+252.738336152" lastFinishedPulling="2026-06-02 16:45:30.302455512 +0000 UTC m=+253.587734226" observedRunningTime="2026-06-02 16:45:31.064774855 +0000 UTC m=+254.350053591" watchObservedRunningTime="2026-06-02 16:45:31.065527921 +0000 UTC m=+254.350806656" Jun 02 16:45:33.330951 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:33.330923 2555 patch_prober.go:28] interesting pod/console-6cd598fc56-jszg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 02 16:45:33.331325 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:33.330978 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cd598fc56-jszg7" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 02 16:45:34.343357 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:34.343320 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" podUID="d6fd5754-a634-4586-8e1c-0f9aefa955b3" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 16:45:34.343751 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:34.343385 2555 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" Jun 02 16:45:34.343890 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:34.343857 2555 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f9ceba5b456efb6c64c02d881f4e7f3a0b70eb7b428b0263538fb9741af84b79"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 16:45:34.343929 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:34.343912 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" podUID="d6fd5754-a634-4586-8e1c-0f9aefa955b3" containerName="service-proxy" containerID="cri-o://f9ceba5b456efb6c64c02d881f4e7f3a0b70eb7b428b0263538fb9741af84b79" gracePeriod=30 Jun 02 16:45:35.062388 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:35.062350 2555 generic.go:358] "Generic (PLEG): container finished" podID="d6fd5754-a634-4586-8e1c-0f9aefa955b3" containerID="f9ceba5b456efb6c64c02d881f4e7f3a0b70eb7b428b0263538fb9741af84b79" exitCode=2 Jun 02 16:45:35.062551 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:35.062401 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" event={"ID":"d6fd5754-a634-4586-8e1c-0f9aefa955b3","Type":"ContainerDied","Data":"f9ceba5b456efb6c64c02d881f4e7f3a0b70eb7b428b0263538fb9741af84b79"} Jun 02 16:45:35.062551 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:35.062431 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5b7966697f-q7tfm" event={"ID":"d6fd5754-a634-4586-8e1c-0f9aefa955b3","Type":"ContainerStarted","Data":"553435e0edcff45c08dc80ef44cd6be2381c8a13941640a692731fed293fb21a"} Jun 02 16:45:35.741837 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:35.741800 2555 patch_prober.go:28] interesting pod/console-7d8fcdc96c-mhnjb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 02 16:45:35.742204 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:35.741856 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d8fcdc96c-mhnjb" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 02 16:45:43.331130 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:43.331043 2555 patch_prober.go:28] interesting pod/console-6cd598fc56-jszg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 02 16:45:43.331130 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:43.331099 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cd598fc56-jszg7" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 02 16:45:45.742039 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:45.741992 2555 patch_prober.go:28] interesting pod/console-7d8fcdc96c-mhnjb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 02 16:45:45.742551 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:45.742063 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d8fcdc96c-mhnjb" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 02 16:45:53.331166 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:53.331134 2555 patch_prober.go:28] interesting pod/console-6cd598fc56-jszg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 02 16:45:53.331534 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:53.331176 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cd598fc56-jszg7" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 02 16:45:55.741775 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:55.741694 2555 patch_prober.go:28] interesting pod/console-7d8fcdc96c-mhnjb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 02 16:45:55.741775 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:55.741749 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d8fcdc96c-mhnjb" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 02 16:45:57.784687 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:45:57.784618 2555 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p6tqb" podUID="61567aca-4523-4e65-b0b9-1e41ab678400" Jun 02 16:45:58.126983 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:45:58.126901 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6tqb" Jun 02 16:46:00.971735 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:00.971678 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:46:00.972155 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:00.971793 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:46:00.974104 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:00.974072 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61567aca-4523-4e65-b0b9-1e41ab678400-metrics-tls\") pod \"dns-default-p6tqb\" (UID: \"61567aca-4523-4e65-b0b9-1e41ab678400\") " pod="openshift-dns/dns-default-p6tqb" Jun 02 16:46:00.974318 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:00.974299 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29e15dd3-c0af-4a23-aca4-d572bf1ede24-cert\") pod \"ingress-canary-f7mv2\" (UID: \"29e15dd3-c0af-4a23-aca4-d572bf1ede24\") " pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:46:01.093876 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:01.093845 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vq24k\"" Jun 02 16:46:01.101197 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:01.101163 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f7mv2" Jun 02 16:46:01.130924 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:01.130901 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qcz2w\"" Jun 02 16:46:01.138469 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:01.138441 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p6tqb" Jun 02 16:46:01.236481 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:01.236454 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f7mv2"] Jun 02 16:46:01.239835 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:46:01.239806 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e15dd3_c0af_4a23_aca4_d572bf1ede24.slice/crio-903380e5eebaff37745fd2dc3aab114c0e3bdf4fbe3287bfe0d37901c426ec87 WatchSource:0}: Error finding container 903380e5eebaff37745fd2dc3aab114c0e3bdf4fbe3287bfe0d37901c426ec87: Status 404 returned error can't find the container with id 903380e5eebaff37745fd2dc3aab114c0e3bdf4fbe3287bfe0d37901c426ec87 Jun 02 16:46:01.276384 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:01.276362 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p6tqb"] Jun 02 16:46:01.278204 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:46:01.278180 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61567aca_4523_4e65_b0b9_1e41ab678400.slice/crio-3b8b0feec5090e10151754999f9f23baf0fa5c4de612f76f874f7ad07b236d73 WatchSource:0}: Error finding container 3b8b0feec5090e10151754999f9f23baf0fa5c4de612f76f874f7ad07b236d73: Status 404 returned error can't find the container with id 3b8b0feec5090e10151754999f9f23baf0fa5c4de612f76f874f7ad07b236d73 Jun 02 16:46:02.139332 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:02.139290 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6tqb" event={"ID":"61567aca-4523-4e65-b0b9-1e41ab678400","Type":"ContainerStarted","Data":"3b8b0feec5090e10151754999f9f23baf0fa5c4de612f76f874f7ad07b236d73"} Jun 02 16:46:02.140472 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:02.140427 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f7mv2" event={"ID":"29e15dd3-c0af-4a23-aca4-d572bf1ede24","Type":"ContainerStarted","Data":"903380e5eebaff37745fd2dc3aab114c0e3bdf4fbe3287bfe0d37901c426ec87"} Jun 02 16:46:03.331548 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:03.331524 2555 patch_prober.go:28] interesting pod/console-6cd598fc56-jszg7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" start-of-body= Jun 02 16:46:03.331923 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:03.331574 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6cd598fc56-jszg7" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" probeResult="failure" output="Get \"https://10.133.0.13:8443/health\": dial tcp 10.133.0.13:8443: connect: connection refused" Jun 02 16:46:04.147447 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:04.147414 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f7mv2" event={"ID":"29e15dd3-c0af-4a23-aca4-d572bf1ede24","Type":"ContainerStarted","Data":"db5b9485c0768c12ef17dac419425cf6cf2b199a2c60a46f35470e8873392315"} Jun 02 16:46:04.148872 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:04.148851 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6tqb" event={"ID":"61567aca-4523-4e65-b0b9-1e41ab678400","Type":"ContainerStarted","Data":"f1b0af3ab6119f3fbae9095a4f4c34d9ea391990c24c0ada881327769d5e00d1"} Jun 02 16:46:04.148966 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:04.148878 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p6tqb" event={"ID":"61567aca-4523-4e65-b0b9-1e41ab678400","Type":"ContainerStarted","Data":"56d73f2bddcf4151265c07f0f6b631b8b3798bac7c720f23ea033bc210e6480b"} Jun 02 16:46:04.149016 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:04.148975 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p6tqb" Jun 02 16:46:04.182163 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:04.182118 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f7mv2" podStartSLOduration=252.14016019 podStartE2EDuration="4m14.182104082s" podCreationTimestamp="2026-06-02 16:41:50 +0000 UTC" firstStartedPulling="2026-06-02 16:46:01.241632273 +0000 UTC m=+284.526911008" lastFinishedPulling="2026-06-02 16:46:03.283576183 +0000 UTC m=+286.568854900" observedRunningTime="2026-06-02 16:46:04.180170104 +0000 UTC m=+287.465448839" watchObservedRunningTime="2026-06-02 16:46:04.182104082 +0000 UTC m=+287.467382816" Jun 02 16:46:04.217279 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:04.217220 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-p6tqb" podStartSLOduration=252.216817026 podStartE2EDuration="4m14.217201372s" podCreationTimestamp="2026-06-02 16:41:50 +0000 UTC" firstStartedPulling="2026-06-02 16:46:01.279825473 +0000 UTC m=+284.565104187" lastFinishedPulling="2026-06-02 16:46:03.280209819 +0000 UTC m=+286.565488533" observedRunningTime="2026-06-02 16:46:04.213003262 +0000 UTC m=+287.498281998" watchObservedRunningTime="2026-06-02 16:46:04.217201372 +0000 UTC m=+287.502480109" Jun 02 16:46:05.742026 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.741973 2555 patch_prober.go:28] interesting pod/console-7d8fcdc96c-mhnjb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 02 16:46:05.742411 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.742056 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d8fcdc96c-mhnjb" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 02 16:46:05.950458 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.950425 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6db845cb44-xm5q5"] Jun 02 16:46:05.953473 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.953458 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:05.957633 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.957614 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 16:46:05.957940 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.957922 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 16:46:05.958192 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.958178 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 16:46:05.958841 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.958819 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 16:46:05.958950 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.958849 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5w47k\"" Jun 02 16:46:05.959308 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.959293 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 16:46:05.965708 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.965690 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 16:46:05.975261 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:05.975240 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6db845cb44-xm5q5"] Jun 02 16:46:06.012145 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.012077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.012145 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.012115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-federate-client-tls\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.012145 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.012138 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-telemeter-client-tls\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.012313 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.012187 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl65m\" (UniqueName: \"kubernetes.io/projected/7e43face-e3f9-46c1-926f-ae50f249dacd-kube-api-access-nl65m\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.012313 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.012274 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-metrics-client-ca\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.012313 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.012306 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-serving-certs-ca-bundle\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.012407 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.012321 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.012407 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.012341 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-secret-telemeter-client\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.113690 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.113644 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-federate-client-tls\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.113861 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.113711 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-telemeter-client-tls\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.113861 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.113751 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl65m\" (UniqueName: \"kubernetes.io/projected/7e43face-e3f9-46c1-926f-ae50f249dacd-kube-api-access-nl65m\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.113861 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.113823 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-metrics-client-ca\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.114042 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.113870 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-serving-certs-ca-bundle\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.114042 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.113897 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.114042 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.113925 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-secret-telemeter-client\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.114042 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.113949 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.114712 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.114637 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-metrics-client-ca\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.114868 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.114845 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-serving-certs-ca-bundle\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.114984 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.114946 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e43face-e3f9-46c1-926f-ae50f249dacd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.116545 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.116523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-federate-client-tls\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.116754 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.116730 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-secret-telemeter-client\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.116877 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.116854 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-telemeter-client-tls\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.117143 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.117125 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e43face-e3f9-46c1-926f-ae50f249dacd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.133531 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.133504 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl65m\" (UniqueName: \"kubernetes.io/projected/7e43face-e3f9-46c1-926f-ae50f249dacd-kube-api-access-nl65m\") pod \"telemeter-client-6db845cb44-xm5q5\" (UID: \"7e43face-e3f9-46c1-926f-ae50f249dacd\") " pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.262540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.262468 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" Jun 02 16:46:06.415460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:06.415430 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6db845cb44-xm5q5"] Jun 02 16:46:06.419180 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:46:06.419155 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e43face_e3f9_46c1_926f_ae50f249dacd.slice/crio-23980c55b937a4f4dfe73bbeaa95320509889b8a17d3d30137b394ab387bcfa0 WatchSource:0}: Error finding container 23980c55b937a4f4dfe73bbeaa95320509889b8a17d3d30137b394ab387bcfa0: Status 404 returned error can't find the container with id 23980c55b937a4f4dfe73bbeaa95320509889b8a17d3d30137b394ab387bcfa0 Jun 02 16:46:07.159006 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:07.158969 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" event={"ID":"7e43face-e3f9-46c1-926f-ae50f249dacd","Type":"ContainerStarted","Data":"23980c55b937a4f4dfe73bbeaa95320509889b8a17d3d30137b394ab387bcfa0"} Jun 02 16:46:09.165861 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:09.165831 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" event={"ID":"7e43face-e3f9-46c1-926f-ae50f249dacd","Type":"ContainerStarted","Data":"1bae9f551289ed28b7c017bbf910ee52b15f3119828f5d7fd3feca9a1d9e3ef4"} Jun 02 16:46:11.173366 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.173327 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" event={"ID":"7e43face-e3f9-46c1-926f-ae50f249dacd","Type":"ContainerStarted","Data":"30c39c1ca9c4ef272cc5837c575372be0f93dee2ccf8d2d71ac9b2042a8e6c62"} Jun 02 16:46:11.173366 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.173371 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" event={"ID":"7e43face-e3f9-46c1-926f-ae50f249dacd","Type":"ContainerStarted","Data":"7da7fe4a2d4121955482fbde9b0fd5b2925c1ba691a423f2520606ee99008f46"} Jun 02 16:46:11.200814 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.200769 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6db845cb44-xm5q5" podStartSLOduration=2.449673197 podStartE2EDuration="6.20075209s" podCreationTimestamp="2026-06-02 16:46:05 +0000 UTC" firstStartedPulling="2026-06-02 16:46:06.420848919 +0000 UTC m=+289.706127636" lastFinishedPulling="2026-06-02 16:46:10.171927812 +0000 UTC m=+293.457206529" observedRunningTime="2026-06-02 16:46:11.199858763 +0000 UTC m=+294.485137499" watchObservedRunningTime="2026-06-02 16:46:11.20075209 +0000 UTC m=+294.486030827" Jun 02 16:46:11.317423 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.317391 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cd598fc56-jszg7"] Jun 02 16:46:11.371269 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.371243 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76584b7988-bwdmq"] Jun 02 16:46:11.374313 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.374298 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.384578 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.384554 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76584b7988-bwdmq"] Jun 02 16:46:11.455083 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.455019 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-console-config\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.455083 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.455056 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jftb8\" (UniqueName: \"kubernetes.io/projected/86819390-662b-4b53-a307-bc8133341424-kube-api-access-jftb8\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.455083 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.455074 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-serving-cert\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.455246 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.455112 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-service-ca\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.455246 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.455146 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-oauth-config\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.455246 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.455163 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-trusted-ca-bundle\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.455246 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.455208 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-oauth-serving-cert\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.555924 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.555898 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-console-config\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556031 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.555933 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jftb8\" (UniqueName: \"kubernetes.io/projected/86819390-662b-4b53-a307-bc8133341424-kube-api-access-jftb8\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556031 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.555952 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-serving-cert\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556031 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.555974 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-service-ca\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556031 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.556004 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-oauth-config\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556031 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.556027 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-trusted-ca-bundle\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556268 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.556054 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-oauth-serving-cert\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556647 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.556623 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-service-ca\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556874 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.556850 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-console-config\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556918 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.556868 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-oauth-serving-cert\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.556953 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.556931 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-trusted-ca-bundle\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.558362 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.558338 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-oauth-config\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.558529 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.558514 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-serving-cert\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.565997 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.565976 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jftb8\" (UniqueName: \"kubernetes.io/projected/86819390-662b-4b53-a307-bc8133341424-kube-api-access-jftb8\") pod \"console-76584b7988-bwdmq\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.682943 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.682904 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:11.802035 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:11.802002 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76584b7988-bwdmq"] Jun 02 16:46:11.806017 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:46:11.805991 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86819390_662b_4b53_a307_bc8133341424.slice/crio-be7d539d99ef208553681ed16c9a93f6720fee66a6127e53a5ddfb89ec1a9abc WatchSource:0}: Error finding container be7d539d99ef208553681ed16c9a93f6720fee66a6127e53a5ddfb89ec1a9abc: Status 404 returned error can't find the container with id be7d539d99ef208553681ed16c9a93f6720fee66a6127e53a5ddfb89ec1a9abc Jun 02 16:46:12.177538 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:12.177500 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76584b7988-bwdmq" event={"ID":"86819390-662b-4b53-a307-bc8133341424","Type":"ContainerStarted","Data":"56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357"} Jun 02 16:46:12.177538 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:12.177542 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76584b7988-bwdmq" event={"ID":"86819390-662b-4b53-a307-bc8133341424","Type":"ContainerStarted","Data":"be7d539d99ef208553681ed16c9a93f6720fee66a6127e53a5ddfb89ec1a9abc"} Jun 02 16:46:12.197766 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:12.197723 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76584b7988-bwdmq" podStartSLOduration=1.197707941 podStartE2EDuration="1.197707941s" podCreationTimestamp="2026-06-02 16:46:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:46:12.195427843 +0000 UTC m=+295.480706578" watchObservedRunningTime="2026-06-02 16:46:12.197707941 +0000 UTC m=+295.482986674" Jun 02 16:46:14.153806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:14.153772 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p6tqb" Jun 02 16:46:15.741446 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:15.741401 2555 patch_prober.go:28] interesting pod/console-7d8fcdc96c-mhnjb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 02 16:46:15.741826 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:15.741471 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d8fcdc96c-mhnjb" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 02 16:46:17.215489 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:17.215464 2555 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 16:46:21.683676 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:21.683610 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:21.683676 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:21.683682 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:21.688471 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:21.688453 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:22.208286 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:22.208260 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:46:22.265143 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:22.265115 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8fcdc96c-mhnjb"] Jun 02 16:46:36.336426 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.336389 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6cd598fc56-jszg7" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" containerID="cri-o://bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2" gracePeriod=15 Jun 02 16:46:36.569524 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.569504 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cd598fc56-jszg7_fd364ebe-453e-4559-a510-f91405bc9686/console/0.log" Jun 02 16:46:36.569620 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.569571 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:46:36.640442 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.640382 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-service-ca\") pod \"fd364ebe-453e-4559-a510-f91405bc9686\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " Jun 02 16:46:36.640442 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.640415 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-oauth-config\") pod \"fd364ebe-453e-4559-a510-f91405bc9686\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " Jun 02 16:46:36.640582 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.640443 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wch7\" (UniqueName: \"kubernetes.io/projected/fd364ebe-453e-4559-a510-f91405bc9686-kube-api-access-2wch7\") pod \"fd364ebe-453e-4559-a510-f91405bc9686\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " Jun 02 16:46:36.640582 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.640469 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-oauth-serving-cert\") pod \"fd364ebe-453e-4559-a510-f91405bc9686\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " Jun 02 16:46:36.640582 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.640539 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-serving-cert\") pod \"fd364ebe-453e-4559-a510-f91405bc9686\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " Jun 02 16:46:36.640582 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.640566 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-console-config\") pod \"fd364ebe-453e-4559-a510-f91405bc9686\" (UID: \"fd364ebe-453e-4559-a510-f91405bc9686\") " Jun 02 16:46:36.640945 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.640913 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd364ebe-453e-4559-a510-f91405bc9686" (UID: "fd364ebe-453e-4559-a510-f91405bc9686"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:36.641030 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.640938 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd364ebe-453e-4559-a510-f91405bc9686" (UID: "fd364ebe-453e-4559-a510-f91405bc9686"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:36.641073 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.641038 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-console-config" (OuterVolumeSpecName: "console-config") pod "fd364ebe-453e-4559-a510-f91405bc9686" (UID: "fd364ebe-453e-4559-a510-f91405bc9686"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:36.642606 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.642583 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd364ebe-453e-4559-a510-f91405bc9686" (UID: "fd364ebe-453e-4559-a510-f91405bc9686"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:36.642769 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.642631 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd364ebe-453e-4559-a510-f91405bc9686" (UID: "fd364ebe-453e-4559-a510-f91405bc9686"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:36.642823 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.642767 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd364ebe-453e-4559-a510-f91405bc9686-kube-api-access-2wch7" (OuterVolumeSpecName: "kube-api-access-2wch7") pod "fd364ebe-453e-4559-a510-f91405bc9686" (UID: "fd364ebe-453e-4559-a510-f91405bc9686"). InnerVolumeSpecName "kube-api-access-2wch7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:36.741870 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.741838 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:36.741870 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.741868 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:36.741870 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.741878 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:36.742022 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.741887 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd364ebe-453e-4559-a510-f91405bc9686-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:36.742022 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.741896 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wch7\" (UniqueName: \"kubernetes.io/projected/fd364ebe-453e-4559-a510-f91405bc9686-kube-api-access-2wch7\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:36.742022 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:36.741905 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd364ebe-453e-4559-a510-f91405bc9686-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:37.250798 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.250771 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cd598fc56-jszg7_fd364ebe-453e-4559-a510-f91405bc9686/console/0.log" Jun 02 16:46:37.250916 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.250808 2555 generic.go:358] "Generic (PLEG): container finished" podID="fd364ebe-453e-4559-a510-f91405bc9686" containerID="bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2" exitCode=2 Jun 02 16:46:37.250916 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.250854 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd598fc56-jszg7" event={"ID":"fd364ebe-453e-4559-a510-f91405bc9686","Type":"ContainerDied","Data":"bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2"} Jun 02 16:46:37.250916 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.250878 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cd598fc56-jszg7" event={"ID":"fd364ebe-453e-4559-a510-f91405bc9686","Type":"ContainerDied","Data":"9c8cd3721cd8dedcd70ec9f25da1533a179aca863543454e6e34f962137aa663"} Jun 02 16:46:37.250916 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.250876 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cd598fc56-jszg7" Jun 02 16:46:37.250916 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.250902 2555 scope.go:117] "RemoveContainer" containerID="bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2" Jun 02 16:46:37.259760 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.259743 2555 scope.go:117] "RemoveContainer" containerID="bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2" Jun 02 16:46:37.260044 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:46:37.260021 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2\": container with ID starting with bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2 not found: ID does not exist" containerID="bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2" Jun 02 16:46:37.260090 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.260055 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2"} err="failed to get container status \"bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2\": rpc error: code = NotFound desc = could not find container \"bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2\": container with ID starting with bb8cba8ae3a7a06da30d13926441e64af6c5a9cdc151ef93e5cb4742c9d8aaf2 not found: ID does not exist" Jun 02 16:46:37.273687 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.273645 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cd598fc56-jszg7"] Jun 02 16:46:37.277176 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.277154 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cd598fc56-jszg7"] Jun 02 16:46:37.292942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:37.292920 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd364ebe-453e-4559-a510-f91405bc9686" path="/var/lib/kubelet/pods/fd364ebe-453e-4559-a510-f91405bc9686/volumes" Jun 02 16:46:47.284284 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.284227 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7d8fcdc96c-mhnjb" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" containerID="cri-o://b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a" gracePeriod=15 Jun 02 16:46:47.521105 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.521084 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d8fcdc96c-mhnjb_8ff3edbc-e56b-4286-b677-b7e154f5cca6/console/0.log" Jun 02 16:46:47.521216 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.521143 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:46:47.618482 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.618406 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-serving-cert\") pod \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " Jun 02 16:46:47.618482 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.618445 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5dw2\" (UniqueName: \"kubernetes.io/projected/8ff3edbc-e56b-4286-b677-b7e154f5cca6-kube-api-access-m5dw2\") pod \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " Jun 02 16:46:47.618482 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.618471 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-trusted-ca-bundle\") pod \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " Jun 02 16:46:47.618723 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.618506 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-service-ca\") pod \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " Jun 02 16:46:47.618723 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.618534 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-oauth-config\") pod \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " Jun 02 16:46:47.618723 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.618554 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-config\") pod \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " Jun 02 16:46:47.618723 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.618606 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-oauth-serving-cert\") pod \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\" (UID: \"8ff3edbc-e56b-4286-b677-b7e154f5cca6\") " Jun 02 16:46:47.619495 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.619435 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8ff3edbc-e56b-4286-b677-b7e154f5cca6" (UID: "8ff3edbc-e56b-4286-b677-b7e154f5cca6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:47.619495 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.619450 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ff3edbc-e56b-4286-b677-b7e154f5cca6" (UID: "8ff3edbc-e56b-4286-b677-b7e154f5cca6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:47.619712 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.619494 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ff3edbc-e56b-4286-b677-b7e154f5cca6" (UID: "8ff3edbc-e56b-4286-b677-b7e154f5cca6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:47.619712 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.619515 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-config" (OuterVolumeSpecName: "console-config") pod "8ff3edbc-e56b-4286-b677-b7e154f5cca6" (UID: "8ff3edbc-e56b-4286-b677-b7e154f5cca6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:46:47.624735 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.624711 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ff3edbc-e56b-4286-b677-b7e154f5cca6" (UID: "8ff3edbc-e56b-4286-b677-b7e154f5cca6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:47.624735 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.624720 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ff3edbc-e56b-4286-b677-b7e154f5cca6-kube-api-access-m5dw2" (OuterVolumeSpecName: "kube-api-access-m5dw2") pod "8ff3edbc-e56b-4286-b677-b7e154f5cca6" (UID: "8ff3edbc-e56b-4286-b677-b7e154f5cca6"). InnerVolumeSpecName "kube-api-access-m5dw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:46:47.624869 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.624749 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ff3edbc-e56b-4286-b677-b7e154f5cca6" (UID: "8ff3edbc-e56b-4286-b677-b7e154f5cca6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:46:47.719827 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.719804 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:47.719827 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.719826 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:47.719970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.719836 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5dw2\" (UniqueName: \"kubernetes.io/projected/8ff3edbc-e56b-4286-b677-b7e154f5cca6-kube-api-access-m5dw2\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:47.719970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.719845 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-trusted-ca-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:47.719970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.719854 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:47.719970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.719864 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:47.719970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:47.719872 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ff3edbc-e56b-4286-b677-b7e154f5cca6-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:46:48.285851 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.285824 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d8fcdc96c-mhnjb_8ff3edbc-e56b-4286-b677-b7e154f5cca6/console/0.log" Jun 02 16:46:48.286321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.285862 2555 generic.go:358] "Generic (PLEG): container finished" podID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerID="b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a" exitCode=2 Jun 02 16:46:48.286321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.285890 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8fcdc96c-mhnjb" event={"ID":"8ff3edbc-e56b-4286-b677-b7e154f5cca6","Type":"ContainerDied","Data":"b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a"} Jun 02 16:46:48.286321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.285914 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8fcdc96c-mhnjb" event={"ID":"8ff3edbc-e56b-4286-b677-b7e154f5cca6","Type":"ContainerDied","Data":"f9892893e2f6daed6d0db91f7903ac00539f240affd90928f92f61d69232910c"} Jun 02 16:46:48.286321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.285931 2555 scope.go:117] "RemoveContainer" containerID="b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a" Jun 02 16:46:48.286321 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.285953 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8fcdc96c-mhnjb" Jun 02 16:46:48.317831 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.317809 2555 scope.go:117] "RemoveContainer" containerID="b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a" Jun 02 16:46:48.318126 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:46:48.318105 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a\": container with ID starting with b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a not found: ID does not exist" containerID="b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a" Jun 02 16:46:48.318171 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.318135 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a"} err="failed to get container status \"b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a\": rpc error: code = NotFound desc = could not find container \"b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a\": container with ID starting with b25ff66d4856766d84fee6857d1d682e78a1c5ad5de4026cdd1bb31a2e84139a not found: ID does not exist" Jun 02 16:46:48.333290 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.333265 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8fcdc96c-mhnjb"] Jun 02 16:46:48.336250 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:48.336227 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8fcdc96c-mhnjb"] Jun 02 16:46:49.293500 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:46:49.293464 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" path="/var/lib/kubelet/pods/8ff3edbc-e56b-4286-b677-b7e154f5cca6/volumes" Jun 02 16:47:17.802952 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.802912 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-77c56df567-8vsxb"] Jun 02 16:47:17.803499 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.803262 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" Jun 02 16:47:17.803499 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.803280 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" Jun 02 16:47:17.803499 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.803309 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" Jun 02 16:47:17.803499 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.803317 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" Jun 02 16:47:17.803499 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.803381 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ff3edbc-e56b-4286-b677-b7e154f5cca6" containerName="console" Jun 02 16:47:17.803499 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.803395 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd364ebe-453e-4559-a510-f91405bc9686" containerName="console" Jun 02 16:47:17.806131 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.806110 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:17.816584 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.816563 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c56df567-8vsxb"] Jun 02 16:47:17.916839 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.916798 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llpjh\" (UniqueName: \"kubernetes.io/projected/0139b892-ccd4-418a-8ecb-e822c9691d28-kube-api-access-llpjh\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:17.916979 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.916847 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-trusted-ca-bundle\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:17.916979 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.916902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-service-ca\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:17.916979 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.916934 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-console-config\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:17.916979 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.916960 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-serving-cert\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:17.917109 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.916984 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-oauth-config\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:17.917109 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:17.917035 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-oauth-serving-cert\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.018206 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.018157 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-serving-cert\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.018206 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.018207 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-oauth-config\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.018444 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.018319 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-oauth-serving-cert\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.018444 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.018370 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llpjh\" (UniqueName: \"kubernetes.io/projected/0139b892-ccd4-418a-8ecb-e822c9691d28-kube-api-access-llpjh\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.018444 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.018396 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-trusted-ca-bundle\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.018444 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.018438 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-service-ca\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.018676 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.018481 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-console-config\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.019092 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.019068 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-oauth-serving-cert\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.019180 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.019104 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-console-config\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.019313 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.019290 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-service-ca\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.019454 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.019429 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-trusted-ca-bundle\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.020766 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.020740 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-oauth-config\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.020863 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.020812 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-serving-cert\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.026741 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.026721 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llpjh\" (UniqueName: \"kubernetes.io/projected/0139b892-ccd4-418a-8ecb-e822c9691d28-kube-api-access-llpjh\") pod \"console-77c56df567-8vsxb\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.114545 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.114487 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:18.231384 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.231351 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c56df567-8vsxb"] Jun 02 16:47:18.234250 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:47:18.234221 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0139b892_ccd4_418a_8ecb_e822c9691d28.slice/crio-f83c912270eea8292f466b586e23d2ac12227bea0d0facb2198bf9a83d6860e8 WatchSource:0}: Error finding container f83c912270eea8292f466b586e23d2ac12227bea0d0facb2198bf9a83d6860e8: Status 404 returned error can't find the container with id f83c912270eea8292f466b586e23d2ac12227bea0d0facb2198bf9a83d6860e8 Jun 02 16:47:18.236061 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.236045 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:47:18.368478 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.368399 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c56df567-8vsxb" event={"ID":"0139b892-ccd4-418a-8ecb-e822c9691d28","Type":"ContainerStarted","Data":"d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a"} Jun 02 16:47:18.368478 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.368435 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c56df567-8vsxb" event={"ID":"0139b892-ccd4-418a-8ecb-e822c9691d28","Type":"ContainerStarted","Data":"f83c912270eea8292f466b586e23d2ac12227bea0d0facb2198bf9a83d6860e8"} Jun 02 16:47:18.385246 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:18.385206 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-77c56df567-8vsxb" podStartSLOduration=1.385193368 podStartE2EDuration="1.385193368s" podCreationTimestamp="2026-06-02 16:47:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:47:18.38471175 +0000 UTC m=+361.669990486" watchObservedRunningTime="2026-06-02 16:47:18.385193368 +0000 UTC m=+361.670472104" Jun 02 16:47:28.115484 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:28.115440 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:28.115939 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:28.115590 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:28.120505 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:28.120478 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:28.398169 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:28.398097 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:47:28.446616 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:28.446592 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76584b7988-bwdmq"] Jun 02 16:47:53.465548 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.465496 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-76584b7988-bwdmq" podUID="86819390-662b-4b53-a307-bc8133341424" containerName="console" containerID="cri-o://56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357" gracePeriod=15 Jun 02 16:47:53.697692 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.697647 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76584b7988-bwdmq_86819390-662b-4b53-a307-bc8133341424/console/0.log" Jun 02 16:47:53.697788 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.697731 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:47:53.754520 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.754464 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-trusted-ca-bundle\") pod \"86819390-662b-4b53-a307-bc8133341424\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " Jun 02 16:47:53.754520 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.754496 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-serving-cert\") pod \"86819390-662b-4b53-a307-bc8133341424\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " Jun 02 16:47:53.754686 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.754531 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-console-config\") pod \"86819390-662b-4b53-a307-bc8133341424\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " Jun 02 16:47:53.754686 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.754555 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-oauth-serving-cert\") pod \"86819390-662b-4b53-a307-bc8133341424\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " Jun 02 16:47:53.754686 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.754590 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-service-ca\") pod \"86819390-662b-4b53-a307-bc8133341424\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " Jun 02 16:47:53.754686 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.754635 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-oauth-config\") pod \"86819390-662b-4b53-a307-bc8133341424\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " Jun 02 16:47:53.754884 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.754687 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jftb8\" (UniqueName: \"kubernetes.io/projected/86819390-662b-4b53-a307-bc8133341424-kube-api-access-jftb8\") pod \"86819390-662b-4b53-a307-bc8133341424\" (UID: \"86819390-662b-4b53-a307-bc8133341424\") " Jun 02 16:47:53.755013 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.754986 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-console-config" (OuterVolumeSpecName: "console-config") pod "86819390-662b-4b53-a307-bc8133341424" (UID: "86819390-662b-4b53-a307-bc8133341424"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:47:53.755138 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.755055 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86819390-662b-4b53-a307-bc8133341424" (UID: "86819390-662b-4b53-a307-bc8133341424"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:47:53.755138 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.755065 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86819390-662b-4b53-a307-bc8133341424" (UID: "86819390-662b-4b53-a307-bc8133341424"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:47:53.755138 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.755074 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-service-ca" (OuterVolumeSpecName: "service-ca") pod "86819390-662b-4b53-a307-bc8133341424" (UID: "86819390-662b-4b53-a307-bc8133341424"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:47:53.760575 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.760450 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86819390-662b-4b53-a307-bc8133341424" (UID: "86819390-662b-4b53-a307-bc8133341424"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:47:53.760942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.760919 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86819390-662b-4b53-a307-bc8133341424" (UID: "86819390-662b-4b53-a307-bc8133341424"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:47:53.761402 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.761378 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86819390-662b-4b53-a307-bc8133341424-kube-api-access-jftb8" (OuterVolumeSpecName: "kube-api-access-jftb8") pod "86819390-662b-4b53-a307-bc8133341424" (UID: "86819390-662b-4b53-a307-bc8133341424"). InnerVolumeSpecName "kube-api-access-jftb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:47:53.856015 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.855994 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-trusted-ca-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:47:53.856015 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.856014 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:47:53.856128 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.856024 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:47:53.856128 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.856050 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:47:53.856128 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.856059 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86819390-662b-4b53-a307-bc8133341424-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:47:53.856128 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.856068 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86819390-662b-4b53-a307-bc8133341424-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:47:53.856128 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:53.856077 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jftb8\" (UniqueName: \"kubernetes.io/projected/86819390-662b-4b53-a307-bc8133341424-kube-api-access-jftb8\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:47:54.464389 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.464361 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76584b7988-bwdmq_86819390-662b-4b53-a307-bc8133341424/console/0.log" Jun 02 16:47:54.464542 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.464403 2555 generic.go:358] "Generic (PLEG): container finished" podID="86819390-662b-4b53-a307-bc8133341424" containerID="56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357" exitCode=2 Jun 02 16:47:54.464542 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.464482 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76584b7988-bwdmq" Jun 02 16:47:54.464542 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.464490 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76584b7988-bwdmq" event={"ID":"86819390-662b-4b53-a307-bc8133341424","Type":"ContainerDied","Data":"56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357"} Jun 02 16:47:54.464542 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.464527 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76584b7988-bwdmq" event={"ID":"86819390-662b-4b53-a307-bc8133341424","Type":"ContainerDied","Data":"be7d539d99ef208553681ed16c9a93f6720fee66a6127e53a5ddfb89ec1a9abc"} Jun 02 16:47:54.464542 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.464543 2555 scope.go:117] "RemoveContainer" containerID="56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357" Jun 02 16:47:54.472511 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.472343 2555 scope.go:117] "RemoveContainer" containerID="56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357" Jun 02 16:47:54.472749 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:47:54.472602 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357\": container with ID starting with 56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357 not found: ID does not exist" containerID="56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357" Jun 02 16:47:54.472749 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.472626 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357"} err="failed to get container status \"56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357\": rpc error: code = NotFound desc = could not find container \"56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357\": container with ID starting with 56fb78f07e49cfc5cca0a0fb3b791d2e61ae017a944367ed4bbc8467091e2357 not found: ID does not exist" Jun 02 16:47:54.486778 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.486751 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76584b7988-bwdmq"] Jun 02 16:47:54.491130 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:54.491106 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76584b7988-bwdmq"] Jun 02 16:47:55.293390 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:47:55.293352 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86819390-662b-4b53-a307-bc8133341424" path="/var/lib/kubelet/pods/86819390-662b-4b53-a307-bc8133341424/volumes" Jun 02 16:48:13.945558 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.945518 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm"] Jun 02 16:48:13.946079 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.945833 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86819390-662b-4b53-a307-bc8133341424" containerName="console" Jun 02 16:48:13.946079 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.945848 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="86819390-662b-4b53-a307-bc8133341424" containerName="console" Jun 02 16:48:13.946079 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.945914 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="86819390-662b-4b53-a307-bc8133341424" containerName="console" Jun 02 16:48:13.947972 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.947951 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:13.950915 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.950886 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 16:48:13.952076 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.952054 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 16:48:13.952076 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.952063 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7jbk\"" Jun 02 16:48:13.958045 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.958020 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm"] Jun 02 16:48:13.981193 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.981167 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7njd\" (UniqueName: \"kubernetes.io/projected/aa4ef691-cbba-4468-bbba-333af82a2452-kube-api-access-k7njd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:13.981306 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.981204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:13.981306 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:13.981237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:14.082115 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.082080 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7njd\" (UniqueName: \"kubernetes.io/projected/aa4ef691-cbba-4468-bbba-333af82a2452-kube-api-access-k7njd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:14.082115 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.082121 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:14.082272 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.082246 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:14.082428 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.082411 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:14.082569 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.082551 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:14.091109 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.091087 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7njd\" (UniqueName: \"kubernetes.io/projected/aa4ef691-cbba-4468-bbba-333af82a2452-kube-api-access-k7njd\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:14.258954 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.258907 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:14.379882 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.379852 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm"] Jun 02 16:48:14.381735 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:48:14.381713 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4ef691_cbba_4468_bbba_333af82a2452.slice/crio-9e3899cbf7db3cee24519d74419a544db590e9d3209897b6fd62e3d1d53863d4 WatchSource:0}: Error finding container 9e3899cbf7db3cee24519d74419a544db590e9d3209897b6fd62e3d1d53863d4: Status 404 returned error can't find the container with id 9e3899cbf7db3cee24519d74419a544db590e9d3209897b6fd62e3d1d53863d4 Jun 02 16:48:14.527704 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:14.527678 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" event={"ID":"aa4ef691-cbba-4468-bbba-333af82a2452","Type":"ContainerStarted","Data":"9e3899cbf7db3cee24519d74419a544db590e9d3209897b6fd62e3d1d53863d4"} Jun 02 16:48:21.546759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:21.546723 2555 generic.go:358] "Generic (PLEG): container finished" podID="aa4ef691-cbba-4468-bbba-333af82a2452" containerID="c86cf5ed81a310614dd5a83e356a1b7e41f85e68d561f5ded054fb06fe9e9dd0" exitCode=0 Jun 02 16:48:21.547126 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:21.546808 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" event={"ID":"aa4ef691-cbba-4468-bbba-333af82a2452","Type":"ContainerDied","Data":"c86cf5ed81a310614dd5a83e356a1b7e41f85e68d561f5ded054fb06fe9e9dd0"} Jun 02 16:48:22.550456 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:22.550428 2555 generic.go:358] "Generic (PLEG): container finished" podID="aa4ef691-cbba-4468-bbba-333af82a2452" containerID="6bf821b8d24f793e0d4fefd20346478eae1f8ee35bc3901f7379d2003f9bf020" exitCode=0 Jun 02 16:48:22.550801 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:22.550516 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" event={"ID":"aa4ef691-cbba-4468-bbba-333af82a2452","Type":"ContainerDied","Data":"6bf821b8d24f793e0d4fefd20346478eae1f8ee35bc3901f7379d2003f9bf020"} Jun 02 16:48:31.575984 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:31.575948 2555 generic.go:358] "Generic (PLEG): container finished" podID="aa4ef691-cbba-4468-bbba-333af82a2452" containerID="d5982930a5a4e07300ef1b750b7cc8d75ae1816e180c23e07af7b835ccf2bfb6" exitCode=0 Jun 02 16:48:31.576343 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:31.576009 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" event={"ID":"aa4ef691-cbba-4468-bbba-333af82a2452","Type":"ContainerDied","Data":"d5982930a5a4e07300ef1b750b7cc8d75ae1816e180c23e07af7b835ccf2bfb6"} Jun 02 16:48:32.692913 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.692891 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:32.830847 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.830753 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-util\") pod \"aa4ef691-cbba-4468-bbba-333af82a2452\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " Jun 02 16:48:32.830847 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.830799 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7njd\" (UniqueName: \"kubernetes.io/projected/aa4ef691-cbba-4468-bbba-333af82a2452-kube-api-access-k7njd\") pod \"aa4ef691-cbba-4468-bbba-333af82a2452\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " Jun 02 16:48:32.831039 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.830859 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-bundle\") pod \"aa4ef691-cbba-4468-bbba-333af82a2452\" (UID: \"aa4ef691-cbba-4468-bbba-333af82a2452\") " Jun 02 16:48:32.831489 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.831464 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-bundle" (OuterVolumeSpecName: "bundle") pod "aa4ef691-cbba-4468-bbba-333af82a2452" (UID: "aa4ef691-cbba-4468-bbba-333af82a2452"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:48:32.833094 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.833063 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4ef691-cbba-4468-bbba-333af82a2452-kube-api-access-k7njd" (OuterVolumeSpecName: "kube-api-access-k7njd") pod "aa4ef691-cbba-4468-bbba-333af82a2452" (UID: "aa4ef691-cbba-4468-bbba-333af82a2452"). InnerVolumeSpecName "kube-api-access-k7njd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:48:32.835078 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.835058 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-util" (OuterVolumeSpecName: "util") pod "aa4ef691-cbba-4468-bbba-333af82a2452" (UID: "aa4ef691-cbba-4468-bbba-333af82a2452"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:48:32.931608 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.931554 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:48:32.931608 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.931603 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7njd\" (UniqueName: \"kubernetes.io/projected/aa4ef691-cbba-4468-bbba-333af82a2452-kube-api-access-k7njd\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:48:32.931608 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:32.931614 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa4ef691-cbba-4468-bbba-333af82a2452-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:48:33.582634 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:33.582558 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" event={"ID":"aa4ef691-cbba-4468-bbba-333af82a2452","Type":"ContainerDied","Data":"9e3899cbf7db3cee24519d74419a544db590e9d3209897b6fd62e3d1d53863d4"} Jun 02 16:48:33.582634 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:33.582592 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e3899cbf7db3cee24519d74419a544db590e9d3209897b6fd62e3d1d53863d4" Jun 02 16:48:33.582634 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:33.582606 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dvhnhm" Jun 02 16:48:36.710699 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.710606 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh"] Jun 02 16:48:36.711029 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.710846 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4ef691-cbba-4468-bbba-333af82a2452" containerName="extract" Jun 02 16:48:36.711029 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.710856 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4ef691-cbba-4468-bbba-333af82a2452" containerName="extract" Jun 02 16:48:36.711029 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.710871 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4ef691-cbba-4468-bbba-333af82a2452" containerName="pull" Jun 02 16:48:36.711029 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.710876 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4ef691-cbba-4468-bbba-333af82a2452" containerName="pull" Jun 02 16:48:36.711029 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.710890 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4ef691-cbba-4468-bbba-333af82a2452" containerName="util" Jun 02 16:48:36.711029 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.710895 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4ef691-cbba-4468-bbba-333af82a2452" containerName="util" Jun 02 16:48:36.711029 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.710935 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa4ef691-cbba-4468-bbba-333af82a2452" containerName="extract" Jun 02 16:48:36.743827 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.743759 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh"] Jun 02 16:48:36.743960 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.743852 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" Jun 02 16:48:36.747272 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.747251 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 16:48:36.747399 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.747276 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kdlxg\"" Jun 02 16:48:36.747399 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.747276 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:48:36.856700 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.856679 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c92d786-3d7e-427f-8caa-ec0ad0115478-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-b5jnh\" (UID: \"6c92d786-3d7e-427f-8caa-ec0ad0115478\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" Jun 02 16:48:36.856799 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.856730 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdm7g\" (UniqueName: \"kubernetes.io/projected/6c92d786-3d7e-427f-8caa-ec0ad0115478-kube-api-access-zdm7g\") pod \"cert-manager-operator-controller-manager-54b9655956-b5jnh\" (UID: \"6c92d786-3d7e-427f-8caa-ec0ad0115478\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" Jun 02 16:48:36.957643 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.957611 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdm7g\" (UniqueName: \"kubernetes.io/projected/6c92d786-3d7e-427f-8caa-ec0ad0115478-kube-api-access-zdm7g\") pod \"cert-manager-operator-controller-manager-54b9655956-b5jnh\" (UID: \"6c92d786-3d7e-427f-8caa-ec0ad0115478\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" Jun 02 16:48:36.957774 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.957678 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c92d786-3d7e-427f-8caa-ec0ad0115478-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-b5jnh\" (UID: \"6c92d786-3d7e-427f-8caa-ec0ad0115478\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" Jun 02 16:48:36.957980 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.957963 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c92d786-3d7e-427f-8caa-ec0ad0115478-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-b5jnh\" (UID: \"6c92d786-3d7e-427f-8caa-ec0ad0115478\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" Jun 02 16:48:36.969451 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:36.969401 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdm7g\" (UniqueName: \"kubernetes.io/projected/6c92d786-3d7e-427f-8caa-ec0ad0115478-kube-api-access-zdm7g\") pod \"cert-manager-operator-controller-manager-54b9655956-b5jnh\" (UID: \"6c92d786-3d7e-427f-8caa-ec0ad0115478\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" Jun 02 16:48:37.052980 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:37.052948 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" Jun 02 16:48:37.182417 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:37.182389 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh"] Jun 02 16:48:37.185760 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:48:37.185730 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c92d786_3d7e_427f_8caa_ec0ad0115478.slice/crio-43f908895bb0e9ea853cfdc462c89b3cb9aecd629cd53c65a715e5b0d4e40fe6 WatchSource:0}: Error finding container 43f908895bb0e9ea853cfdc462c89b3cb9aecd629cd53c65a715e5b0d4e40fe6: Status 404 returned error can't find the container with id 43f908895bb0e9ea853cfdc462c89b3cb9aecd629cd53c65a715e5b0d4e40fe6 Jun 02 16:48:37.594637 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:37.594605 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" event={"ID":"6c92d786-3d7e-427f-8caa-ec0ad0115478","Type":"ContainerStarted","Data":"43f908895bb0e9ea853cfdc462c89b3cb9aecd629cd53c65a715e5b0d4e40fe6"} Jun 02 16:48:39.603837 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:39.603714 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" event={"ID":"6c92d786-3d7e-427f-8caa-ec0ad0115478","Type":"ContainerStarted","Data":"e4535a8d98c630fa8bfae17a9579a8cebb10fdefd1ba26a5a2b2fdbec0ae4a96"} Jun 02 16:48:41.402166 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.402109 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-b5jnh" podStartSLOduration=3.624897968 podStartE2EDuration="5.402092337s" podCreationTimestamp="2026-06-02 16:48:36 +0000 UTC" firstStartedPulling="2026-06-02 16:48:37.188896462 +0000 UTC m=+440.474175176" lastFinishedPulling="2026-06-02 16:48:38.966090831 +0000 UTC m=+442.251369545" observedRunningTime="2026-06-02 16:48:39.65554009 +0000 UTC m=+442.940818826" watchObservedRunningTime="2026-06-02 16:48:41.402092337 +0000 UTC m=+444.687371084" Jun 02 16:48:41.403332 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.403314 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch"] Jun 02 16:48:41.405662 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.405635 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.408911 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.408889 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7jbk\"" Jun 02 16:48:41.408911 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.408903 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 16:48:41.410108 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.410091 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 16:48:41.415460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.415435 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch"] Jun 02 16:48:41.491495 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.491463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.491628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.491500 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.491628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.491550 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjxmc\" (UniqueName: \"kubernetes.io/projected/5743138b-fb10-4c75-bad7-750e2474edf9-kube-api-access-gjxmc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.592219 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.592192 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.592341 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.592227 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.592341 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.592274 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjxmc\" (UniqueName: \"kubernetes.io/projected/5743138b-fb10-4c75-bad7-750e2474edf9-kube-api-access-gjxmc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.592636 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.592616 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.592636 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.592627 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.602976 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.602950 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjxmc\" (UniqueName: \"kubernetes.io/projected/5743138b-fb10-4c75-bad7-750e2474edf9-kube-api-access-gjxmc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.715081 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.715008 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:41.847436 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:41.847407 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch"] Jun 02 16:48:41.848749 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:48:41.848724 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5743138b_fb10_4c75_bad7_750e2474edf9.slice/crio-fbc1a8762e7f8368a693f5ca923011a2a233a01f2632751eae5cfa42b1ab92c1 WatchSource:0}: Error finding container fbc1a8762e7f8368a693f5ca923011a2a233a01f2632751eae5cfa42b1ab92c1: Status 404 returned error can't find the container with id fbc1a8762e7f8368a693f5ca923011a2a233a01f2632751eae5cfa42b1ab92c1 Jun 02 16:48:42.613389 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:42.613360 2555 generic.go:358] "Generic (PLEG): container finished" podID="5743138b-fb10-4c75-bad7-750e2474edf9" containerID="0de308d2932b8fffa0265a0d083a4c6f79357464a415d77e87464da3b0114f79" exitCode=0 Jun 02 16:48:42.613726 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:42.613412 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" event={"ID":"5743138b-fb10-4c75-bad7-750e2474edf9","Type":"ContainerDied","Data":"0de308d2932b8fffa0265a0d083a4c6f79357464a415d77e87464da3b0114f79"} Jun 02 16:48:42.613726 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:42.613435 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" event={"ID":"5743138b-fb10-4c75-bad7-750e2474edf9","Type":"ContainerStarted","Data":"fbc1a8762e7f8368a693f5ca923011a2a233a01f2632751eae5cfa42b1ab92c1"} Jun 02 16:48:44.947758 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:44.947731 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-8qwx2"] Jun 02 16:48:44.949759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:44.949740 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" Jun 02 16:48:44.952894 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:44.952876 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 16:48:44.952978 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:44.952928 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-h59qj\"" Jun 02 16:48:44.952978 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:44.952967 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 16:48:44.959350 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:44.959327 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-8qwx2"] Jun 02 16:48:45.019705 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.019682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5448f8a-5243-405d-865c-098a428d58f4-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-8qwx2\" (UID: \"f5448f8a-5243-405d-865c-098a428d58f4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" Jun 02 16:48:45.019807 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.019730 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srvhg\" (UniqueName: \"kubernetes.io/projected/f5448f8a-5243-405d-865c-098a428d58f4-kube-api-access-srvhg\") pod \"cert-manager-cainjector-68b757865b-8qwx2\" (UID: \"f5448f8a-5243-405d-865c-098a428d58f4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" Jun 02 16:48:45.120891 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.120864 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5448f8a-5243-405d-865c-098a428d58f4-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-8qwx2\" (UID: \"f5448f8a-5243-405d-865c-098a428d58f4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" Jun 02 16:48:45.120993 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.120907 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-srvhg\" (UniqueName: \"kubernetes.io/projected/f5448f8a-5243-405d-865c-098a428d58f4-kube-api-access-srvhg\") pod \"cert-manager-cainjector-68b757865b-8qwx2\" (UID: \"f5448f8a-5243-405d-865c-098a428d58f4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" Jun 02 16:48:45.130279 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.130250 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srvhg\" (UniqueName: \"kubernetes.io/projected/f5448f8a-5243-405d-865c-098a428d58f4-kube-api-access-srvhg\") pod \"cert-manager-cainjector-68b757865b-8qwx2\" (UID: \"f5448f8a-5243-405d-865c-098a428d58f4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" Jun 02 16:48:45.130363 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.130284 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f5448f8a-5243-405d-865c-098a428d58f4-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-8qwx2\" (UID: \"f5448f8a-5243-405d-865c-098a428d58f4\") " pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" Jun 02 16:48:45.258629 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.258540 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" Jun 02 16:48:45.398585 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.398561 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-8qwx2"] Jun 02 16:48:45.400567 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:48:45.400540 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5448f8a_5243_405d_865c_098a428d58f4.slice/crio-b9953f57909c79802e3f84f54759e3b24738defed65b638275daf2be88b5cbca WatchSource:0}: Error finding container b9953f57909c79802e3f84f54759e3b24738defed65b638275daf2be88b5cbca: Status 404 returned error can't find the container with id b9953f57909c79802e3f84f54759e3b24738defed65b638275daf2be88b5cbca Jun 02 16:48:45.622331 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.622294 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" event={"ID":"f5448f8a-5243-405d-865c-098a428d58f4","Type":"ContainerStarted","Data":"b9953f57909c79802e3f84f54759e3b24738defed65b638275daf2be88b5cbca"} Jun 02 16:48:45.623886 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.623853 2555 generic.go:358] "Generic (PLEG): container finished" podID="5743138b-fb10-4c75-bad7-750e2474edf9" containerID="67bbecddd11316ecbc753ccb01b457632984a38d9d8777919f20f2c1ffd5c7a4" exitCode=0 Jun 02 16:48:45.624014 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:45.623893 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" event={"ID":"5743138b-fb10-4c75-bad7-750e2474edf9","Type":"ContainerDied","Data":"67bbecddd11316ecbc753ccb01b457632984a38d9d8777919f20f2c1ffd5c7a4"} Jun 02 16:48:46.629127 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:46.629086 2555 generic.go:358] "Generic (PLEG): container finished" podID="5743138b-fb10-4c75-bad7-750e2474edf9" containerID="e652f843d9c9bbf685780c8dc02a299cc4e7385d386145ce16ca482dc693af4c" exitCode=0 Jun 02 16:48:46.629548 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:46.629161 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" event={"ID":"5743138b-fb10-4c75-bad7-750e2474edf9","Type":"ContainerDied","Data":"e652f843d9c9bbf685780c8dc02a299cc4e7385d386145ce16ca482dc693af4c"} Jun 02 16:48:48.110486 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.110454 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:48.244774 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.244746 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-bundle\") pod \"5743138b-fb10-4c75-bad7-750e2474edf9\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " Jun 02 16:48:48.244933 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.244806 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjxmc\" (UniqueName: \"kubernetes.io/projected/5743138b-fb10-4c75-bad7-750e2474edf9-kube-api-access-gjxmc\") pod \"5743138b-fb10-4c75-bad7-750e2474edf9\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " Jun 02 16:48:48.244933 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.244839 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-util\") pod \"5743138b-fb10-4c75-bad7-750e2474edf9\" (UID: \"5743138b-fb10-4c75-bad7-750e2474edf9\") " Jun 02 16:48:48.245186 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.245165 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-bundle" (OuterVolumeSpecName: "bundle") pod "5743138b-fb10-4c75-bad7-750e2474edf9" (UID: "5743138b-fb10-4c75-bad7-750e2474edf9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:48:48.246938 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.246912 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5743138b-fb10-4c75-bad7-750e2474edf9-kube-api-access-gjxmc" (OuterVolumeSpecName: "kube-api-access-gjxmc") pod "5743138b-fb10-4c75-bad7-750e2474edf9" (UID: "5743138b-fb10-4c75-bad7-750e2474edf9"). InnerVolumeSpecName "kube-api-access-gjxmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:48:48.249458 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.249431 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-util" (OuterVolumeSpecName: "util") pod "5743138b-fb10-4c75-bad7-750e2474edf9" (UID: "5743138b-fb10-4c75-bad7-750e2474edf9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:48:48.345906 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.345869 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:48:48.346092 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.345901 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5743138b-fb10-4c75-bad7-750e2474edf9-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:48:48.346092 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.345945 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjxmc\" (UniqueName: \"kubernetes.io/projected/5743138b-fb10-4c75-bad7-750e2474edf9-kube-api-access-gjxmc\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:48:48.636841 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.636807 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" event={"ID":"f5448f8a-5243-405d-865c-098a428d58f4","Type":"ContainerStarted","Data":"560bfc8f4aff664cf0d852a63324cc0d747d29088a37fb16b05a9feace9a3d66"} Jun 02 16:48:48.638367 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.638344 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" event={"ID":"5743138b-fb10-4c75-bad7-750e2474edf9","Type":"ContainerDied","Data":"fbc1a8762e7f8368a693f5ca923011a2a233a01f2632751eae5cfa42b1ab92c1"} Jun 02 16:48:48.638478 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.638371 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbc1a8762e7f8368a693f5ca923011a2a233a01f2632751eae5cfa42b1ab92c1" Jun 02 16:48:48.638478 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.638384 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f29rch" Jun 02 16:48:48.654231 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:48.654194 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-8qwx2" podStartSLOduration=1.8971327740000001 podStartE2EDuration="4.654183698s" podCreationTimestamp="2026-06-02 16:48:44 +0000 UTC" firstStartedPulling="2026-06-02 16:48:45.402358296 +0000 UTC m=+448.687637010" lastFinishedPulling="2026-06-02 16:48:48.159409206 +0000 UTC m=+451.444687934" observedRunningTime="2026-06-02 16:48:48.652972855 +0000 UTC m=+451.938251590" watchObservedRunningTime="2026-06-02 16:48:48.654183698 +0000 UTC m=+451.939462434" Jun 02 16:48:58.599253 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.599216 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd"] Jun 02 16:48:58.599602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.599538 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5743138b-fb10-4c75-bad7-750e2474edf9" containerName="pull" Jun 02 16:48:58.599602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.599551 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5743138b-fb10-4c75-bad7-750e2474edf9" containerName="pull" Jun 02 16:48:58.599602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.599569 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5743138b-fb10-4c75-bad7-750e2474edf9" containerName="extract" Jun 02 16:48:58.599602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.599575 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5743138b-fb10-4c75-bad7-750e2474edf9" containerName="extract" Jun 02 16:48:58.599602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.599585 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5743138b-fb10-4c75-bad7-750e2474edf9" containerName="util" Jun 02 16:48:58.599602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.599591 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5743138b-fb10-4c75-bad7-750e2474edf9" containerName="util" Jun 02 16:48:58.599838 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.599637 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="5743138b-fb10-4c75-bad7-750e2474edf9" containerName="extract" Jun 02 16:48:58.602663 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.602637 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" Jun 02 16:48:58.605253 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.605231 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pt8ct\"" Jun 02 16:48:58.606456 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.606442 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 16:48:58.606525 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.606455 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:48:58.610336 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.610314 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd"] Jun 02 16:48:58.713223 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.713191 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbd452c5-50ce-4c26-9603-1d2c0cdacba1-tmp\") pod \"openshift-lws-operator-bfc7f696d-p2fpd\" (UID: \"bbd452c5-50ce-4c26-9603-1d2c0cdacba1\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" Jun 02 16:48:58.713373 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.713244 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jq2t\" (UniqueName: \"kubernetes.io/projected/bbd452c5-50ce-4c26-9603-1d2c0cdacba1-kube-api-access-5jq2t\") pod \"openshift-lws-operator-bfc7f696d-p2fpd\" (UID: \"bbd452c5-50ce-4c26-9603-1d2c0cdacba1\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" Jun 02 16:48:58.813669 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.813625 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5jq2t\" (UniqueName: \"kubernetes.io/projected/bbd452c5-50ce-4c26-9603-1d2c0cdacba1-kube-api-access-5jq2t\") pod \"openshift-lws-operator-bfc7f696d-p2fpd\" (UID: \"bbd452c5-50ce-4c26-9603-1d2c0cdacba1\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" Jun 02 16:48:58.813788 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.813683 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbd452c5-50ce-4c26-9603-1d2c0cdacba1-tmp\") pod \"openshift-lws-operator-bfc7f696d-p2fpd\" (UID: \"bbd452c5-50ce-4c26-9603-1d2c0cdacba1\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" Jun 02 16:48:58.813983 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.813969 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbd452c5-50ce-4c26-9603-1d2c0cdacba1-tmp\") pod \"openshift-lws-operator-bfc7f696d-p2fpd\" (UID: \"bbd452c5-50ce-4c26-9603-1d2c0cdacba1\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" Jun 02 16:48:58.822121 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.822095 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jq2t\" (UniqueName: \"kubernetes.io/projected/bbd452c5-50ce-4c26-9603-1d2c0cdacba1-kube-api-access-5jq2t\") pod \"openshift-lws-operator-bfc7f696d-p2fpd\" (UID: \"bbd452c5-50ce-4c26-9603-1d2c0cdacba1\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" Jun 02 16:48:58.911928 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:58.911854 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" Jun 02 16:48:59.032271 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:59.032240 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd"] Jun 02 16:48:59.035771 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:48:59.035743 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbd452c5_50ce_4c26_9603_1d2c0cdacba1.slice/crio-5918b052b4f69184d79604006dba4edb3a8aa550a05ec9fa0a3a441a56b6624b WatchSource:0}: Error finding container 5918b052b4f69184d79604006dba4edb3a8aa550a05ec9fa0a3a441a56b6624b: Status 404 returned error can't find the container with id 5918b052b4f69184d79604006dba4edb3a8aa550a05ec9fa0a3a441a56b6624b Jun 02 16:48:59.669405 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:48:59.669369 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" event={"ID":"bbd452c5-50ce-4c26-9603-1d2c0cdacba1","Type":"ContainerStarted","Data":"5918b052b4f69184d79604006dba4edb3a8aa550a05ec9fa0a3a441a56b6624b"} Jun 02 16:49:01.676481 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:01.676399 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" event={"ID":"bbd452c5-50ce-4c26-9603-1d2c0cdacba1","Type":"ContainerStarted","Data":"803ab2257540980dcfbbf3dd624c66ebb005b98d8a4702c84685c1c00fa4d330"} Jun 02 16:49:01.693848 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:01.693805 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-p2fpd" podStartSLOduration=1.313438163 podStartE2EDuration="3.693791352s" podCreationTimestamp="2026-06-02 16:48:58 +0000 UTC" firstStartedPulling="2026-06-02 16:48:59.037197912 +0000 UTC m=+462.322476625" lastFinishedPulling="2026-06-02 16:49:01.417551101 +0000 UTC m=+464.702829814" observedRunningTime="2026-06-02 16:49:01.692237302 +0000 UTC m=+464.977516044" watchObservedRunningTime="2026-06-02 16:49:01.693791352 +0000 UTC m=+464.979070088" Jun 02 16:49:06.422282 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.422254 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f"] Jun 02 16:49:06.443426 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.443404 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f"] Jun 02 16:49:06.443583 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.443515 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.446577 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.446557 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7jbk\"" Jun 02 16:49:06.446700 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.446560 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 16:49:06.446700 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.446564 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 16:49:06.569106 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.569081 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.569229 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.569138 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cqqv\" (UniqueName: \"kubernetes.io/projected/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-kube-api-access-6cqqv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.569229 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.569185 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.669704 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.669676 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cqqv\" (UniqueName: \"kubernetes.io/projected/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-kube-api-access-6cqqv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.669826 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.669713 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.669826 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.669739 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.670043 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.670030 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.670081 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.670048 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.678554 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.678510 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cqqv\" (UniqueName: \"kubernetes.io/projected/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-kube-api-access-6cqqv\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.752372 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.752345 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:06.877594 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:06.877562 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f"] Jun 02 16:49:06.880077 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:06.880043 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d44a25_6668_4a4f_b3da_f7a3ba66cb31.slice/crio-953d5780fe392c9a17c7390a6e01717752cd6073d00354f19291dad0eec53b81 WatchSource:0}: Error finding container 953d5780fe392c9a17c7390a6e01717752cd6073d00354f19291dad0eec53b81: Status 404 returned error can't find the container with id 953d5780fe392c9a17c7390a6e01717752cd6073d00354f19291dad0eec53b81 Jun 02 16:49:07.694606 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:07.694573 2555 generic.go:358] "Generic (PLEG): container finished" podID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerID="d684c887815d4d323e349b9200e3225f9197c2fe64cd164c299267c083e69a5a" exitCode=0 Jun 02 16:49:07.694997 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:07.694644 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" event={"ID":"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31","Type":"ContainerDied","Data":"d684c887815d4d323e349b9200e3225f9197c2fe64cd164c299267c083e69a5a"} Jun 02 16:49:07.694997 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:07.694680 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" event={"ID":"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31","Type":"ContainerStarted","Data":"953d5780fe392c9a17c7390a6e01717752cd6073d00354f19291dad0eec53b81"} Jun 02 16:49:08.699270 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:08.699231 2555 generic.go:358] "Generic (PLEG): container finished" podID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerID="6a2374d78a832c938e7f4bf251bfe626ed73cc33796201074d5152113e1995d2" exitCode=0 Jun 02 16:49:08.699766 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:08.699327 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" event={"ID":"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31","Type":"ContainerDied","Data":"6a2374d78a832c938e7f4bf251bfe626ed73cc33796201074d5152113e1995d2"} Jun 02 16:49:09.703926 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:09.703886 2555 generic.go:358] "Generic (PLEG): container finished" podID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerID="6aafcdcfdd4ef8363dce1c14eb895611a1c113cda30082bf0a714e71a7f03b59" exitCode=0 Jun 02 16:49:09.704361 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:09.703968 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" event={"ID":"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31","Type":"ContainerDied","Data":"6aafcdcfdd4ef8363dce1c14eb895611a1c113cda30082bf0a714e71a7f03b59"} Jun 02 16:49:10.829710 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:10.829688 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:11.005225 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.005144 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cqqv\" (UniqueName: \"kubernetes.io/projected/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-kube-api-access-6cqqv\") pod \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " Jun 02 16:49:11.005225 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.005208 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-bundle\") pod \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " Jun 02 16:49:11.005448 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.005267 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-util\") pod \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\" (UID: \"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31\") " Jun 02 16:49:11.005888 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.005860 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-bundle" (OuterVolumeSpecName: "bundle") pod "b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" (UID: "b6d44a25-6668-4a4f-b3da-f7a3ba66cb31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:49:11.007226 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.007206 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-kube-api-access-6cqqv" (OuterVolumeSpecName: "kube-api-access-6cqqv") pod "b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" (UID: "b6d44a25-6668-4a4f-b3da-f7a3ba66cb31"). InnerVolumeSpecName "kube-api-access-6cqqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:49:11.010628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.010589 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-util" (OuterVolumeSpecName: "util") pod "b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" (UID: "b6d44a25-6668-4a4f-b3da-f7a3ba66cb31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:49:11.106136 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.106102 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:49:11.106136 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.106128 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cqqv\" (UniqueName: \"kubernetes.io/projected/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-kube-api-access-6cqqv\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:49:11.106136 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.106138 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6d44a25-6668-4a4f-b3da-f7a3ba66cb31-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:49:11.713572 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.713492 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" event={"ID":"b6d44a25-6668-4a4f-b3da-f7a3ba66cb31","Type":"ContainerDied","Data":"953d5780fe392c9a17c7390a6e01717752cd6073d00354f19291dad0eec53b81"} Jun 02 16:49:11.713572 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.713524 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="953d5780fe392c9a17c7390a6e01717752cd6073d00354f19291dad0eec53b81" Jun 02 16:49:11.713572 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:11.713528 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd4nv7f" Jun 02 16:49:19.713996 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.713955 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95"] Jun 02 16:49:19.714460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.714330 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerName="util" Jun 02 16:49:19.714460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.714347 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerName="util" Jun 02 16:49:19.714460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.714368 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerName="extract" Jun 02 16:49:19.714460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.714376 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerName="extract" Jun 02 16:49:19.714460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.714397 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerName="pull" Jun 02 16:49:19.714460 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.714404 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerName="pull" Jun 02 16:49:19.714790 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.714472 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6d44a25-6668-4a4f-b3da-f7a3ba66cb31" containerName="extract" Jun 02 16:49:19.719234 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.719209 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.722552 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.722527 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 16:49:19.722694 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.722556 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h4z8v\"" Jun 02 16:49:19.722694 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.722529 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 16:49:19.722694 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.722690 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 16:49:19.722873 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.722756 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 16:49:19.734434 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.734407 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95"] Jun 02 16:49:19.772519 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.772489 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99ed2148-557d-419e-8fcf-5c3cc858ed12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.772630 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.772541 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99ed2148-557d-419e-8fcf-5c3cc858ed12-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.772630 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.772557 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99ed2148-557d-419e-8fcf-5c3cc858ed12-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.772630 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.772621 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99ed2148-557d-419e-8fcf-5c3cc858ed12-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.772778 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.772679 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrr44\" (UniqueName: \"kubernetes.io/projected/99ed2148-557d-419e-8fcf-5c3cc858ed12-kube-api-access-jrr44\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.873285 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.873265 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99ed2148-557d-419e-8fcf-5c3cc858ed12-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.873469 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.873297 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99ed2148-557d-419e-8fcf-5c3cc858ed12-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.873469 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.873334 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99ed2148-557d-419e-8fcf-5c3cc858ed12-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.873469 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.873368 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrr44\" (UniqueName: \"kubernetes.io/projected/99ed2148-557d-419e-8fcf-5c3cc858ed12-kube-api-access-jrr44\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.873469 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.873409 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99ed2148-557d-419e-8fcf-5c3cc858ed12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.873717 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.873605 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/99ed2148-557d-419e-8fcf-5c3cc858ed12-manifests\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.875588 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.875565 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99ed2148-557d-419e-8fcf-5c3cc858ed12-tmp\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.875832 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.875812 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/99ed2148-557d-419e-8fcf-5c3cc858ed12-webhook-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.875946 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.875928 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/99ed2148-557d-419e-8fcf-5c3cc858ed12-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:19.891613 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:19.891588 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrr44\" (UniqueName: \"kubernetes.io/projected/99ed2148-557d-419e-8fcf-5c3cc858ed12-kube-api-access-jrr44\") pod \"opendatahub-operator-controller-manager-58857ff9f-ffd95\" (UID: \"99ed2148-557d-419e-8fcf-5c3cc858ed12\") " pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:20.030486 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:20.030462 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:20.166797 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:20.166769 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95"] Jun 02 16:49:20.172830 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:20.172796 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ed2148_557d_419e_8fcf_5c3cc858ed12.slice/crio-d50b4b4410dc2847259c913f33e05329007a81a95ea93cd4efd6d3e25113d435 WatchSource:0}: Error finding container d50b4b4410dc2847259c913f33e05329007a81a95ea93cd4efd6d3e25113d435: Status 404 returned error can't find the container with id d50b4b4410dc2847259c913f33e05329007a81a95ea93cd4efd6d3e25113d435 Jun 02 16:49:20.744872 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:20.744831 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" event={"ID":"99ed2148-557d-419e-8fcf-5c3cc858ed12","Type":"ContainerStarted","Data":"d50b4b4410dc2847259c913f33e05329007a81a95ea93cd4efd6d3e25113d435"} Jun 02 16:49:24.759878 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:24.759840 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" event={"ID":"99ed2148-557d-419e-8fcf-5c3cc858ed12","Type":"ContainerStarted","Data":"005b7630b24b5d65bc7e06647d4effab487d0ab1397606e5e96e80c7383c3c09"} Jun 02 16:49:25.764581 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:25.764547 2555 generic.go:358] "Generic (PLEG): container finished" podID="99ed2148-557d-419e-8fcf-5c3cc858ed12" containerID="005b7630b24b5d65bc7e06647d4effab487d0ab1397606e5e96e80c7383c3c09" exitCode=0 Jun 02 16:49:25.764985 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:25.764590 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" event={"ID":"99ed2148-557d-419e-8fcf-5c3cc858ed12","Type":"ContainerDied","Data":"005b7630b24b5d65bc7e06647d4effab487d0ab1397606e5e96e80c7383c3c09"} Jun 02 16:49:26.769252 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:26.769211 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" event={"ID":"99ed2148-557d-419e-8fcf-5c3cc858ed12","Type":"ContainerStarted","Data":"17d17411057536c81ccc836b96f47d79de2341306817b5c72794c3442c64ae68"} Jun 02 16:49:26.769682 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:26.769320 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:26.793523 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:26.793450 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" podStartSLOduration=1.864648341 podStartE2EDuration="7.793434025s" podCreationTimestamp="2026-06-02 16:49:19 +0000 UTC" firstStartedPulling="2026-06-02 16:49:20.174596191 +0000 UTC m=+483.459874905" lastFinishedPulling="2026-06-02 16:49:26.103381875 +0000 UTC m=+489.388660589" observedRunningTime="2026-06-02 16:49:26.789007921 +0000 UTC m=+490.074286657" watchObservedRunningTime="2026-06-02 16:49:26.793434025 +0000 UTC m=+490.078712762" Jun 02 16:49:37.775194 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:37.775163 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58857ff9f-ffd95" Jun 02 16:49:40.095833 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.095776 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8dc448d-lwccz"] Jun 02 16:49:40.098786 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.098763 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.102744 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.102714 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 16:49:40.102855 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.102747 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ls92g\"" Jun 02 16:49:40.102923 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.102852 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 16:49:40.102999 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.102937 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 16:49:40.102999 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.102962 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 16:49:40.113012 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.112980 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8dc448d-lwccz"] Jun 02 16:49:40.114288 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.114268 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-6tm4n"] Jun 02 16:49:40.117084 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.117067 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:40.119284 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.119259 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88e84fb5-343d-4f23-bf47-097274669fbc-tls-certs\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.119393 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.119310 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nlkd\" (UniqueName: \"kubernetes.io/projected/88e84fb5-343d-4f23-bf47-097274669fbc-kube-api-access-5nlkd\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.119393 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.119339 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88e84fb5-343d-4f23-bf47-097274669fbc-tmp\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.119878 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.119854 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mhbvd\"" Jun 02 16:49:40.119985 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.119915 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 16:49:40.127303 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.127280 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-6tm4n"] Jun 02 16:49:40.220279 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.220255 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nlkd\" (UniqueName: \"kubernetes.io/projected/88e84fb5-343d-4f23-bf47-097274669fbc-kube-api-access-5nlkd\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.220408 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.220285 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88e84fb5-343d-4f23-bf47-097274669fbc-tmp\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.220408 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.220313 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsv7\" (UniqueName: \"kubernetes.io/projected/802ff626-f592-4f5f-937f-8628362815e8-kube-api-access-grsv7\") pod \"odh-model-controller-76588b95-6tm4n\" (UID: \"802ff626-f592-4f5f-937f-8628362815e8\") " pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:40.220408 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.220345 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/802ff626-f592-4f5f-937f-8628362815e8-cert\") pod \"odh-model-controller-76588b95-6tm4n\" (UID: \"802ff626-f592-4f5f-937f-8628362815e8\") " pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:40.220408 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.220400 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88e84fb5-343d-4f23-bf47-097274669fbc-tls-certs\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.222383 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.222364 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88e84fb5-343d-4f23-bf47-097274669fbc-tmp\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.222721 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.222703 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88e84fb5-343d-4f23-bf47-097274669fbc-tls-certs\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.229003 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.228985 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nlkd\" (UniqueName: \"kubernetes.io/projected/88e84fb5-343d-4f23-bf47-097274669fbc-kube-api-access-5nlkd\") pod \"kube-auth-proxy-8dc448d-lwccz\" (UID: \"88e84fb5-343d-4f23-bf47-097274669fbc\") " pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.321485 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.321461 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/802ff626-f592-4f5f-937f-8628362815e8-cert\") pod \"odh-model-controller-76588b95-6tm4n\" (UID: \"802ff626-f592-4f5f-937f-8628362815e8\") " pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:40.321582 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.321529 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grsv7\" (UniqueName: \"kubernetes.io/projected/802ff626-f592-4f5f-937f-8628362815e8-kube-api-access-grsv7\") pod \"odh-model-controller-76588b95-6tm4n\" (UID: \"802ff626-f592-4f5f-937f-8628362815e8\") " pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:40.321634 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:49:40.321601 2555 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 16:49:40.321724 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:49:40.321695 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/802ff626-f592-4f5f-937f-8628362815e8-cert podName:802ff626-f592-4f5f-937f-8628362815e8 nodeName:}" failed. No retries permitted until 2026-06-02 16:49:40.821676027 +0000 UTC m=+504.106954752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/802ff626-f592-4f5f-937f-8628362815e8-cert") pod "odh-model-controller-76588b95-6tm4n" (UID: "802ff626-f592-4f5f-937f-8628362815e8") : secret "odh-model-controller-webhook-cert" not found Jun 02 16:49:40.335507 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.335480 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsv7\" (UniqueName: \"kubernetes.io/projected/802ff626-f592-4f5f-937f-8628362815e8-kube-api-access-grsv7\") pod \"odh-model-controller-76588b95-6tm4n\" (UID: \"802ff626-f592-4f5f-937f-8628362815e8\") " pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:40.408331 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.408261 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" Jun 02 16:49:40.531124 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.531097 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8dc448d-lwccz"] Jun 02 16:49:40.533522 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:40.533493 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e84fb5_343d_4f23_bf47_097274669fbc.slice/crio-4b196b014f9117606cabd7db4269566d328a4f71217f6a727df4a84bf8137c53 WatchSource:0}: Error finding container 4b196b014f9117606cabd7db4269566d328a4f71217f6a727df4a84bf8137c53: Status 404 returned error can't find the container with id 4b196b014f9117606cabd7db4269566d328a4f71217f6a727df4a84bf8137c53 Jun 02 16:49:40.695381 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.695324 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-xsfhd"] Jun 02 16:49:40.699771 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.699754 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:40.702435 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.702419 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 16:49:40.711906 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.711887 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-xsfhd"] Jun 02 16:49:40.724314 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.724295 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7293276d-f43b-404a-8800-c7922d2e5d77-tls-certs\") pod \"model-serving-api-6577596cd5-xsfhd\" (UID: \"7293276d-f43b-404a-8800-c7922d2e5d77\") " pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:40.724413 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.724349 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dj6q\" (UniqueName: \"kubernetes.io/projected/7293276d-f43b-404a-8800-c7922d2e5d77-kube-api-access-2dj6q\") pod \"model-serving-api-6577596cd5-xsfhd\" (UID: \"7293276d-f43b-404a-8800-c7922d2e5d77\") " pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:40.825063 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.825037 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/802ff626-f592-4f5f-937f-8628362815e8-cert\") pod \"odh-model-controller-76588b95-6tm4n\" (UID: \"802ff626-f592-4f5f-937f-8628362815e8\") " pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:40.825162 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.825083 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7293276d-f43b-404a-8800-c7922d2e5d77-tls-certs\") pod \"model-serving-api-6577596cd5-xsfhd\" (UID: \"7293276d-f43b-404a-8800-c7922d2e5d77\") " pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:40.825162 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.825156 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dj6q\" (UniqueName: \"kubernetes.io/projected/7293276d-f43b-404a-8800-c7922d2e5d77-kube-api-access-2dj6q\") pod \"model-serving-api-6577596cd5-xsfhd\" (UID: \"7293276d-f43b-404a-8800-c7922d2e5d77\") " pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:40.826180 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.826146 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" event={"ID":"88e84fb5-343d-4f23-bf47-097274669fbc","Type":"ContainerStarted","Data":"4b196b014f9117606cabd7db4269566d328a4f71217f6a727df4a84bf8137c53"} Jun 02 16:49:40.827540 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.827516 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/802ff626-f592-4f5f-937f-8628362815e8-cert\") pod \"odh-model-controller-76588b95-6tm4n\" (UID: \"802ff626-f592-4f5f-937f-8628362815e8\") " pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:40.827684 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.827667 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7293276d-f43b-404a-8800-c7922d2e5d77-tls-certs\") pod \"model-serving-api-6577596cd5-xsfhd\" (UID: \"7293276d-f43b-404a-8800-c7922d2e5d77\") " pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:40.834319 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:40.834298 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dj6q\" (UniqueName: \"kubernetes.io/projected/7293276d-f43b-404a-8800-c7922d2e5d77-kube-api-access-2dj6q\") pod \"model-serving-api-6577596cd5-xsfhd\" (UID: \"7293276d-f43b-404a-8800-c7922d2e5d77\") " pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:41.009709 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.009644 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:41.028366 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.028328 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:41.156472 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.156422 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-xsfhd"] Jun 02 16:49:41.160370 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:41.160336 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7293276d_f43b_404a_8800_c7922d2e5d77.slice/crio-1caf1f0889c8e46c03e5838a78af685661ed4cb56307d0724ee2e601f651f89d WatchSource:0}: Error finding container 1caf1f0889c8e46c03e5838a78af685661ed4cb56307d0724ee2e601f651f89d: Status 404 returned error can't find the container with id 1caf1f0889c8e46c03e5838a78af685661ed4cb56307d0724ee2e601f651f89d Jun 02 16:49:41.181859 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.181835 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-6tm4n"] Jun 02 16:49:41.183447 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:41.183406 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802ff626_f592_4f5f_937f_8628362815e8.slice/crio-085e9c4282ea39d3b2dcb2e5ab1f858ac1765bd867a0f10896a7d8a655c9657b WatchSource:0}: Error finding container 085e9c4282ea39d3b2dcb2e5ab1f858ac1765bd867a0f10896a7d8a655c9657b: Status 404 returned error can't find the container with id 085e9c4282ea39d3b2dcb2e5ab1f858ac1765bd867a0f10896a7d8a655c9657b Jun 02 16:49:41.765922 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.764732 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj"] Jun 02 16:49:41.771416 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.770562 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.774235 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.773984 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7jbk\"" Jun 02 16:49:41.776375 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.774952 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj"] Jun 02 16:49:41.778748 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.777366 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 16:49:41.778748 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.777609 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 16:49:41.838603 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.834998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.838603 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.835063 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.838603 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.835161 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ll64\" (UniqueName: \"kubernetes.io/projected/33107ac0-2c16-4925-9433-6547f3d3eb67-kube-api-access-9ll64\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.840641 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.840607 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-xsfhd" event={"ID":"7293276d-f43b-404a-8800-c7922d2e5d77","Type":"ContainerStarted","Data":"1caf1f0889c8e46c03e5838a78af685661ed4cb56307d0724ee2e601f651f89d"} Jun 02 16:49:41.843221 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.843119 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-6tm4n" event={"ID":"802ff626-f592-4f5f-937f-8628362815e8","Type":"ContainerStarted","Data":"085e9c4282ea39d3b2dcb2e5ab1f858ac1765bd867a0f10896a7d8a655c9657b"} Jun 02 16:49:41.936024 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.935988 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.936168 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.936092 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9ll64\" (UniqueName: \"kubernetes.io/projected/33107ac0-2c16-4925-9433-6547f3d3eb67-kube-api-access-9ll64\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.936168 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.936133 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.937070 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.936489 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.937070 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.936763 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:41.948729 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:41.948683 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ll64\" (UniqueName: \"kubernetes.io/projected/33107ac0-2c16-4925-9433-6547f3d3eb67-kube-api-access-9ll64\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:42.094200 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:42.093968 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:45.353280 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.353247 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj"] Jun 02 16:49:45.356478 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:45.356430 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33107ac0_2c16_4925_9433_6547f3d3eb67.slice/crio-ac28045f5d251b42604939ff4982f4ee4355671087c0c7891ba7d00c0e89d737 WatchSource:0}: Error finding container ac28045f5d251b42604939ff4982f4ee4355671087c0c7891ba7d00c0e89d737: Status 404 returned error can't find the container with id ac28045f5d251b42604939ff4982f4ee4355671087c0c7891ba7d00c0e89d737 Jun 02 16:49:45.859598 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.859563 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-6tm4n" event={"ID":"802ff626-f592-4f5f-937f-8628362815e8","Type":"ContainerStarted","Data":"fc27d727120a5bc9c277020005a281411fe76afd10d7fd05ef56305f97888332"} Jun 02 16:49:45.859804 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.859679 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:45.860967 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.860942 2555 generic.go:358] "Generic (PLEG): container finished" podID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerID="738c3b704549f49aca5a933d9e6cea133ad73efc52d28fc0fd310ac38c075840" exitCode=0 Jun 02 16:49:45.861065 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.861028 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" event={"ID":"33107ac0-2c16-4925-9433-6547f3d3eb67","Type":"ContainerDied","Data":"738c3b704549f49aca5a933d9e6cea133ad73efc52d28fc0fd310ac38c075840"} Jun 02 16:49:45.861065 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.861056 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" event={"ID":"33107ac0-2c16-4925-9433-6547f3d3eb67","Type":"ContainerStarted","Data":"ac28045f5d251b42604939ff4982f4ee4355671087c0c7891ba7d00c0e89d737"} Jun 02 16:49:45.862356 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.862339 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" event={"ID":"88e84fb5-343d-4f23-bf47-097274669fbc","Type":"ContainerStarted","Data":"e3bbad7d9ac193d392f13e9091796dc84e9af07be3ac8446e2289b4ed81f8194"} Jun 02 16:49:45.863573 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.863554 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-xsfhd" event={"ID":"7293276d-f43b-404a-8800-c7922d2e5d77","Type":"ContainerStarted","Data":"f96845492368467045c64c03c455ed2a5fe88316ed18f155d44abb1977d4e72b"} Jun 02 16:49:45.863793 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.863778 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:45.878759 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.878720 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-6tm4n" podStartSLOduration=1.80601455 podStartE2EDuration="5.8787077s" podCreationTimestamp="2026-06-02 16:49:40 +0000 UTC" firstStartedPulling="2026-06-02 16:49:41.185333736 +0000 UTC m=+504.470612451" lastFinishedPulling="2026-06-02 16:49:45.258026881 +0000 UTC m=+508.543305601" observedRunningTime="2026-06-02 16:49:45.876403443 +0000 UTC m=+509.161682178" watchObservedRunningTime="2026-06-02 16:49:45.8787077 +0000 UTC m=+509.163986428" Jun 02 16:49:45.893588 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.893521 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-xsfhd" podStartSLOduration=1.836808207 podStartE2EDuration="5.893510161s" podCreationTimestamp="2026-06-02 16:49:40 +0000 UTC" firstStartedPulling="2026-06-02 16:49:41.162639266 +0000 UTC m=+504.447917983" lastFinishedPulling="2026-06-02 16:49:45.219341224 +0000 UTC m=+508.504619937" observedRunningTime="2026-06-02 16:49:45.892166038 +0000 UTC m=+509.177444777" watchObservedRunningTime="2026-06-02 16:49:45.893510161 +0000 UTC m=+509.178788897" Jun 02 16:49:45.907990 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:45.907952 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8dc448d-lwccz" podStartSLOduration=1.195595917 podStartE2EDuration="5.907942218s" podCreationTimestamp="2026-06-02 16:49:40 +0000 UTC" firstStartedPulling="2026-06-02 16:49:40.535104158 +0000 UTC m=+503.820382872" lastFinishedPulling="2026-06-02 16:49:45.247450458 +0000 UTC m=+508.532729173" observedRunningTime="2026-06-02 16:49:45.906598553 +0000 UTC m=+509.191877289" watchObservedRunningTime="2026-06-02 16:49:45.907942218 +0000 UTC m=+509.193220953" Jun 02 16:49:48.875190 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:48.875157 2555 generic.go:358] "Generic (PLEG): container finished" podID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerID="e532c9416a87fb6d6f8d1514b6506ac2729574c881824d0d2576d52872d8d8c1" exitCode=0 Jun 02 16:49:48.875558 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:48.875244 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" event={"ID":"33107ac0-2c16-4925-9433-6547f3d3eb67","Type":"ContainerDied","Data":"e532c9416a87fb6d6f8d1514b6506ac2729574c881824d0d2576d52872d8d8c1"} Jun 02 16:49:49.881000 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:49.880965 2555 generic.go:358] "Generic (PLEG): container finished" podID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerID="16e89199efca401c6f8b4604ba49e9ee28f3f6f68c5603c3ee45555861d1779b" exitCode=0 Jun 02 16:49:49.881384 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:49.881050 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" event={"ID":"33107ac0-2c16-4925-9433-6547f3d3eb67","Type":"ContainerDied","Data":"16e89199efca401c6f8b4604ba49e9ee28f3f6f68c5603c3ee45555861d1779b"} Jun 02 16:49:50.055074 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.055039 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w"] Jun 02 16:49:50.058172 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.058156 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.061057 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.061038 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 16:49:50.062175 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.062155 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xkc24\"" Jun 02 16:49:50.062497 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.062478 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh"] Jun 02 16:49:50.065446 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.065424 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:50.068674 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.068636 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 16:49:50.068778 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.068709 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-q6jsp\"" Jun 02 16:49:50.070320 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.070300 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w"] Jun 02 16:49:50.078258 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.078239 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh"] Jun 02 16:49:50.103775 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.103749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4zvx\" (UniqueName: \"kubernetes.io/projected/45c37a6e-9fe3-45dc-b49c-09310a59af00-kube-api-access-w4zvx\") pod \"kserve-controller-manager-7c99ffcdcd-psc4w\" (UID: \"45c37a6e-9fe3-45dc-b49c-09310a59af00\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.103868 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.103785 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c37a6e-9fe3-45dc-b49c-09310a59af00-cert\") pod \"kserve-controller-manager-7c99ffcdcd-psc4w\" (UID: \"45c37a6e-9fe3-45dc-b49c-09310a59af00\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.204601 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.204542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2595e25-6fd6-4a25-a083-08a87a70670a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcdlh\" (UID: \"a2595e25-6fd6-4a25-a083-08a87a70670a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:50.204714 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.204597 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4zvx\" (UniqueName: \"kubernetes.io/projected/45c37a6e-9fe3-45dc-b49c-09310a59af00-kube-api-access-w4zvx\") pod \"kserve-controller-manager-7c99ffcdcd-psc4w\" (UID: \"45c37a6e-9fe3-45dc-b49c-09310a59af00\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.204714 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.204627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5ms7\" (UniqueName: \"kubernetes.io/projected/a2595e25-6fd6-4a25-a083-08a87a70670a-kube-api-access-p5ms7\") pod \"llmisvc-controller-manager-c6b9847d7-wcdlh\" (UID: \"a2595e25-6fd6-4a25-a083-08a87a70670a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:50.204714 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.204644 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c37a6e-9fe3-45dc-b49c-09310a59af00-cert\") pod \"kserve-controller-manager-7c99ffcdcd-psc4w\" (UID: \"45c37a6e-9fe3-45dc-b49c-09310a59af00\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.204822 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:49:50.204756 2555 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 16:49:50.204822 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:49:50.204804 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45c37a6e-9fe3-45dc-b49c-09310a59af00-cert podName:45c37a6e-9fe3-45dc-b49c-09310a59af00 nodeName:}" failed. No retries permitted until 2026-06-02 16:49:50.704789476 +0000 UTC m=+513.990068195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/45c37a6e-9fe3-45dc-b49c-09310a59af00-cert") pod "kserve-controller-manager-7c99ffcdcd-psc4w" (UID: "45c37a6e-9fe3-45dc-b49c-09310a59af00") : secret "kserve-webhook-server-cert" not found Jun 02 16:49:50.218307 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.218284 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4zvx\" (UniqueName: \"kubernetes.io/projected/45c37a6e-9fe3-45dc-b49c-09310a59af00-kube-api-access-w4zvx\") pod \"kserve-controller-manager-7c99ffcdcd-psc4w\" (UID: \"45c37a6e-9fe3-45dc-b49c-09310a59af00\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.305747 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.305722 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2595e25-6fd6-4a25-a083-08a87a70670a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcdlh\" (UID: \"a2595e25-6fd6-4a25-a083-08a87a70670a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:50.305851 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.305791 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p5ms7\" (UniqueName: \"kubernetes.io/projected/a2595e25-6fd6-4a25-a083-08a87a70670a-kube-api-access-p5ms7\") pod \"llmisvc-controller-manager-c6b9847d7-wcdlh\" (UID: \"a2595e25-6fd6-4a25-a083-08a87a70670a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:50.305910 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:49:50.305845 2555 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 02 16:49:50.305910 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:49:50.305899 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2595e25-6fd6-4a25-a083-08a87a70670a-cert podName:a2595e25-6fd6-4a25-a083-08a87a70670a nodeName:}" failed. No retries permitted until 2026-06-02 16:49:50.805886351 +0000 UTC m=+514.091165064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a2595e25-6fd6-4a25-a083-08a87a70670a-cert") pod "llmisvc-controller-manager-c6b9847d7-wcdlh" (UID: "a2595e25-6fd6-4a25-a083-08a87a70670a") : secret "llmisvc-webhook-server-cert" not found Jun 02 16:49:50.319407 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.319382 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5ms7\" (UniqueName: \"kubernetes.io/projected/a2595e25-6fd6-4a25-a083-08a87a70670a-kube-api-access-p5ms7\") pod \"llmisvc-controller-manager-c6b9847d7-wcdlh\" (UID: \"a2595e25-6fd6-4a25-a083-08a87a70670a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:50.709499 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.709468 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c37a6e-9fe3-45dc-b49c-09310a59af00-cert\") pod \"kserve-controller-manager-7c99ffcdcd-psc4w\" (UID: \"45c37a6e-9fe3-45dc-b49c-09310a59af00\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.711921 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.711891 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/45c37a6e-9fe3-45dc-b49c-09310a59af00-cert\") pod \"kserve-controller-manager-7c99ffcdcd-psc4w\" (UID: \"45c37a6e-9fe3-45dc-b49c-09310a59af00\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.810481 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.810448 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2595e25-6fd6-4a25-a083-08a87a70670a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcdlh\" (UID: \"a2595e25-6fd6-4a25-a083-08a87a70670a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:50.812727 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.812705 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a2595e25-6fd6-4a25-a083-08a87a70670a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-wcdlh\" (UID: \"a2595e25-6fd6-4a25-a083-08a87a70670a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:50.968993 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.968930 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:50.978817 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:50.978790 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:51.005180 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.005154 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:51.113541 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.113515 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ll64\" (UniqueName: \"kubernetes.io/projected/33107ac0-2c16-4925-9433-6547f3d3eb67-kube-api-access-9ll64\") pod \"33107ac0-2c16-4925-9433-6547f3d3eb67\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " Jun 02 16:49:51.113689 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.113568 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-bundle\") pod \"33107ac0-2c16-4925-9433-6547f3d3eb67\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " Jun 02 16:49:51.113689 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.113597 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-util\") pod \"33107ac0-2c16-4925-9433-6547f3d3eb67\" (UID: \"33107ac0-2c16-4925-9433-6547f3d3eb67\") " Jun 02 16:49:51.114984 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.114957 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-bundle" (OuterVolumeSpecName: "bundle") pod "33107ac0-2c16-4925-9433-6547f3d3eb67" (UID: "33107ac0-2c16-4925-9433-6547f3d3eb67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:49:51.117885 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.117860 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33107ac0-2c16-4925-9433-6547f3d3eb67-kube-api-access-9ll64" (OuterVolumeSpecName: "kube-api-access-9ll64") pod "33107ac0-2c16-4925-9433-6547f3d3eb67" (UID: "33107ac0-2c16-4925-9433-6547f3d3eb67"). InnerVolumeSpecName "kube-api-access-9ll64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:49:51.119550 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.119528 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-util" (OuterVolumeSpecName: "util") pod "33107ac0-2c16-4925-9433-6547f3d3eb67" (UID: "33107ac0-2c16-4925-9433-6547f3d3eb67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:49:51.138883 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.138858 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh"] Jun 02 16:49:51.139905 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:51.139880 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2595e25_6fd6_4a25_a083_08a87a70670a.slice/crio-3de67bd968ab874247cf3622aed914c549e4b39324f11941096301e9047b0c04 WatchSource:0}: Error finding container 3de67bd968ab874247cf3622aed914c549e4b39324f11941096301e9047b0c04: Status 404 returned error can't find the container with id 3de67bd968ab874247cf3622aed914c549e4b39324f11941096301e9047b0c04 Jun 02 16:49:51.153080 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.153057 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w"] Jun 02 16:49:51.156418 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:51.156392 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45c37a6e_9fe3_45dc_b49c_09310a59af00.slice/crio-aff9a80f27958b0f15235c56e24e29a5fdffe45c557393d1c6a1fe1c1943cd41 WatchSource:0}: Error finding container aff9a80f27958b0f15235c56e24e29a5fdffe45c557393d1c6a1fe1c1943cd41: Status 404 returned error can't find the container with id aff9a80f27958b0f15235c56e24e29a5fdffe45c557393d1c6a1fe1c1943cd41 Jun 02 16:49:51.214567 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.214534 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ll64\" (UniqueName: \"kubernetes.io/projected/33107ac0-2c16-4925-9433-6547f3d3eb67-kube-api-access-9ll64\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:49:51.214567 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.214568 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:49:51.214738 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.214584 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33107ac0-2c16-4925-9433-6547f3d3eb67-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:49:51.889453 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.889414 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" event={"ID":"45c37a6e-9fe3-45dc-b49c-09310a59af00","Type":"ContainerStarted","Data":"aff9a80f27958b0f15235c56e24e29a5fdffe45c557393d1c6a1fe1c1943cd41"} Jun 02 16:49:51.890939 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.890903 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" event={"ID":"a2595e25-6fd6-4a25-a083-08a87a70670a","Type":"ContainerStarted","Data":"3de67bd968ab874247cf3622aed914c549e4b39324f11941096301e9047b0c04"} Jun 02 16:49:51.892864 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.892841 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" event={"ID":"33107ac0-2c16-4925-9433-6547f3d3eb67","Type":"ContainerDied","Data":"ac28045f5d251b42604939ff4982f4ee4355671087c0c7891ba7d00c0e89d737"} Jun 02 16:49:51.892944 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.892870 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac28045f5d251b42604939ff4982f4ee4355671087c0c7891ba7d00c0e89d737" Jun 02 16:49:51.892986 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:51.892949 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835xc9bj" Jun 02 16:49:54.905412 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:54.905378 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" event={"ID":"a2595e25-6fd6-4a25-a083-08a87a70670a","Type":"ContainerStarted","Data":"063a1d8fe9c7db13aeb650e833bb60b45493f1a9251cef70f5fed688b989a377"} Jun 02 16:49:54.905412 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:54.905420 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:49:54.906766 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:54.906746 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" event={"ID":"45c37a6e-9fe3-45dc-b49c-09310a59af00","Type":"ContainerStarted","Data":"486def830ed8d74d5b5db08320ca922faf1ff19d78028971a0649fbd154959c0"} Jun 02 16:49:54.906878 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:54.906861 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:49:54.929012 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:54.928968 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" podStartSLOduration=1.747483773 podStartE2EDuration="4.928956484s" podCreationTimestamp="2026-06-02 16:49:50 +0000 UTC" firstStartedPulling="2026-06-02 16:49:51.141240887 +0000 UTC m=+514.426519602" lastFinishedPulling="2026-06-02 16:49:54.322713584 +0000 UTC m=+517.607992313" observedRunningTime="2026-06-02 16:49:54.926638332 +0000 UTC m=+518.211917065" watchObservedRunningTime="2026-06-02 16:49:54.928956484 +0000 UTC m=+518.214235220" Jun 02 16:49:54.947430 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:54.947389 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" podStartSLOduration=1.789170485 podStartE2EDuration="4.94737552s" podCreationTimestamp="2026-06-02 16:49:50 +0000 UTC" firstStartedPulling="2026-06-02 16:49:51.158049759 +0000 UTC m=+514.443328473" lastFinishedPulling="2026-06-02 16:49:54.31625479 +0000 UTC m=+517.601533508" observedRunningTime="2026-06-02 16:49:54.946675117 +0000 UTC m=+518.231953852" watchObservedRunningTime="2026-06-02 16:49:54.94737552 +0000 UTC m=+518.232654256" Jun 02 16:49:56.485199 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.485166 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5"] Jun 02 16:49:56.485624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.485447 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerName="util" Jun 02 16:49:56.485624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.485457 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerName="util" Jun 02 16:49:56.485624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.485473 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerName="pull" Jun 02 16:49:56.485624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.485479 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerName="pull" Jun 02 16:49:56.485624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.485488 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerName="extract" Jun 02 16:49:56.485624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.485493 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerName="extract" Jun 02 16:49:56.485624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.485541 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="33107ac0-2c16-4925-9433-6547f3d3eb67" containerName="extract" Jun 02 16:49:56.545946 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.545921 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5"] Jun 02 16:49:56.546080 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.546022 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.558425 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.558401 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 16:49:56.558550 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.558432 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7jbk\"" Jun 02 16:49:56.558550 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.558406 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 16:49:56.659082 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.659057 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.659200 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.659102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnnk7\" (UniqueName: \"kubernetes.io/projected/4d53cdff-f026-420c-b945-3f03e0d8bcd1-kube-api-access-vnnk7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.659200 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.659135 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.759992 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.759930 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnnk7\" (UniqueName: \"kubernetes.io/projected/4d53cdff-f026-420c-b945-3f03e0d8bcd1-kube-api-access-vnnk7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.760119 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.759994 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.760119 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.760050 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.760471 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.760449 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.760471 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.760463 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.782281 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.782257 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnnk7\" (UniqueName: \"kubernetes.io/projected/4d53cdff-f026-420c-b945-3f03e0d8bcd1-kube-api-access-vnnk7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.855414 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.855394 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:49:56.873026 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.873008 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-xsfhd" Jun 02 16:49:56.894040 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:56.894015 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-6tm4n" Jun 02 16:49:57.216349 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.216322 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5"] Jun 02 16:49:57.217907 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:57.217879 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d53cdff_f026_420c_b945_3f03e0d8bcd1.slice/crio-506e07211540dac79518db69ff4bac6ced93943b57709d28e7552fa83eb4e585 WatchSource:0}: Error finding container 506e07211540dac79518db69ff4bac6ced93943b57709d28e7552fa83eb4e585: Status 404 returned error can't find the container with id 506e07211540dac79518db69ff4bac6ced93943b57709d28e7552fa83eb4e585 Jun 02 16:49:57.737181 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.737152 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l"] Jun 02 16:49:57.739531 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.739513 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:49:57.743667 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.743641 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 16:49:57.743887 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.743873 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-ckw9k\"" Jun 02 16:49:57.743975 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.743957 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 16:49:57.755829 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.755783 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l"] Jun 02 16:49:57.869958 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.869923 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vz6x\" (UniqueName: \"kubernetes.io/projected/31f93747-b1dd-4adc-ae44-c5b0dfdc5aca-kube-api-access-2vz6x\") pod \"servicemesh-operator3-55f49c5f94-p8q9l\" (UID: \"31f93747-b1dd-4adc-ae44-c5b0dfdc5aca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:49:57.870057 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.869976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/31f93747-b1dd-4adc-ae44-c5b0dfdc5aca-operator-config\") pod \"servicemesh-operator3-55f49c5f94-p8q9l\" (UID: \"31f93747-b1dd-4adc-ae44-c5b0dfdc5aca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:49:57.919312 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.919283 2555 generic.go:358] "Generic (PLEG): container finished" podID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerID="13a1e962ed8fb0ebd037852663a95aae12476fb9a50a314e88f05bb1ebecb52a" exitCode=0 Jun 02 16:49:57.919419 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.919369 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" event={"ID":"4d53cdff-f026-420c-b945-3f03e0d8bcd1","Type":"ContainerDied","Data":"13a1e962ed8fb0ebd037852663a95aae12476fb9a50a314e88f05bb1ebecb52a"} Jun 02 16:49:57.919419 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.919397 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" event={"ID":"4d53cdff-f026-420c-b945-3f03e0d8bcd1","Type":"ContainerStarted","Data":"506e07211540dac79518db69ff4bac6ced93943b57709d28e7552fa83eb4e585"} Jun 02 16:49:57.971200 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.971179 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/31f93747-b1dd-4adc-ae44-c5b0dfdc5aca-operator-config\") pod \"servicemesh-operator3-55f49c5f94-p8q9l\" (UID: \"31f93747-b1dd-4adc-ae44-c5b0dfdc5aca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:49:57.971301 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.971245 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vz6x\" (UniqueName: \"kubernetes.io/projected/31f93747-b1dd-4adc-ae44-c5b0dfdc5aca-kube-api-access-2vz6x\") pod \"servicemesh-operator3-55f49c5f94-p8q9l\" (UID: \"31f93747-b1dd-4adc-ae44-c5b0dfdc5aca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:49:57.973574 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.973547 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/31f93747-b1dd-4adc-ae44-c5b0dfdc5aca-operator-config\") pod \"servicemesh-operator3-55f49c5f94-p8q9l\" (UID: \"31f93747-b1dd-4adc-ae44-c5b0dfdc5aca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:49:57.992507 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:57.992458 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vz6x\" (UniqueName: \"kubernetes.io/projected/31f93747-b1dd-4adc-ae44-c5b0dfdc5aca-kube-api-access-2vz6x\") pod \"servicemesh-operator3-55f49c5f94-p8q9l\" (UID: \"31f93747-b1dd-4adc-ae44-c5b0dfdc5aca\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:49:58.048116 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:58.048095 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:49:58.178749 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:58.178724 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l"] Jun 02 16:49:58.180256 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:49:58.180229 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f93747_b1dd_4adc_ae44_c5b0dfdc5aca.slice/crio-c375b061bc953077219cc1bea93c72479bb7b68bbb7f3cc647220c8e60571abe WatchSource:0}: Error finding container c375b061bc953077219cc1bea93c72479bb7b68bbb7f3cc647220c8e60571abe: Status 404 returned error can't find the container with id c375b061bc953077219cc1bea93c72479bb7b68bbb7f3cc647220c8e60571abe Jun 02 16:49:58.923832 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:58.923791 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" event={"ID":"31f93747-b1dd-4adc-ae44-c5b0dfdc5aca","Type":"ContainerStarted","Data":"c375b061bc953077219cc1bea93c72479bb7b68bbb7f3cc647220c8e60571abe"} Jun 02 16:49:59.928331 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:59.928297 2555 generic.go:358] "Generic (PLEG): container finished" podID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerID="aad048259ce89f9e001ee49e660418a0fe417b314cefcf04ac1ff85b8d0fb374" exitCode=0 Jun 02 16:49:59.928742 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:49:59.928379 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" event={"ID":"4d53cdff-f026-420c-b945-3f03e0d8bcd1","Type":"ContainerDied","Data":"aad048259ce89f9e001ee49e660418a0fe417b314cefcf04ac1ff85b8d0fb374"} Jun 02 16:50:00.934088 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:00.934054 2555 generic.go:358] "Generic (PLEG): container finished" podID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerID="a63641af16ff0ff03f116e29b3f25a69a0a58bfc30dc4d038f3d3191b2cc3a11" exitCode=0 Jun 02 16:50:00.934452 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:00.934129 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" event={"ID":"4d53cdff-f026-420c-b945-3f03e0d8bcd1","Type":"ContainerDied","Data":"a63641af16ff0ff03f116e29b3f25a69a0a58bfc30dc4d038f3d3191b2cc3a11"} Jun 02 16:50:02.074189 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.074161 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:50:02.208117 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.208050 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnnk7\" (UniqueName: \"kubernetes.io/projected/4d53cdff-f026-420c-b945-3f03e0d8bcd1-kube-api-access-vnnk7\") pod \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " Jun 02 16:50:02.208117 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.208092 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-bundle\") pod \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " Jun 02 16:50:02.208299 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.208124 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-util\") pod \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\" (UID: \"4d53cdff-f026-420c-b945-3f03e0d8bcd1\") " Jun 02 16:50:02.208989 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.208961 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-bundle" (OuterVolumeSpecName: "bundle") pod "4d53cdff-f026-420c-b945-3f03e0d8bcd1" (UID: "4d53cdff-f026-420c-b945-3f03e0d8bcd1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:50:02.210093 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.210075 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d53cdff-f026-420c-b945-3f03e0d8bcd1-kube-api-access-vnnk7" (OuterVolumeSpecName: "kube-api-access-vnnk7") pod "4d53cdff-f026-420c-b945-3f03e0d8bcd1" (UID: "4d53cdff-f026-420c-b945-3f03e0d8bcd1"). InnerVolumeSpecName "kube-api-access-vnnk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:50:02.213132 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.213099 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-util" (OuterVolumeSpecName: "util") pod "4d53cdff-f026-420c-b945-3f03e0d8bcd1" (UID: "4d53cdff-f026-420c-b945-3f03e0d8bcd1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:50:02.309538 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.309516 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnnk7\" (UniqueName: \"kubernetes.io/projected/4d53cdff-f026-420c-b945-3f03e0d8bcd1-kube-api-access-vnnk7\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:50:02.309538 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.309537 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:50:02.309666 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.309550 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d53cdff-f026-420c-b945-3f03e0d8bcd1-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:50:02.943524 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.943491 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" event={"ID":"4d53cdff-f026-420c-b945-3f03e0d8bcd1","Type":"ContainerDied","Data":"506e07211540dac79518db69ff4bac6ced93943b57709d28e7552fa83eb4e585"} Jun 02 16:50:02.943524 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.943528 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="506e07211540dac79518db69ff4bac6ced93943b57709d28e7552fa83eb4e585" Jun 02 16:50:02.943780 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:02.943554 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762asjrq5" Jun 02 16:50:07.962872 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:07.962831 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" event={"ID":"31f93747-b1dd-4adc-ae44-c5b0dfdc5aca","Type":"ContainerStarted","Data":"0d9db70635da47a9ce58ddc148f4430f570c4351c7dfcb925ff41e1b784cbfc8"} Jun 02 16:50:07.963282 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:07.962976 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:50:07.984029 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:07.983975 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" podStartSLOduration=2.20088395 podStartE2EDuration="10.983957376s" podCreationTimestamp="2026-06-02 16:49:57 +0000 UTC" firstStartedPulling="2026-06-02 16:49:58.182761395 +0000 UTC m=+521.468040109" lastFinishedPulling="2026-06-02 16:50:06.965834822 +0000 UTC m=+530.251113535" observedRunningTime="2026-06-02 16:50:07.981670309 +0000 UTC m=+531.266949041" watchObservedRunningTime="2026-06-02 16:50:07.983957376 +0000 UTC m=+531.269236112" Jun 02 16:50:08.185757 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.185721 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22"] Jun 02 16:50:08.186207 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.186179 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerName="pull" Jun 02 16:50:08.186207 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.186198 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerName="pull" Jun 02 16:50:08.186335 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.186227 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerName="util" Jun 02 16:50:08.186335 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.186236 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerName="util" Jun 02 16:50:08.186335 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.186254 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerName="extract" Jun 02 16:50:08.186335 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.186263 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerName="extract" Jun 02 16:50:08.186459 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.186338 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d53cdff-f026-420c-b945-3f03e0d8bcd1" containerName="extract" Jun 02 16:50:08.189341 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.189324 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.192087 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.192055 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 16:50:08.192087 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.192074 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xhnql\"" Jun 02 16:50:08.192270 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.192096 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 16:50:08.192270 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.192062 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 16:50:08.192270 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.192064 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 16:50:08.199352 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.199326 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22"] Jun 02 16:50:08.356663 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.356625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e4425a-08b8-4165-856c-cede12ff3a95-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.356801 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.356684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.356801 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.356723 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.356801 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.356747 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41e4425a-08b8-4165-856c-cede12ff3a95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.356901 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.356797 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.356901 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.356851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e4425a-08b8-4165-856c-cede12ff3a95-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.356901 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.356875 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzmd\" (UniqueName: \"kubernetes.io/projected/41e4425a-08b8-4165-856c-cede12ff3a95-kube-api-access-hbzmd\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.458113 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.458076 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzmd\" (UniqueName: \"kubernetes.io/projected/41e4425a-08b8-4165-856c-cede12ff3a95-kube-api-access-hbzmd\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.458278 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.458142 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e4425a-08b8-4165-856c-cede12ff3a95-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.458278 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.458186 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.458278 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.458217 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.458278 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.458252 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41e4425a-08b8-4165-856c-cede12ff3a95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.458490 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.458286 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.458490 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.458339 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e4425a-08b8-4165-856c-cede12ff3a95-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.459072 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.459035 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/41e4425a-08b8-4165-856c-cede12ff3a95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.460675 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.460621 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.460790 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.460729 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.460917 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.460899 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/41e4425a-08b8-4165-856c-cede12ff3a95-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.460978 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.460939 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/41e4425a-08b8-4165-856c-cede12ff3a95-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.466200 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.466180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41e4425a-08b8-4165-856c-cede12ff3a95-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.466502 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.466483 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzmd\" (UniqueName: \"kubernetes.io/projected/41e4425a-08b8-4165-856c-cede12ff3a95-kube-api-access-hbzmd\") pod \"istiod-openshift-gateway-798958bb55-vdg22\" (UID: \"41e4425a-08b8-4165-856c-cede12ff3a95\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.499561 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.499540 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:08.631710 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.631683 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22"] Jun 02 16:50:08.632634 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:50:08.632610 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e4425a_08b8_4165_856c_cede12ff3a95.slice/crio-5a2ffea575c8ee17c595104fb7bc8d8a5522e48c98e9668fb65dd791000122f3 WatchSource:0}: Error finding container 5a2ffea575c8ee17c595104fb7bc8d8a5522e48c98e9668fb65dd791000122f3: Status 404 returned error can't find the container with id 5a2ffea575c8ee17c595104fb7bc8d8a5522e48c98e9668fb65dd791000122f3 Jun 02 16:50:08.967846 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:08.967751 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" event={"ID":"41e4425a-08b8-4165-856c-cede12ff3a95","Type":"ContainerStarted","Data":"5a2ffea575c8ee17c595104fb7bc8d8a5522e48c98e9668fb65dd791000122f3"} Jun 02 16:50:11.522081 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:11.522047 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 16:50:11.522364 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:11.522110 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 16:50:11.981021 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:11.980932 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" event={"ID":"41e4425a-08b8-4165-856c-cede12ff3a95","Type":"ContainerStarted","Data":"83ea40ba8de15af1bb54b1bf832bc5f2441a8099f080ec9fabeba7952d620c7c"} Jun 02 16:50:11.981021 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:11.980995 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:12.003545 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:12.003488 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" podStartSLOduration=1.116421213 podStartE2EDuration="4.00347452s" podCreationTimestamp="2026-06-02 16:50:08 +0000 UTC" firstStartedPulling="2026-06-02 16:50:08.634776027 +0000 UTC m=+531.920054743" lastFinishedPulling="2026-06-02 16:50:11.521829337 +0000 UTC m=+534.807108050" observedRunningTime="2026-06-02 16:50:12.002239742 +0000 UTC m=+535.287518479" watchObservedRunningTime="2026-06-02 16:50:12.00347452 +0000 UTC m=+535.288753255" Jun 02 16:50:12.998096 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:12.998066 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vdg22" Jun 02 16:50:13.365388 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.365339 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-584bd5886b-lbtxw"] Jun 02 16:50:13.371962 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.371941 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" Jun 02 16:50:13.374929 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.374898 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vj58k\"" Jun 02 16:50:13.375225 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.375207 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 16:50:13.376442 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.376423 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-584bd5886b-lbtxw"] Jun 02 16:50:13.501372 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.501338 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5gnm\" (UniqueName: \"kubernetes.io/projected/5ddf844b-d06c-4c5e-8bbd-615254057a88-kube-api-access-t5gnm\") pod \"dashboard-redirect-584bd5886b-lbtxw\" (UID: \"5ddf844b-d06c-4c5e-8bbd-615254057a88\") " pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" Jun 02 16:50:13.501548 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.501389 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5ddf844b-d06c-4c5e-8bbd-615254057a88-redirect-config\") pod \"dashboard-redirect-584bd5886b-lbtxw\" (UID: \"5ddf844b-d06c-4c5e-8bbd-615254057a88\") " pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" Jun 02 16:50:13.602553 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.602518 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5gnm\" (UniqueName: \"kubernetes.io/projected/5ddf844b-d06c-4c5e-8bbd-615254057a88-kube-api-access-t5gnm\") pod \"dashboard-redirect-584bd5886b-lbtxw\" (UID: \"5ddf844b-d06c-4c5e-8bbd-615254057a88\") " pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" Jun 02 16:50:13.602736 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.602560 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5ddf844b-d06c-4c5e-8bbd-615254057a88-redirect-config\") pod \"dashboard-redirect-584bd5886b-lbtxw\" (UID: \"5ddf844b-d06c-4c5e-8bbd-615254057a88\") " pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" Jun 02 16:50:13.603230 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.603212 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5ddf844b-d06c-4c5e-8bbd-615254057a88-redirect-config\") pod \"dashboard-redirect-584bd5886b-lbtxw\" (UID: \"5ddf844b-d06c-4c5e-8bbd-615254057a88\") " pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" Jun 02 16:50:13.611811 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.611784 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5gnm\" (UniqueName: \"kubernetes.io/projected/5ddf844b-d06c-4c5e-8bbd-615254057a88-kube-api-access-t5gnm\") pod \"dashboard-redirect-584bd5886b-lbtxw\" (UID: \"5ddf844b-d06c-4c5e-8bbd-615254057a88\") " pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" Jun 02 16:50:13.683762 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.683698 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" Jun 02 16:50:13.814932 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:13.814904 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-584bd5886b-lbtxw"] Jun 02 16:50:13.816640 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:50:13.816607 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ddf844b_d06c_4c5e_8bbd_615254057a88.slice/crio-0fb86c48a0ab8d23f8f4e9cef929ecb6ed26dde3e7d9b6d2df1b76036725c2ec WatchSource:0}: Error finding container 0fb86c48a0ab8d23f8f4e9cef929ecb6ed26dde3e7d9b6d2df1b76036725c2ec: Status 404 returned error can't find the container with id 0fb86c48a0ab8d23f8f4e9cef929ecb6ed26dde3e7d9b6d2df1b76036725c2ec Jun 02 16:50:14.007153 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:14.007057 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" event={"ID":"5ddf844b-d06c-4c5e-8bbd-615254057a88","Type":"ContainerStarted","Data":"0fb86c48a0ab8d23f8f4e9cef929ecb6ed26dde3e7d9b6d2df1b76036725c2ec"} Jun 02 16:50:16.016593 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:16.016562 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" event={"ID":"5ddf844b-d06c-4c5e-8bbd-615254057a88","Type":"ContainerStarted","Data":"d402f387656624955c14bd1523606d89c6db6d6133e511dc96125bac13b74946"} Jun 02 16:50:16.033375 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:16.033330 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-584bd5886b-lbtxw" podStartSLOduration=1.153014633 podStartE2EDuration="3.03331635s" podCreationTimestamp="2026-06-02 16:50:13 +0000 UTC" firstStartedPulling="2026-06-02 16:50:13.817986602 +0000 UTC m=+537.103265316" lastFinishedPulling="2026-06-02 16:50:15.698288309 +0000 UTC m=+538.983567033" observedRunningTime="2026-06-02 16:50:16.031225641 +0000 UTC m=+539.316504380" watchObservedRunningTime="2026-06-02 16:50:16.03331635 +0000 UTC m=+539.318595142" Jun 02 16:50:18.969761 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:18.969725 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-p8q9l" Jun 02 16:50:25.912084 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:25.912050 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-wcdlh" Jun 02 16:50:25.915101 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:25.915083 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-psc4w" Jun 02 16:50:56.316608 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.316568 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj"] Jun 02 16:50:56.336249 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.336213 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj"] Jun 02 16:50:56.336428 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.336326 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.339493 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.339469 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 16:50:56.339493 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.339484 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 16:50:56.340710 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.340690 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6g5tq\"" Jun 02 16:50:56.403999 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.403971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvkgf\" (UniqueName: \"kubernetes.io/projected/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-kube-api-access-zvkgf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.404101 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.404005 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.404101 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.404070 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.505276 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.505247 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zvkgf\" (UniqueName: \"kubernetes.io/projected/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-kube-api-access-zvkgf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.505354 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.505282 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.505436 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.505416 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.505732 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.505709 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.505785 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.505742 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.514202 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.514180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvkgf\" (UniqueName: \"kubernetes.io/projected/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-kube-api-access-zvkgf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.646560 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.646510 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:50:56.711103 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.711075 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5"] Jun 02 16:50:56.715935 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.715919 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.722487 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.722465 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5"] Jun 02 16:50:56.776660 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.776629 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj"] Jun 02 16:50:56.778329 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:50:56.778304 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1a54b55_5b0a_4f00_87e8_1a17faa6516c.slice/crio-dc9247246785ce223725c816214f2dcc811e866cdb15116962d84e465356945b WatchSource:0}: Error finding container dc9247246785ce223725c816214f2dcc811e866cdb15116962d84e465356945b: Status 404 returned error can't find the container with id dc9247246785ce223725c816214f2dcc811e866cdb15116962d84e465356945b Jun 02 16:50:56.808516 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.808491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.808607 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.808523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.808684 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.808608 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9lst\" (UniqueName: \"kubernetes.io/projected/1fb2e621-01b9-4771-b86f-80eb6b753f8c-kube-api-access-m9lst\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.910123 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.910066 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9lst\" (UniqueName: \"kubernetes.io/projected/1fb2e621-01b9-4771-b86f-80eb6b753f8c-kube-api-access-m9lst\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.910123 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.910116 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.910300 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.910140 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.911581 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.910925 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.911581 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.910972 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:56.918628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:56.918607 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9lst\" (UniqueName: \"kubernetes.io/projected/1fb2e621-01b9-4771-b86f-80eb6b753f8c-kube-api-access-m9lst\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:57.027362 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.027340 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:50:57.152866 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.152837 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5"] Jun 02 16:50:57.154167 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:50:57.154144 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb2e621_01b9_4771_b86f_80eb6b753f8c.slice/crio-77a0af6a91fe7cd31228cbc4d40be13917539f0a9b2fc677cb3e7d47bc908b7e WatchSource:0}: Error finding container 77a0af6a91fe7cd31228cbc4d40be13917539f0a9b2fc677cb3e7d47bc908b7e: Status 404 returned error can't find the container with id 77a0af6a91fe7cd31228cbc4d40be13917539f0a9b2fc677cb3e7d47bc908b7e Jun 02 16:50:57.171767 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.171741 2555 generic.go:358] "Generic (PLEG): container finished" podID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerID="da9e478c7be7191b21881b5c6d93427028dc7ca6b4b91239c880dd6d15e7d02c" exitCode=0 Jun 02 16:50:57.171872 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.171829 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" event={"ID":"e1a54b55-5b0a-4f00-87e8-1a17faa6516c","Type":"ContainerDied","Data":"da9e478c7be7191b21881b5c6d93427028dc7ca6b4b91239c880dd6d15e7d02c"} Jun 02 16:50:57.171872 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.171863 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" event={"ID":"e1a54b55-5b0a-4f00-87e8-1a17faa6516c","Type":"ContainerStarted","Data":"dc9247246785ce223725c816214f2dcc811e866cdb15116962d84e465356945b"} Jun 02 16:50:57.173023 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.172994 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" event={"ID":"1fb2e621-01b9-4771-b86f-80eb6b753f8c","Type":"ContainerStarted","Data":"77a0af6a91fe7cd31228cbc4d40be13917539f0a9b2fc677cb3e7d47bc908b7e"} Jun 02 16:50:57.309396 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.309372 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv"] Jun 02 16:50:57.312903 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.312886 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.320318 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.320296 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv"] Jun 02 16:50:57.414033 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.413976 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.414033 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.414017 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.414173 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.414036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rslc\" (UniqueName: \"kubernetes.io/projected/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-kube-api-access-5rslc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.515162 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.515139 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.515260 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.515182 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.515260 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.515206 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rslc\" (UniqueName: \"kubernetes.io/projected/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-kube-api-access-5rslc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.515481 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.515465 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.515566 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.515547 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.524156 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.524132 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rslc\" (UniqueName: \"kubernetes.io/projected/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-kube-api-access-5rslc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.627674 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.627632 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:50:57.748644 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.748620 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv"] Jun 02 16:50:57.750701 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:50:57.750670 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57dc8adc_07e3_4c53_9e60_f7c8d33c5c4e.slice/crio-b7cb0a5b6b15c17510c9c947c769d5afbc1a4c2fbc4c0efe2f9b81b60e6ea186 WatchSource:0}: Error finding container b7cb0a5b6b15c17510c9c947c769d5afbc1a4c2fbc4c0efe2f9b81b60e6ea186: Status 404 returned error can't find the container with id b7cb0a5b6b15c17510c9c947c769d5afbc1a4c2fbc4c0efe2f9b81b60e6ea186 Jun 02 16:50:57.917414 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.917390 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd"] Jun 02 16:50:57.920627 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.920611 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:57.930353 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:57.930335 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd"] Jun 02 16:50:58.018872 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.018851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.018961 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.018896 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmmnx\" (UniqueName: \"kubernetes.io/projected/8d2ababf-e383-4437-b2fd-bd55cffaaa97-kube-api-access-dmmnx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.019000 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.018981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.119362 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.119340 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmmnx\" (UniqueName: \"kubernetes.io/projected/8d2ababf-e383-4437-b2fd-bd55cffaaa97-kube-api-access-dmmnx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.119470 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.119386 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.119470 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.119424 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.119665 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.119635 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.119743 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.119728 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.128330 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.128313 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmmnx\" (UniqueName: \"kubernetes.io/projected/8d2ababf-e383-4437-b2fd-bd55cffaaa97-kube-api-access-dmmnx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.177941 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.177885 2555 generic.go:358] "Generic (PLEG): container finished" podID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerID="41c0cd4b5d80553527252ae72805607043db85f01ef24e4c908ce58585b436d5" exitCode=0 Jun 02 16:50:58.178022 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.177975 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" event={"ID":"1fb2e621-01b9-4771-b86f-80eb6b753f8c","Type":"ContainerDied","Data":"41c0cd4b5d80553527252ae72805607043db85f01ef24e4c908ce58585b436d5"} Jun 02 16:50:58.179420 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.179401 2555 generic.go:358] "Generic (PLEG): container finished" podID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerID="b1cf9e7dc4089ab6f14b34a7ab39425d8d71e79edcf72241d14bb6a53e15b006" exitCode=0 Jun 02 16:50:58.179505 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.179492 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" event={"ID":"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e","Type":"ContainerDied","Data":"b1cf9e7dc4089ab6f14b34a7ab39425d8d71e79edcf72241d14bb6a53e15b006"} Jun 02 16:50:58.179554 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.179515 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" event={"ID":"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e","Type":"ContainerStarted","Data":"b7cb0a5b6b15c17510c9c947c769d5afbc1a4c2fbc4c0efe2f9b81b60e6ea186"} Jun 02 16:50:58.181324 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.181305 2555 generic.go:358] "Generic (PLEG): container finished" podID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerID="f9aa1f1d7e7f7237560dc650e41b23ee6f2b4584bc5f250f9c5651e47abbb8ed" exitCode=0 Jun 02 16:50:58.181421 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.181333 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" event={"ID":"e1a54b55-5b0a-4f00-87e8-1a17faa6516c","Type":"ContainerDied","Data":"f9aa1f1d7e7f7237560dc650e41b23ee6f2b4584bc5f250f9c5651e47abbb8ed"} Jun 02 16:50:58.229931 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.229906 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:50:58.362008 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:58.361981 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd"] Jun 02 16:50:58.365510 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:50:58.365484 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2ababf_e383_4437_b2fd_bd55cffaaa97.slice/crio-640311df08b9dfc1ff591dd8945f0d016949a9ca81d7715791dce9407fcdeea0 WatchSource:0}: Error finding container 640311df08b9dfc1ff591dd8945f0d016949a9ca81d7715791dce9407fcdeea0: Status 404 returned error can't find the container with id 640311df08b9dfc1ff591dd8945f0d016949a9ca81d7715791dce9407fcdeea0 Jun 02 16:50:58.491409 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:50:58.491381 2555 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2ababf_e383_4437_b2fd_bd55cffaaa97.slice/crio-conmon-785d54dea8bd416a8a670b5963874872c1a32f7a9ad428386636df04ddd0b868.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2ababf_e383_4437_b2fd_bd55cffaaa97.slice/crio-785d54dea8bd416a8a670b5963874872c1a32f7a9ad428386636df04ddd0b868.scope\": RecentStats: unable to find data in memory cache]" Jun 02 16:50:59.186529 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.186497 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerID="785d54dea8bd416a8a670b5963874872c1a32f7a9ad428386636df04ddd0b868" exitCode=0 Jun 02 16:50:59.186637 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.186579 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" event={"ID":"8d2ababf-e383-4437-b2fd-bd55cffaaa97","Type":"ContainerDied","Data":"785d54dea8bd416a8a670b5963874872c1a32f7a9ad428386636df04ddd0b868"} Jun 02 16:50:59.186637 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.186611 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" event={"ID":"8d2ababf-e383-4437-b2fd-bd55cffaaa97","Type":"ContainerStarted","Data":"640311df08b9dfc1ff591dd8945f0d016949a9ca81d7715791dce9407fcdeea0"} Jun 02 16:50:59.188305 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.188284 2555 generic.go:358] "Generic (PLEG): container finished" podID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerID="f448f7b4e0aff5955769fcaf0ce81e11bb91c718dc05be0bc650538392d0e51c" exitCode=0 Jun 02 16:50:59.188419 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.188360 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" event={"ID":"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e","Type":"ContainerDied","Data":"f448f7b4e0aff5955769fcaf0ce81e11bb91c718dc05be0bc650538392d0e51c"} Jun 02 16:50:59.190450 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.190424 2555 generic.go:358] "Generic (PLEG): container finished" podID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerID="31db2e2b9e8a1266d6bb4b22d41ee2a3e14da0de5c42e24d8c619970a20aa38a" exitCode=0 Jun 02 16:50:59.190565 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.190521 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" event={"ID":"e1a54b55-5b0a-4f00-87e8-1a17faa6516c","Type":"ContainerDied","Data":"31db2e2b9e8a1266d6bb4b22d41ee2a3e14da0de5c42e24d8c619970a20aa38a"} Jun 02 16:50:59.192135 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.192116 2555 generic.go:358] "Generic (PLEG): container finished" podID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerID="9f20c36cbc20de7f51fcccf69de4b7c3719afe22b61e049b24d1809abbf97d44" exitCode=0 Jun 02 16:50:59.192225 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:50:59.192174 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" event={"ID":"1fb2e621-01b9-4771-b86f-80eb6b753f8c","Type":"ContainerDied","Data":"9f20c36cbc20de7f51fcccf69de4b7c3719afe22b61e049b24d1809abbf97d44"} Jun 02 16:51:00.198833 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.198809 2555 generic.go:358] "Generic (PLEG): container finished" podID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerID="9025dff9c313ee81d7a0841c12249e14ec63f5168ff233a5802e07c4f8a49ba3" exitCode=0 Jun 02 16:51:00.199118 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.198886 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" event={"ID":"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e","Type":"ContainerDied","Data":"9025dff9c313ee81d7a0841c12249e14ec63f5168ff233a5802e07c4f8a49ba3"} Jun 02 16:51:00.200613 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.200594 2555 generic.go:358] "Generic (PLEG): container finished" podID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerID="e93f0c621419258c962e88ceccb5673e2b27d24adae4115c06050d2bf3abffa1" exitCode=0 Jun 02 16:51:00.200713 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.200695 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" event={"ID":"1fb2e621-01b9-4771-b86f-80eb6b753f8c","Type":"ContainerDied","Data":"e93f0c621419258c962e88ceccb5673e2b27d24adae4115c06050d2bf3abffa1"} Jun 02 16:51:00.380210 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.380191 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:51:00.440088 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.440065 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvkgf\" (UniqueName: \"kubernetes.io/projected/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-kube-api-access-zvkgf\") pod \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " Jun 02 16:51:00.440195 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.440111 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-bundle\") pod \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " Jun 02 16:51:00.440195 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.440155 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-util\") pod \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\" (UID: \"e1a54b55-5b0a-4f00-87e8-1a17faa6516c\") " Jun 02 16:51:00.440631 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.440610 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-bundle" (OuterVolumeSpecName: "bundle") pod "e1a54b55-5b0a-4f00-87e8-1a17faa6516c" (UID: "e1a54b55-5b0a-4f00-87e8-1a17faa6516c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:51:00.442233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.442205 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-kube-api-access-zvkgf" (OuterVolumeSpecName: "kube-api-access-zvkgf") pod "e1a54b55-5b0a-4f00-87e8-1a17faa6516c" (UID: "e1a54b55-5b0a-4f00-87e8-1a17faa6516c"). InnerVolumeSpecName "kube-api-access-zvkgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:51:00.445781 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.445731 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-util" (OuterVolumeSpecName: "util") pod "e1a54b55-5b0a-4f00-87e8-1a17faa6516c" (UID: "e1a54b55-5b0a-4f00-87e8-1a17faa6516c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:51:00.541490 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.541469 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:00.541490 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.541490 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvkgf\" (UniqueName: \"kubernetes.io/projected/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-kube-api-access-zvkgf\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:00.541598 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:00.541502 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1a54b55-5b0a-4f00-87e8-1a17faa6516c-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:01.206859 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.206818 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerID="d222225afa090967ee9f9922502548fd2c10b801f5647ec81d68536be590099f" exitCode=0 Jun 02 16:51:01.207384 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.206916 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" event={"ID":"8d2ababf-e383-4437-b2fd-bd55cffaaa97","Type":"ContainerDied","Data":"d222225afa090967ee9f9922502548fd2c10b801f5647ec81d68536be590099f"} Jun 02 16:51:01.209195 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.209158 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" event={"ID":"e1a54b55-5b0a-4f00-87e8-1a17faa6516c","Type":"ContainerDied","Data":"dc9247246785ce223725c816214f2dcc811e866cdb15116962d84e465356945b"} Jun 02 16:51:01.209290 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.209202 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc9247246785ce223725c816214f2dcc811e866cdb15116962d84e465356945b" Jun 02 16:51:01.209290 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.209203 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj" Jun 02 16:51:01.415363 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.415345 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:51:01.419305 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.419284 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:51:01.448995 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.448974 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-util\") pod \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " Jun 02 16:51:01.449119 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.449017 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rslc\" (UniqueName: \"kubernetes.io/projected/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-kube-api-access-5rslc\") pod \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " Jun 02 16:51:01.449119 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.449114 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-bundle\") pod \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " Jun 02 16:51:01.449233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.449148 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-bundle\") pod \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " Jun 02 16:51:01.449233 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.449176 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-util\") pod \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\" (UID: \"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e\") " Jun 02 16:51:01.449338 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.449241 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9lst\" (UniqueName: \"kubernetes.io/projected/1fb2e621-01b9-4771-b86f-80eb6b753f8c-kube-api-access-m9lst\") pod \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\" (UID: \"1fb2e621-01b9-4771-b86f-80eb6b753f8c\") " Jun 02 16:51:01.450196 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.450171 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-bundle" (OuterVolumeSpecName: "bundle") pod "57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" (UID: "57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:51:01.450338 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.450205 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-bundle" (OuterVolumeSpecName: "bundle") pod "1fb2e621-01b9-4771-b86f-80eb6b753f8c" (UID: "1fb2e621-01b9-4771-b86f-80eb6b753f8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:51:01.452631 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.452606 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-kube-api-access-5rslc" (OuterVolumeSpecName: "kube-api-access-5rslc") pod "57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" (UID: "57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e"). InnerVolumeSpecName "kube-api-access-5rslc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:51:01.452733 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.452642 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb2e621-01b9-4771-b86f-80eb6b753f8c-kube-api-access-m9lst" (OuterVolumeSpecName: "kube-api-access-m9lst") pod "1fb2e621-01b9-4771-b86f-80eb6b753f8c" (UID: "1fb2e621-01b9-4771-b86f-80eb6b753f8c"). InnerVolumeSpecName "kube-api-access-m9lst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:51:01.459590 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.459542 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-util" (OuterVolumeSpecName: "util") pod "1fb2e621-01b9-4771-b86f-80eb6b753f8c" (UID: "1fb2e621-01b9-4771-b86f-80eb6b753f8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:51:01.459683 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.459605 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-util" (OuterVolumeSpecName: "util") pod "57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" (UID: "57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:51:01.550264 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.550231 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:01.550264 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.550265 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rslc\" (UniqueName: \"kubernetes.io/projected/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-kube-api-access-5rslc\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:01.550386 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.550275 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:01.550386 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.550284 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1fb2e621-01b9-4771-b86f-80eb6b753f8c-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:01.550386 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.550293 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:01.550386 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:01.550301 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9lst\" (UniqueName: \"kubernetes.io/projected/1fb2e621-01b9-4771-b86f-80eb6b753f8c-kube-api-access-m9lst\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:02.215191 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:02.215152 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" Jun 02 16:51:02.215598 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:02.215156 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv" event={"ID":"57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e","Type":"ContainerDied","Data":"b7cb0a5b6b15c17510c9c947c769d5afbc1a4c2fbc4c0efe2f9b81b60e6ea186"} Jun 02 16:51:02.215598 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:02.215262 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7cb0a5b6b15c17510c9c947c769d5afbc1a4c2fbc4c0efe2f9b81b60e6ea186" Jun 02 16:51:02.216942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:02.216920 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" Jun 02 16:51:02.217078 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:02.216923 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5" event={"ID":"1fb2e621-01b9-4771-b86f-80eb6b753f8c","Type":"ContainerDied","Data":"77a0af6a91fe7cd31228cbc4d40be13917539f0a9b2fc677cb3e7d47bc908b7e"} Jun 02 16:51:02.217078 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:02.217018 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77a0af6a91fe7cd31228cbc4d40be13917539f0a9b2fc677cb3e7d47bc908b7e" Jun 02 16:51:02.226085 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:02.226061 2555 generic.go:358] "Generic (PLEG): container finished" podID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerID="e252e36e594c94821f81474893f99a0c2890d5fafa62204c9ed2eb3b020df357" exitCode=0 Jun 02 16:51:02.226198 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:02.226117 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" event={"ID":"8d2ababf-e383-4437-b2fd-bd55cffaaa97","Type":"ContainerDied","Data":"e252e36e594c94821f81474893f99a0c2890d5fafa62204c9ed2eb3b020df357"} Jun 02 16:51:03.351219 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.351188 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:51:03.465940 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.465908 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-util\") pod \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " Jun 02 16:51:03.466098 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.465949 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-bundle\") pod \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " Jun 02 16:51:03.466098 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.465980 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmmnx\" (UniqueName: \"kubernetes.io/projected/8d2ababf-e383-4437-b2fd-bd55cffaaa97-kube-api-access-dmmnx\") pod \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\" (UID: \"8d2ababf-e383-4437-b2fd-bd55cffaaa97\") " Jun 02 16:51:03.466371 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.466345 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-bundle" (OuterVolumeSpecName: "bundle") pod "8d2ababf-e383-4437-b2fd-bd55cffaaa97" (UID: "8d2ababf-e383-4437-b2fd-bd55cffaaa97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:51:03.468036 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.468012 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2ababf-e383-4437-b2fd-bd55cffaaa97-kube-api-access-dmmnx" (OuterVolumeSpecName: "kube-api-access-dmmnx") pod "8d2ababf-e383-4437-b2fd-bd55cffaaa97" (UID: "8d2ababf-e383-4437-b2fd-bd55cffaaa97"). InnerVolumeSpecName "kube-api-access-dmmnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:51:03.471144 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.471108 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-util" (OuterVolumeSpecName: "util") pod "8d2ababf-e383-4437-b2fd-bd55cffaaa97" (UID: "8d2ababf-e383-4437-b2fd-bd55cffaaa97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:51:03.567452 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.567431 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:03.567452 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.567451 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d2ababf-e383-4437-b2fd-bd55cffaaa97-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:03.567584 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:03.567461 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmmnx\" (UniqueName: \"kubernetes.io/projected/8d2ababf-e383-4437-b2fd-bd55cffaaa97-kube-api-access-dmmnx\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:51:04.236287 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:04.236253 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" event={"ID":"8d2ababf-e383-4437-b2fd-bd55cffaaa97","Type":"ContainerDied","Data":"640311df08b9dfc1ff591dd8945f0d016949a9ca81d7715791dce9407fcdeea0"} Jun 02 16:51:04.236287 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:04.236283 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd" Jun 02 16:51:04.236559 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:04.236288 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="640311df08b9dfc1ff591dd8945f0d016949a9ca81d7715791dce9407fcdeea0" Jun 02 16:51:25.860213 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860175 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-68d7484c79-2jkfw"] Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860498 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerName="pull" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860509 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerName="pull" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860519 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerName="pull" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860525 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerName="pull" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860531 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860536 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860547 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerName="util" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860554 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerName="util" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860562 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860568 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860578 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerName="util" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860583 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerName="util" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860593 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerName="util" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860598 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerName="util" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860605 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerName="pull" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860610 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerName="pull" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860617 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerName="pull" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860621 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerName="pull" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860627 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerName="util" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860634 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerName="util" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860639 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860644 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860665 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860671 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860736 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860746 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fb2e621-01b9-4771-b86f-80eb6b753f8c" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860753 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1a54b55-5b0a-4f00-87e8-1a17faa6516c" containerName="extract" Jun 02 16:51:25.862602 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.860759 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d2ababf-e383-4437-b2fd-bd55cffaaa97" containerName="extract" Jun 02 16:51:25.863628 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.863611 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:25.873377 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.873353 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d7484c79-2jkfw"] Jun 02 16:51:25.933900 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.933876 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-service-ca\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:25.934018 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.933926 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1eec119a-6bc8-4489-9e30-a5384683150d-console-serving-cert\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:25.934018 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.933981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-console-config\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:25.934103 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.934017 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-oauth-serving-cert\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:25.934103 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.934036 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dls9h\" (UniqueName: \"kubernetes.io/projected/1eec119a-6bc8-4489-9e30-a5384683150d-kube-api-access-dls9h\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:25.934103 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.934055 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-trusted-ca-bundle\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:25.934103 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:25.934073 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1eec119a-6bc8-4489-9e30-a5384683150d-console-oauth-config\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.035312 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.035286 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-service-ca\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.035432 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.035337 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1eec119a-6bc8-4489-9e30-a5384683150d-console-serving-cert\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.035432 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.035355 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-console-config\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.035618 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.035595 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-oauth-serving-cert\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.035694 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.035639 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dls9h\" (UniqueName: \"kubernetes.io/projected/1eec119a-6bc8-4489-9e30-a5384683150d-kube-api-access-dls9h\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.035791 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.035694 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-trusted-ca-bundle\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.035791 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.035724 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1eec119a-6bc8-4489-9e30-a5384683150d-console-oauth-config\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.036056 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.036032 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-console-config\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.036129 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.036111 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-service-ca\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.036247 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.036225 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-oauth-serving-cert\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.036569 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.036544 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eec119a-6bc8-4489-9e30-a5384683150d-trusted-ca-bundle\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.037972 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.037944 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1eec119a-6bc8-4489-9e30-a5384683150d-console-serving-cert\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.038167 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.038145 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1eec119a-6bc8-4489-9e30-a5384683150d-console-oauth-config\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.044199 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.044175 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dls9h\" (UniqueName: \"kubernetes.io/projected/1eec119a-6bc8-4489-9e30-a5384683150d-kube-api-access-dls9h\") pod \"console-68d7484c79-2jkfw\" (UID: \"1eec119a-6bc8-4489-9e30-a5384683150d\") " pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.173963 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.173908 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:26.303234 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.303205 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d7484c79-2jkfw"] Jun 02 16:51:26.304950 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:51:26.304922 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eec119a_6bc8_4489_9e30_a5384683150d.slice/crio-fd8cc6454fbfff83d3cf0a8ae6db35b10b41a10db0beb27c964413cb376eb520 WatchSource:0}: Error finding container fd8cc6454fbfff83d3cf0a8ae6db35b10b41a10db0beb27c964413cb376eb520: Status 404 returned error can't find the container with id fd8cc6454fbfff83d3cf0a8ae6db35b10b41a10db0beb27c964413cb376eb520 Jun 02 16:51:26.322477 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:26.322455 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d7484c79-2jkfw" event={"ID":"1eec119a-6bc8-4489-9e30-a5384683150d","Type":"ContainerStarted","Data":"fd8cc6454fbfff83d3cf0a8ae6db35b10b41a10db0beb27c964413cb376eb520"} Jun 02 16:51:27.327557 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:27.327522 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d7484c79-2jkfw" event={"ID":"1eec119a-6bc8-4489-9e30-a5384683150d","Type":"ContainerStarted","Data":"52091400af0c81cdcb0a6ddd2426188f6c50ee772552358758e5fe029b597eb2"} Jun 02 16:51:27.345811 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:27.345768 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-68d7484c79-2jkfw" podStartSLOduration=2.345754013 podStartE2EDuration="2.345754013s" podCreationTimestamp="2026-06-02 16:51:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:51:27.34407295 +0000 UTC m=+610.629351687" watchObservedRunningTime="2026-06-02 16:51:27.345754013 +0000 UTC m=+610.631032762" Jun 02 16:51:36.174909 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:36.174878 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:36.175352 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:36.174960 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:36.179402 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:36.179377 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:36.369367 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:36.369339 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68d7484c79-2jkfw" Jun 02 16:51:36.421339 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:51:36.421310 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c56df567-8vsxb"] Jun 02 16:52:01.448452 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.448389 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-77c56df567-8vsxb" podUID="0139b892-ccd4-418a-8ecb-e822c9691d28" containerName="console" containerID="cri-o://d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a" gracePeriod=15 Jun 02 16:52:01.693313 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.693289 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77c56df567-8vsxb_0139b892-ccd4-418a-8ecb-e822c9691d28/console/0.log" Jun 02 16:52:01.693412 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.693353 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:52:01.802407 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802383 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-service-ca\") pod \"0139b892-ccd4-418a-8ecb-e822c9691d28\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " Jun 02 16:52:01.802553 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802427 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-serving-cert\") pod \"0139b892-ccd4-418a-8ecb-e822c9691d28\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " Jun 02 16:52:01.802553 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802453 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llpjh\" (UniqueName: \"kubernetes.io/projected/0139b892-ccd4-418a-8ecb-e822c9691d28-kube-api-access-llpjh\") pod \"0139b892-ccd4-418a-8ecb-e822c9691d28\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " Jun 02 16:52:01.802553 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802520 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-trusted-ca-bundle\") pod \"0139b892-ccd4-418a-8ecb-e822c9691d28\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " Jun 02 16:52:01.802742 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802565 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-console-config\") pod \"0139b892-ccd4-418a-8ecb-e822c9691d28\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " Jun 02 16:52:01.802742 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802588 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-oauth-config\") pod \"0139b892-ccd4-418a-8ecb-e822c9691d28\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " Jun 02 16:52:01.802742 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802613 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-oauth-serving-cert\") pod \"0139b892-ccd4-418a-8ecb-e822c9691d28\" (UID: \"0139b892-ccd4-418a-8ecb-e822c9691d28\") " Jun 02 16:52:01.802935 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802801 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-service-ca" (OuterVolumeSpecName: "service-ca") pod "0139b892-ccd4-418a-8ecb-e822c9691d28" (UID: "0139b892-ccd4-418a-8ecb-e822c9691d28"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:52:01.803023 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.802997 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-console-config" (OuterVolumeSpecName: "console-config") pod "0139b892-ccd4-418a-8ecb-e822c9691d28" (UID: "0139b892-ccd4-418a-8ecb-e822c9691d28"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:52:01.803124 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.803026 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0139b892-ccd4-418a-8ecb-e822c9691d28" (UID: "0139b892-ccd4-418a-8ecb-e822c9691d28"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:52:01.803201 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.803178 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0139b892-ccd4-418a-8ecb-e822c9691d28" (UID: "0139b892-ccd4-418a-8ecb-e822c9691d28"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:52:01.804720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.804694 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0139b892-ccd4-418a-8ecb-e822c9691d28" (UID: "0139b892-ccd4-418a-8ecb-e822c9691d28"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:52:01.804720 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.804714 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0139b892-ccd4-418a-8ecb-e822c9691d28" (UID: "0139b892-ccd4-418a-8ecb-e822c9691d28"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 16:52:01.804884 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.804849 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0139b892-ccd4-418a-8ecb-e822c9691d28-kube-api-access-llpjh" (OuterVolumeSpecName: "kube-api-access-llpjh") pod "0139b892-ccd4-418a-8ecb-e822c9691d28" (UID: "0139b892-ccd4-418a-8ecb-e822c9691d28"). InnerVolumeSpecName "kube-api-access-llpjh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:52:01.903754 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.903732 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-trusted-ca-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:52:01.903754 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.903753 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-console-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:52:01.903887 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.903762 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-oauth-config\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:52:01.903887 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.903773 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-oauth-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:52:01.903887 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.903782 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0139b892-ccd4-418a-8ecb-e822c9691d28-service-ca\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:52:01.903887 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.903791 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0139b892-ccd4-418a-8ecb-e822c9691d28-console-serving-cert\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:52:01.903887 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:01.903809 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llpjh\" (UniqueName: \"kubernetes.io/projected/0139b892-ccd4-418a-8ecb-e822c9691d28-kube-api-access-llpjh\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:52:02.468750 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.468720 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77c56df567-8vsxb_0139b892-ccd4-418a-8ecb-e822c9691d28/console/0.log" Jun 02 16:52:02.469170 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.468767 2555 generic.go:358] "Generic (PLEG): container finished" podID="0139b892-ccd4-418a-8ecb-e822c9691d28" containerID="d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a" exitCode=2 Jun 02 16:52:02.469170 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.468799 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c56df567-8vsxb" event={"ID":"0139b892-ccd4-418a-8ecb-e822c9691d28","Type":"ContainerDied","Data":"d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a"} Jun 02 16:52:02.469170 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.468840 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c56df567-8vsxb" Jun 02 16:52:02.469170 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.468859 2555 scope.go:117] "RemoveContainer" containerID="d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a" Jun 02 16:52:02.469170 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.468846 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c56df567-8vsxb" event={"ID":"0139b892-ccd4-418a-8ecb-e822c9691d28","Type":"ContainerDied","Data":"f83c912270eea8292f466b586e23d2ac12227bea0d0facb2198bf9a83d6860e8"} Jun 02 16:52:02.479752 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.479732 2555 scope.go:117] "RemoveContainer" containerID="d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a" Jun 02 16:52:02.480056 ip-10-0-130-253 kubenswrapper[2555]: E0602 16:52:02.480036 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a\": container with ID starting with d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a not found: ID does not exist" containerID="d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a" Jun 02 16:52:02.480132 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.480063 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a"} err="failed to get container status \"d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a\": rpc error: code = NotFound desc = could not find container \"d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a\": container with ID starting with d3200cac281d83d3a4603ff994339636c8f9ffee45e6b156c8dd6220212f0f8a not found: ID does not exist" Jun 02 16:52:02.515422 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.515392 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c56df567-8vsxb"] Jun 02 16:52:02.524721 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:02.524696 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77c56df567-8vsxb"] Jun 02 16:52:03.294793 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:03.294761 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0139b892-ccd4-418a-8ecb-e822c9691d28" path="/var/lib/kubelet/pods/0139b892-ccd4-418a-8ecb-e822c9691d28/volumes" Jun 02 16:52:37.564006 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.563976 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8"] Jun 02 16:52:37.564414 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.564293 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0139b892-ccd4-418a-8ecb-e822c9691d28" containerName="console" Jun 02 16:52:37.564414 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.564303 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0139b892-ccd4-418a-8ecb-e822c9691d28" containerName="console" Jun 02 16:52:37.564414 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.564376 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="0139b892-ccd4-418a-8ecb-e822c9691d28" containerName="console" Jun 02 16:52:37.569801 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.569420 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.574049 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.574026 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mnlth\"" Jun 02 16:52:37.579765 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.579739 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8"] Jun 02 16:52:37.677735 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677705 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.677855 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677737 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.677855 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.677855 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677808 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.677855 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677826 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmd72\" (UniqueName: \"kubernetes.io/projected/c6c9c75c-e1d1-44b2-9399-e2f30375a696-kube-api-access-cmd72\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.677987 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.677987 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677918 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.677987 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.678080 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.677989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778461 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778428 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778623 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778473 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778623 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778503 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778623 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778522 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778623 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778551 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778623 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778568 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778623 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778590 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmd72\" (UniqueName: \"kubernetes.io/projected/c6c9c75c-e1d1-44b2-9399-e2f30375a696-kube-api-access-cmd72\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778955 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778643 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778955 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778836 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.778955 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.778875 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.779264 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.779236 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.779383 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.779244 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.779383 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.779331 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.779469 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.779404 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.781186 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.781156 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.781273 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.781243 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.786742 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.786717 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6c9c75c-e1d1-44b2-9399-e2f30375a696-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.786894 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.786878 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmd72\" (UniqueName: \"kubernetes.io/projected/c6c9c75c-e1d1-44b2-9399-e2f30375a696-kube-api-access-cmd72\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-s98l8\" (UID: \"c6c9c75c-e1d1-44b2-9399-e2f30375a696\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:37.887607 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:37.887549 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:38.026869 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:38.026842 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8"] Jun 02 16:52:38.027913 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:52:38.027882 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6c9c75c_e1d1_44b2_9399_e2f30375a696.slice/crio-192cf31e2002edbad0635dbc67c1cd1b2609df249badcf31679adb25b53cfae4 WatchSource:0}: Error finding container 192cf31e2002edbad0635dbc67c1cd1b2609df249badcf31679adb25b53cfae4: Status 404 returned error can't find the container with id 192cf31e2002edbad0635dbc67c1cd1b2609df249badcf31679adb25b53cfae4 Jun 02 16:52:38.030155 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:38.030137 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:52:38.616704 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:38.616668 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" event={"ID":"c6c9c75c-e1d1-44b2-9399-e2f30375a696","Type":"ContainerStarted","Data":"192cf31e2002edbad0635dbc67c1cd1b2609df249badcf31679adb25b53cfae4"} Jun 02 16:52:40.804345 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:40.804304 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 16:52:40.804630 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:40.804378 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 16:52:40.804630 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:40.804408 2555 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 16:52:41.633724 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:41.633688 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" event={"ID":"c6c9c75c-e1d1-44b2-9399-e2f30375a696","Type":"ContainerStarted","Data":"3e70a8fbca5ab29f3efba75b96ff9f10302ec590bf4310286e773b372e6bb795"} Jun 02 16:52:41.656113 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:41.656064 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" podStartSLOduration=1.8822402120000001 podStartE2EDuration="4.656049269s" podCreationTimestamp="2026-06-02 16:52:37 +0000 UTC" firstStartedPulling="2026-06-02 16:52:38.03026611 +0000 UTC m=+681.315544824" lastFinishedPulling="2026-06-02 16:52:40.804075162 +0000 UTC m=+684.089353881" observedRunningTime="2026-06-02 16:52:41.653604187 +0000 UTC m=+684.938882927" watchObservedRunningTime="2026-06-02 16:52:41.656049269 +0000 UTC m=+684.941328004" Jun 02 16:52:41.888192 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:41.888116 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:41.892721 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:41.892698 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:42.638459 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:42.638421 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:42.639566 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:42.639538 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-s98l8" Jun 02 16:52:52.042054 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.042011 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-t8hq4"] Jun 02 16:52:52.045634 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.045615 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:52.048593 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.048565 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 16:52:52.048768 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.048667 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 16:52:52.048768 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.048689 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 16:52:52.048768 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.048756 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6g5tq\"" Jun 02 16:52:52.055065 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.055038 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-t8hq4"] Jun 02 16:52:52.108506 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.108469 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-t8hq4"] Jun 02 16:52:52.195977 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.195946 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj9bv\" (UniqueName: \"kubernetes.io/projected/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-kube-api-access-hj9bv\") pod \"limitador-limitador-7d549b5b-t8hq4\" (UID: \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:52.196116 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.196006 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-config-file\") pod \"limitador-limitador-7d549b5b-t8hq4\" (UID: \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:52.296590 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.296516 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hj9bv\" (UniqueName: \"kubernetes.io/projected/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-kube-api-access-hj9bv\") pod \"limitador-limitador-7d549b5b-t8hq4\" (UID: \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:52.296590 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.296574 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-config-file\") pod \"limitador-limitador-7d549b5b-t8hq4\" (UID: \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:52.297146 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.297126 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-config-file\") pod \"limitador-limitador-7d549b5b-t8hq4\" (UID: \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:52.304897 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.304875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj9bv\" (UniqueName: \"kubernetes.io/projected/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-kube-api-access-hj9bv\") pod \"limitador-limitador-7d549b5b-t8hq4\" (UID: \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\") " pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:52.358376 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.358355 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:52.485140 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.485115 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-t8hq4"] Jun 02 16:52:52.486941 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:52:52.486917 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d0c8a3_dfd2_4b00_b992_3776d6acc33a.slice/crio-42e25558b6b5c225ac9dba9fffe484e98bfdd8462474df1ad866ce976b309f37 WatchSource:0}: Error finding container 42e25558b6b5c225ac9dba9fffe484e98bfdd8462474df1ad866ce976b309f37: Status 404 returned error can't find the container with id 42e25558b6b5c225ac9dba9fffe484e98bfdd8462474df1ad866ce976b309f37 Jun 02 16:52:52.675539 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:52.675468 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" event={"ID":"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a","Type":"ContainerStarted","Data":"42e25558b6b5c225ac9dba9fffe484e98bfdd8462474df1ad866ce976b309f37"} Jun 02 16:52:55.688238 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:55.688168 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" event={"ID":"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a","Type":"ContainerStarted","Data":"4867b7519508501de780877998e78e16f9fcc1e71d90271babc0ee0eb4a969e5"} Jun 02 16:52:55.688556 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:55.688286 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:52:55.706857 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:52:55.706812 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" podStartSLOduration=1.087650877 podStartE2EDuration="3.706798012s" podCreationTimestamp="2026-06-02 16:52:52 +0000 UTC" firstStartedPulling="2026-06-02 16:52:52.489029604 +0000 UTC m=+695.774308318" lastFinishedPulling="2026-06-02 16:52:55.108176738 +0000 UTC m=+698.393455453" observedRunningTime="2026-06-02 16:52:55.703401946 +0000 UTC m=+698.988680681" watchObservedRunningTime="2026-06-02 16:52:55.706798012 +0000 UTC m=+698.992076783" Jun 02 16:53:06.694640 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:06.694554 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:53:06.827122 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:06.827079 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-t8hq4"] Jun 02 16:53:06.827292 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:06.827269 2555 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" podUID="d6d0c8a3-dfd2-4b00-b992-3776d6acc33a" containerName="limitador" containerID="cri-o://4867b7519508501de780877998e78e16f9fcc1e71d90271babc0ee0eb4a969e5" gracePeriod=30 Jun 02 16:53:07.742363 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:07.742331 2555 generic.go:358] "Generic (PLEG): container finished" podID="d6d0c8a3-dfd2-4b00-b992-3776d6acc33a" containerID="4867b7519508501de780877998e78e16f9fcc1e71d90271babc0ee0eb4a969e5" exitCode=0 Jun 02 16:53:07.742709 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:07.742407 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" event={"ID":"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a","Type":"ContainerDied","Data":"4867b7519508501de780877998e78e16f9fcc1e71d90271babc0ee0eb4a969e5"} Jun 02 16:53:07.776868 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:07.776850 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:53:07.922572 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:07.922509 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-config-file\") pod \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\" (UID: \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\") " Jun 02 16:53:07.922708 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:07.922625 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hj9bv\" (UniqueName: \"kubernetes.io/projected/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-kube-api-access-hj9bv\") pod \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\" (UID: \"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a\") " Jun 02 16:53:07.922869 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:07.922847 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-config-file" (OuterVolumeSpecName: "config-file") pod "d6d0c8a3-dfd2-4b00-b992-3776d6acc33a" (UID: "d6d0c8a3-dfd2-4b00-b992-3776d6acc33a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 16:53:07.924614 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:07.924593 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-kube-api-access-hj9bv" (OuterVolumeSpecName: "kube-api-access-hj9bv") pod "d6d0c8a3-dfd2-4b00-b992-3776d6acc33a" (UID: "d6d0c8a3-dfd2-4b00-b992-3776d6acc33a"). InnerVolumeSpecName "kube-api-access-hj9bv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:53:08.023806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.023774 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj9bv\" (UniqueName: \"kubernetes.io/projected/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-kube-api-access-hj9bv\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:53:08.023806 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.023806 2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a-config-file\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:53:08.638325 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.638293 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-cjn6s"] Jun 02 16:53:08.638707 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.638689 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6d0c8a3-dfd2-4b00-b992-3776d6acc33a" containerName="limitador" Jun 02 16:53:08.638707 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.638706 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6d0c8a3-dfd2-4b00-b992-3776d6acc33a" containerName="limitador" Jun 02 16:53:08.638867 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.638771 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="d6d0c8a3-dfd2-4b00-b992-3776d6acc33a" containerName="limitador" Jun 02 16:53:08.641588 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.641568 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:08.644234 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.644214 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 16:53:08.650901 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.650878 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-cjn6s"] Jun 02 16:53:08.746794 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.746767 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" Jun 02 16:53:08.747163 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.746795 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-t8hq4" event={"ID":"d6d0c8a3-dfd2-4b00-b992-3776d6acc33a","Type":"ContainerDied","Data":"42e25558b6b5c225ac9dba9fffe484e98bfdd8462474df1ad866ce976b309f37"} Jun 02 16:53:08.747163 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.746842 2555 scope.go:117] "RemoveContainer" containerID="4867b7519508501de780877998e78e16f9fcc1e71d90271babc0ee0eb4a969e5" Jun 02 16:53:08.771363 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.771337 2555 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-t8hq4"] Jun 02 16:53:08.775347 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.775325 2555 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-t8hq4"] Jun 02 16:53:08.830404 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.830383 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls5k6\" (UniqueName: \"kubernetes.io/projected/34988c02-73e8-42f2-a553-e120b27db5be-kube-api-access-ls5k6\") pod \"postgres-68c4fbbd6f-cjn6s\" (UID: \"34988c02-73e8-42f2-a553-e120b27db5be\") " pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:08.830504 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.830421 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/34988c02-73e8-42f2-a553-e120b27db5be-data\") pod \"postgres-68c4fbbd6f-cjn6s\" (UID: \"34988c02-73e8-42f2-a553-e120b27db5be\") " pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:08.931848 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.931776 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/34988c02-73e8-42f2-a553-e120b27db5be-data\") pod \"postgres-68c4fbbd6f-cjn6s\" (UID: \"34988c02-73e8-42f2-a553-e120b27db5be\") " pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:08.931954 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.931870 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ls5k6\" (UniqueName: \"kubernetes.io/projected/34988c02-73e8-42f2-a553-e120b27db5be-kube-api-access-ls5k6\") pod \"postgres-68c4fbbd6f-cjn6s\" (UID: \"34988c02-73e8-42f2-a553-e120b27db5be\") " pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:08.932125 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.932107 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/34988c02-73e8-42f2-a553-e120b27db5be-data\") pod \"postgres-68c4fbbd6f-cjn6s\" (UID: \"34988c02-73e8-42f2-a553-e120b27db5be\") " pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:08.940225 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.940200 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls5k6\" (UniqueName: \"kubernetes.io/projected/34988c02-73e8-42f2-a553-e120b27db5be-kube-api-access-ls5k6\") pod \"postgres-68c4fbbd6f-cjn6s\" (UID: \"34988c02-73e8-42f2-a553-e120b27db5be\") " pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:08.954135 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:08.954117 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:09.099696 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:09.099671 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-cjn6s"] Jun 02 16:53:09.101706 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:53:09.101677 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34988c02_73e8_42f2_a553_e120b27db5be.slice/crio-a09b4c6516e4c5514f85f9ecb1072924ab8b554293ae3b236765c56486ceb0bd WatchSource:0}: Error finding container a09b4c6516e4c5514f85f9ecb1072924ab8b554293ae3b236765c56486ceb0bd: Status 404 returned error can't find the container with id a09b4c6516e4c5514f85f9ecb1072924ab8b554293ae3b236765c56486ceb0bd Jun 02 16:53:09.294600 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:09.294571 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6d0c8a3-dfd2-4b00-b992-3776d6acc33a" path="/var/lib/kubelet/pods/d6d0c8a3-dfd2-4b00-b992-3776d6acc33a/volumes" Jun 02 16:53:09.751942 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:09.751868 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-cjn6s" event={"ID":"34988c02-73e8-42f2-a553-e120b27db5be","Type":"ContainerStarted","Data":"a09b4c6516e4c5514f85f9ecb1072924ab8b554293ae3b236765c56486ceb0bd"} Jun 02 16:53:12.767791 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:12.767749 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-cjn6s" event={"ID":"34988c02-73e8-42f2-a553-e120b27db5be","Type":"ContainerStarted","Data":"414baa2d769aa075d2c3843d0a2b2e92fe3b6f537010116efaff31597c25c4aa"} Jun 02 16:53:12.768192 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:12.767954 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:12.785927 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:12.785883 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-cjn6s" podStartSLOduration=1.7168459619999998 podStartE2EDuration="4.785871176s" podCreationTimestamp="2026-06-02 16:53:08 +0000 UTC" firstStartedPulling="2026-06-02 16:53:09.102938224 +0000 UTC m=+712.388216938" lastFinishedPulling="2026-06-02 16:53:12.171963438 +0000 UTC m=+715.457242152" observedRunningTime="2026-06-02 16:53:12.782843466 +0000 UTC m=+716.068122201" watchObservedRunningTime="2026-06-02 16:53:12.785871176 +0000 UTC m=+716.071149948" Jun 02 16:53:18.801426 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:18.801397 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-cjn6s" Jun 02 16:53:20.229743 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.229709 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k"] Jun 02 16:53:20.234748 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.234728 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.237841 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.237818 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 16:53:20.239036 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.239007 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 16:53:20.239036 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.239006 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w7jbk\"" Jun 02 16:53:20.241010 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.240986 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k"] Jun 02 16:53:20.324535 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.324508 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmw7q\" (UniqueName: \"kubernetes.io/projected/5be1e071-3f64-4e53-b77f-8342d035f25f-kube-api-access-jmw7q\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.324641 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.324542 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.324641 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.324571 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.425484 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.425458 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmw7q\" (UniqueName: \"kubernetes.io/projected/5be1e071-3f64-4e53-b77f-8342d035f25f-kube-api-access-jmw7q\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.425584 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.425492 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.425584 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.425521 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.425928 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.425908 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.425971 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.425917 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.435236 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.435211 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmw7q\" (UniqueName: \"kubernetes.io/projected/5be1e071-3f64-4e53-b77f-8342d035f25f-kube-api-access-jmw7q\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.545304 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.545285 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:20.673006 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.672978 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k"] Jun 02 16:53:20.675307 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:53:20.675279 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be1e071_3f64_4e53_b77f_8342d035f25f.slice/crio-4d18a13515ed459c4cfee85448ebaa2d3067db147ead5c13fb845ef9f67077e8 WatchSource:0}: Error finding container 4d18a13515ed459c4cfee85448ebaa2d3067db147ead5c13fb845ef9f67077e8: Status 404 returned error can't find the container with id 4d18a13515ed459c4cfee85448ebaa2d3067db147ead5c13fb845ef9f67077e8 Jun 02 16:53:20.801440 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.801377 2555 generic.go:358] "Generic (PLEG): container finished" podID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerID="4ba0e97b7523d97d39ae634c366f75d7fb0b277d727758ebb31a2a49ee5d12c7" exitCode=0 Jun 02 16:53:20.801556 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.801430 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" event={"ID":"5be1e071-3f64-4e53-b77f-8342d035f25f","Type":"ContainerDied","Data":"4ba0e97b7523d97d39ae634c366f75d7fb0b277d727758ebb31a2a49ee5d12c7"} Jun 02 16:53:20.801556 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:20.801465 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" event={"ID":"5be1e071-3f64-4e53-b77f-8342d035f25f","Type":"ContainerStarted","Data":"4d18a13515ed459c4cfee85448ebaa2d3067db147ead5c13fb845ef9f67077e8"} Jun 02 16:53:21.806938 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:21.806909 2555 generic.go:358] "Generic (PLEG): container finished" podID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerID="eb26135fc2dda45bd611e67fa1b28e7253c954c4692beb01699b4457208d2491" exitCode=0 Jun 02 16:53:21.807363 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:21.806998 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" event={"ID":"5be1e071-3f64-4e53-b77f-8342d035f25f","Type":"ContainerDied","Data":"eb26135fc2dda45bd611e67fa1b28e7253c954c4692beb01699b4457208d2491"} Jun 02 16:53:22.813429 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:22.813393 2555 generic.go:358] "Generic (PLEG): container finished" podID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerID="59ed56f7fe1ff744042b7af68490c7ff90dd6748c7caed224260bbe359ed4f8d" exitCode=0 Jun 02 16:53:22.813872 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:22.813468 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" event={"ID":"5be1e071-3f64-4e53-b77f-8342d035f25f","Type":"ContainerDied","Data":"59ed56f7fe1ff744042b7af68490c7ff90dd6748c7caed224260bbe359ed4f8d"} Jun 02 16:53:23.944270 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:23.944250 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:24.052875 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.052847 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmw7q\" (UniqueName: \"kubernetes.io/projected/5be1e071-3f64-4e53-b77f-8342d035f25f-kube-api-access-jmw7q\") pod \"5be1e071-3f64-4e53-b77f-8342d035f25f\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " Jun 02 16:53:24.053000 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.052890 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-util\") pod \"5be1e071-3f64-4e53-b77f-8342d035f25f\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " Jun 02 16:53:24.053000 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.052909 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-bundle\") pod \"5be1e071-3f64-4e53-b77f-8342d035f25f\" (UID: \"5be1e071-3f64-4e53-b77f-8342d035f25f\") " Jun 02 16:53:24.053409 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.053386 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-bundle" (OuterVolumeSpecName: "bundle") pod "5be1e071-3f64-4e53-b77f-8342d035f25f" (UID: "5be1e071-3f64-4e53-b77f-8342d035f25f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:53:24.054912 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.054887 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5be1e071-3f64-4e53-b77f-8342d035f25f-kube-api-access-jmw7q" (OuterVolumeSpecName: "kube-api-access-jmw7q") pod "5be1e071-3f64-4e53-b77f-8342d035f25f" (UID: "5be1e071-3f64-4e53-b77f-8342d035f25f"). InnerVolumeSpecName "kube-api-access-jmw7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 16:53:24.058295 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.058274 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-util" (OuterVolumeSpecName: "util") pod "5be1e071-3f64-4e53-b77f-8342d035f25f" (UID: "5be1e071-3f64-4e53-b77f-8342d035f25f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 16:53:24.153523 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.153471 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmw7q\" (UniqueName: \"kubernetes.io/projected/5be1e071-3f64-4e53-b77f-8342d035f25f-kube-api-access-jmw7q\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:53:24.153523 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.153493 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-util\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:53:24.153523 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.153502 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5be1e071-3f64-4e53-b77f-8342d035f25f-bundle\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 16:53:24.823590 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.823558 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" event={"ID":"5be1e071-3f64-4e53-b77f-8342d035f25f","Type":"ContainerDied","Data":"4d18a13515ed459c4cfee85448ebaa2d3067db147ead5c13fb845ef9f67077e8"} Jun 02 16:53:24.823590 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.823593 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d18a13515ed459c4cfee85448ebaa2d3067db147ead5c13fb845ef9f67077e8" Jun 02 16:53:24.823821 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:24.823600 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a705b59k" Jun 02 16:53:27.492531 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.492493 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-hlbwl"] Jun 02 16:53:27.492922 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.492832 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerName="util" Jun 02 16:53:27.492922 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.492844 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerName="util" Jun 02 16:53:27.492922 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.492854 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerName="pull" Jun 02 16:53:27.492922 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.492860 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerName="pull" Jun 02 16:53:27.492922 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.492882 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerName="extract" Jun 02 16:53:27.492922 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.492887 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerName="extract" Jun 02 16:53:27.493104 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.492936 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="5be1e071-3f64-4e53-b77f-8342d035f25f" containerName="extract" Jun 02 16:53:27.500788 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.500762 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-hlbwl" Jun 02 16:53:27.503638 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.503609 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 16:53:27.503775 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.503642 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-2h2cj\"" Jun 02 16:53:27.504035 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.503815 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-hlbwl"] Jun 02 16:53:27.504790 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.504771 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 16:53:27.577718 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.577687 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr5zw\" (UniqueName: \"kubernetes.io/projected/d2e559b7-dedc-4959-a1dd-8c5b697475a0-kube-api-access-vr5zw\") pod \"keycloak-operator-7864d68cbd-hlbwl\" (UID: \"d2e559b7-dedc-4959-a1dd-8c5b697475a0\") " pod="keycloak-system/keycloak-operator-7864d68cbd-hlbwl" Jun 02 16:53:27.678887 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.678863 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vr5zw\" (UniqueName: \"kubernetes.io/projected/d2e559b7-dedc-4959-a1dd-8c5b697475a0-kube-api-access-vr5zw\") pod \"keycloak-operator-7864d68cbd-hlbwl\" (UID: \"d2e559b7-dedc-4959-a1dd-8c5b697475a0\") " pod="keycloak-system/keycloak-operator-7864d68cbd-hlbwl" Jun 02 16:53:27.687821 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.687798 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr5zw\" (UniqueName: \"kubernetes.io/projected/d2e559b7-dedc-4959-a1dd-8c5b697475a0-kube-api-access-vr5zw\") pod \"keycloak-operator-7864d68cbd-hlbwl\" (UID: \"d2e559b7-dedc-4959-a1dd-8c5b697475a0\") " pod="keycloak-system/keycloak-operator-7864d68cbd-hlbwl" Jun 02 16:53:27.812455 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.812431 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-hlbwl" Jun 02 16:53:27.937552 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:27.937529 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-hlbwl"] Jun 02 16:53:27.939003 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:53:27.938978 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e559b7_dedc_4959_a1dd_8c5b697475a0.slice/crio-5daca07575abddfa241e7f8f543b0e1797d02020eb32fb4a9cbaad3e46d7b505 WatchSource:0}: Error finding container 5daca07575abddfa241e7f8f543b0e1797d02020eb32fb4a9cbaad3e46d7b505: Status 404 returned error can't find the container with id 5daca07575abddfa241e7f8f543b0e1797d02020eb32fb4a9cbaad3e46d7b505 Jun 02 16:53:28.842145 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:28.842108 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-hlbwl" event={"ID":"d2e559b7-dedc-4959-a1dd-8c5b697475a0","Type":"ContainerStarted","Data":"5daca07575abddfa241e7f8f543b0e1797d02020eb32fb4a9cbaad3e46d7b505"} Jun 02 16:53:33.866681 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:33.866628 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-hlbwl" event={"ID":"d2e559b7-dedc-4959-a1dd-8c5b697475a0","Type":"ContainerStarted","Data":"bbecffa5aed0ac794e17c4ff55ff868021c6d28dc9c72ac7665312f4b1b96489"} Jun 02 16:53:33.886446 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:53:33.886400 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-hlbwl" podStartSLOduration=1.390557685 podStartE2EDuration="6.886385165s" podCreationTimestamp="2026-06-02 16:53:27 +0000 UTC" firstStartedPulling="2026-06-02 16:53:27.940413586 +0000 UTC m=+731.225692300" lastFinishedPulling="2026-06-02 16:53:33.436241063 +0000 UTC m=+736.721519780" observedRunningTime="2026-06-02 16:53:33.883358984 +0000 UTC m=+737.168637723" watchObservedRunningTime="2026-06-02 16:53:33.886385165 +0000 UTC m=+737.171663902" Jun 02 16:56:02.873678 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.873630 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2"] Jun 02 16:56:02.877412 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.877389 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:02.882888 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.882865 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 16:56:02.883006 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.882884 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 16:56:02.883006 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.882894 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 16:56:02.883006 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.882874 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gplcp\"" Jun 02 16:56:02.887004 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.886981 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2"] Jun 02 16:56:02.952890 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.952870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:02.952974 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.952901 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:02.952974 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.952927 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e4f2f8-b934-460a-9976-40a7f9d4388f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:02.953091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.953025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:02.953091 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.953072 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfq8b\" (UniqueName: \"kubernetes.io/projected/f0e4f2f8-b934-460a-9976-40a7f9d4388f-kube-api-access-kfq8b\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:02.953192 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:02.953152 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.053832 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.053807 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.053928 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.053881 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.053970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.053939 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e4f2f8-b934-460a-9976-40a7f9d4388f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.053970 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.053961 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.054054 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.053983 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kfq8b\" (UniqueName: \"kubernetes.io/projected/f0e4f2f8-b934-460a-9976-40a7f9d4388f-kube-api-access-kfq8b\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.054054 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.054024 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.054217 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.054201 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.054343 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.054323 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.054411 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.054396 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.056021 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.056003 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0e4f2f8-b934-460a-9976-40a7f9d4388f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.056327 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.056309 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0e4f2f8-b934-460a-9976-40a7f9d4388f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.062014 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.061993 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfq8b\" (UniqueName: \"kubernetes.io/projected/f0e4f2f8-b934-460a-9976-40a7f9d4388f-kube-api-access-kfq8b\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2\" (UID: \"f0e4f2f8-b934-460a-9976-40a7f9d4388f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.210010 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.209921 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" Jun 02 16:56:03.344554 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.344531 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2"] Jun 02 16:56:03.346320 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:56:03.346299 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e4f2f8_b934_460a_9976_40a7f9d4388f.slice/crio-716cf0aa5a092c087ef19d305c30395b8ff8afafa4145d093a18663c1ea31a26 WatchSource:0}: Error finding container 716cf0aa5a092c087ef19d305c30395b8ff8afafa4145d093a18663c1ea31a26: Status 404 returned error can't find the container with id 716cf0aa5a092c087ef19d305c30395b8ff8afafa4145d093a18663c1ea31a26 Jun 02 16:56:03.457058 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:03.457028 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" event={"ID":"f0e4f2f8-b934-460a-9976-40a7f9d4388f","Type":"ContainerStarted","Data":"716cf0aa5a092c087ef19d305c30395b8ff8afafa4145d093a18663c1ea31a26"} Jun 02 16:56:06.471648 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:06.471610 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-srsj2" event={"ID":"f0e4f2f8-b934-460a-9976-40a7f9d4388f","Type":"ContainerStarted","Data":"07e7acb3e34254eb7903c9adacd7dd9c9463a10f85a81f6599e80d376bba4436"} Jun 02 16:56:08.853538 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.853497 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l"] Jun 02 16:56:08.858343 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.858323 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.861392 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.861367 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 16:56:08.869972 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.869930 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l"] Jun 02 16:56:08.894336 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.894294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.894455 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.894344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.894455 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.894445 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.894573 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.894486 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f25948b-e307-46eb-a0c1-ffd2828d88b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.894573 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.894531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.894573 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.894566 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7r9r\" (UniqueName: \"kubernetes.io/projected/8f25948b-e307-46eb-a0c1-ffd2828d88b9-kube-api-access-d7r9r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.995721 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.995696 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.995721 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.995730 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.995926 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.995773 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.995926 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.995808 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f25948b-e307-46eb-a0c1-ffd2828d88b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.995926 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.995856 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.996084 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.995997 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7r9r\" (UniqueName: \"kubernetes.io/projected/8f25948b-e307-46eb-a0c1-ffd2828d88b9-kube-api-access-d7r9r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.996137 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.996116 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.996198 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.996162 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.996295 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.996276 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.997997 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.997975 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f25948b-e307-46eb-a0c1-ffd2828d88b9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:08.999035 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:08.999015 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f25948b-e307-46eb-a0c1-ffd2828d88b9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:09.003329 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:09.003308 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7r9r\" (UniqueName: \"kubernetes.io/projected/8f25948b-e307-46eb-a0c1-ffd2828d88b9-kube-api-access-d7r9r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l\" (UID: \"8f25948b-e307-46eb-a0c1-ffd2828d88b9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:09.171156 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:09.171059 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:09.300232 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:09.300205 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l"] Jun 02 16:56:09.301755 ip-10-0-130-253 kubenswrapper[2555]: W0602 16:56:09.301728 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f25948b_e307_46eb_a0c1_ffd2828d88b9.slice/crio-4b1e91d9e90b335b20443c9d0c884baa8c98ed761fecf2974691f33318d421cf WatchSource:0}: Error finding container 4b1e91d9e90b335b20443c9d0c884baa8c98ed761fecf2974691f33318d421cf: Status 404 returned error can't find the container with id 4b1e91d9e90b335b20443c9d0c884baa8c98ed761fecf2974691f33318d421cf Jun 02 16:56:09.484853 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:09.484769 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" event={"ID":"8f25948b-e307-46eb-a0c1-ffd2828d88b9","Type":"ContainerStarted","Data":"867e7612de10aed3de8a01013e5f7ad6e8147486f6ae5e5a240978499b80c62d"} Jun 02 16:56:09.484853 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:09.484808 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" event={"ID":"8f25948b-e307-46eb-a0c1-ffd2828d88b9","Type":"ContainerStarted","Data":"4b1e91d9e90b335b20443c9d0c884baa8c98ed761fecf2974691f33318d421cf"} Jun 02 16:56:15.509624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:15.509546 2555 generic.go:358] "Generic (PLEG): container finished" podID="8f25948b-e307-46eb-a0c1-ffd2828d88b9" containerID="867e7612de10aed3de8a01013e5f7ad6e8147486f6ae5e5a240978499b80c62d" exitCode=0 Jun 02 16:56:15.509624 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:15.509607 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" event={"ID":"8f25948b-e307-46eb-a0c1-ffd2828d88b9","Type":"ContainerDied","Data":"867e7612de10aed3de8a01013e5f7ad6e8147486f6ae5e5a240978499b80c62d"} Jun 02 16:56:17.518706 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:17.518644 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" event={"ID":"8f25948b-e307-46eb-a0c1-ffd2828d88b9","Type":"ContainerStarted","Data":"3b59eccf4894e66ea5191bd8edca8e2f51ccc8eba22a1f273bf7cd85373857c1"} Jun 02 16:56:17.540300 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:17.540252 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" podStartSLOduration=8.460524695 podStartE2EDuration="9.540238264s" podCreationTimestamp="2026-06-02 16:56:08 +0000 UTC" firstStartedPulling="2026-06-02 16:56:15.510187542 +0000 UTC m=+898.795466256" lastFinishedPulling="2026-06-02 16:56:16.589901111 +0000 UTC m=+899.875179825" observedRunningTime="2026-06-02 16:56:17.537342244 +0000 UTC m=+900.822620991" watchObservedRunningTime="2026-06-02 16:56:17.540238264 +0000 UTC m=+900.825516999" Jun 02 16:56:19.171566 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:19.171530 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:19.172104 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:19.171579 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:19.184142 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:19.184120 2555 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 16:56:19.537328 ip-10-0-130-253 kubenswrapper[2555]: I0602 16:56:19.537297 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l" Jun 02 17:00:00.145233 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.145196 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29673660-ptn66"] Jun 02 17:00:00.148692 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.148675 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" Jun 02 17:00:00.151453 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.151426 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bnddw\"" Jun 02 17:00:00.157550 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.157525 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673660-ptn66"] Jun 02 17:00:00.255942 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.255904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gnv\" (UniqueName: \"kubernetes.io/projected/44e3988a-d066-46e4-abe3-e1b361985248-kube-api-access-b8gnv\") pod \"maas-api-key-cleanup-29673660-ptn66\" (UID: \"44e3988a-d066-46e4-abe3-e1b361985248\") " pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" Jun 02 17:00:00.356457 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.356428 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gnv\" (UniqueName: \"kubernetes.io/projected/44e3988a-d066-46e4-abe3-e1b361985248-kube-api-access-b8gnv\") pod \"maas-api-key-cleanup-29673660-ptn66\" (UID: \"44e3988a-d066-46e4-abe3-e1b361985248\") " pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" Jun 02 17:00:00.365321 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.365297 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gnv\" (UniqueName: \"kubernetes.io/projected/44e3988a-d066-46e4-abe3-e1b361985248-kube-api-access-b8gnv\") pod \"maas-api-key-cleanup-29673660-ptn66\" (UID: \"44e3988a-d066-46e4-abe3-e1b361985248\") " pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" Jun 02 17:00:00.462774 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.462706 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" Jun 02 17:00:00.595530 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.595498 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673660-ptn66"] Jun 02 17:00:00.596725 ip-10-0-130-253 kubenswrapper[2555]: W0602 17:00:00.596698 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e3988a_d066_46e4_abe3_e1b361985248.slice/crio-ae0d8338ca831d12dbac92b643c3ac5b522fba2a57d4d8875a4dd76e76e721b6 WatchSource:0}: Error finding container ae0d8338ca831d12dbac92b643c3ac5b522fba2a57d4d8875a4dd76e76e721b6: Status 404 returned error can't find the container with id ae0d8338ca831d12dbac92b643c3ac5b522fba2a57d4d8875a4dd76e76e721b6 Jun 02 17:00:00.598565 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:00.598547 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 17:00:01.413842 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:01.413809 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" event={"ID":"44e3988a-d066-46e4-abe3-e1b361985248","Type":"ContainerStarted","Data":"ae0d8338ca831d12dbac92b643c3ac5b522fba2a57d4d8875a4dd76e76e721b6"} Jun 02 17:00:08.441341 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:08.441305 2555 generic.go:358] "Generic (PLEG): container finished" podID="44e3988a-d066-46e4-abe3-e1b361985248" containerID="0058e87a684e1c7d3bc498cd770e6d2daf3551d27f3fe1bb21bab7a3908042de" exitCode=0 Jun 02 17:00:08.441680 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:08.441388 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" event={"ID":"44e3988a-d066-46e4-abe3-e1b361985248","Type":"ContainerDied","Data":"0058e87a684e1c7d3bc498cd770e6d2daf3551d27f3fe1bb21bab7a3908042de"} Jun 02 17:00:09.578423 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:09.578398 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" Jun 02 17:00:09.735484 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:09.735404 2555 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8gnv\" (UniqueName: \"kubernetes.io/projected/44e3988a-d066-46e4-abe3-e1b361985248-kube-api-access-b8gnv\") pod \"44e3988a-d066-46e4-abe3-e1b361985248\" (UID: \"44e3988a-d066-46e4-abe3-e1b361985248\") " Jun 02 17:00:09.737566 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:09.737544 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44e3988a-d066-46e4-abe3-e1b361985248-kube-api-access-b8gnv" (OuterVolumeSpecName: "kube-api-access-b8gnv") pod "44e3988a-d066-46e4-abe3-e1b361985248" (UID: "44e3988a-d066-46e4-abe3-e1b361985248"). InnerVolumeSpecName "kube-api-access-b8gnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:00:09.836190 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:09.836164 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8gnv\" (UniqueName: \"kubernetes.io/projected/44e3988a-d066-46e4-abe3-e1b361985248-kube-api-access-b8gnv\") on node \"ip-10-0-130-253.ec2.internal\" DevicePath \"\"" Jun 02 17:00:10.453933 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:10.453899 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" event={"ID":"44e3988a-d066-46e4-abe3-e1b361985248","Type":"ContainerDied","Data":"ae0d8338ca831d12dbac92b643c3ac5b522fba2a57d4d8875a4dd76e76e721b6"} Jun 02 17:00:10.453933 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:10.453933 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae0d8338ca831d12dbac92b643c3ac5b522fba2a57d4d8875a4dd76e76e721b6" Jun 02 17:00:10.454283 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:00:10.453910 2555 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673660-ptn66" Jun 02 17:01:59.653222 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:01:59.653186 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-584bd5886b-lbtxw_5ddf844b-d06c-4c5e-8bbd-615254057a88/nginx/0.log" Jun 02 17:01:59.764320 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:01:59.764291 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-psc4w_45c37a6e-9fe3-45dc-b49c-09310a59af00/manager/0.log" Jun 02 17:01:59.884753 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:01:59.884726 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wcdlh_a2595e25-6fd6-4a25-a083-08a87a70670a/manager/0.log" Jun 02 17:02:00.101312 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:00.101274 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673660-ptn66_44e3988a-d066-46e4-abe3-e1b361985248/cleanup/0.log" Jun 02 17:02:00.326147 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:00.326121 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-xsfhd_7293276d-f43b-404a-8800-c7922d2e5d77/server/0.log" Jun 02 17:02:00.445115 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:00.445037 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-6tm4n_802ff626-f592-4f5f-937f-8628362815e8/manager/0.log" Jun 02 17:02:00.553850 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:00.553828 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-ffd95_99ed2148-557d-419e-8fcf-5c3cc858ed12/manager/0.log" Jun 02 17:02:00.559167 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:00.559149 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-ffd95_99ed2148-557d-419e-8fcf-5c3cc858ed12/copy-manifests/0.log" Jun 02 17:02:00.899284 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:00.899260 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-cjn6s_34988c02-73e8-42f2-a553-e120b27db5be/postgres/0.log" Jun 02 17:02:01.653923 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.653889 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd_8d2ababf-e383-4437-b2fd-bd55cffaaa97/util/0.log" Jun 02 17:02:01.659613 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.659587 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd_8d2ababf-e383-4437-b2fd-bd55cffaaa97/pull/0.log" Jun 02 17:02:01.664352 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.664326 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd_8d2ababf-e383-4437-b2fd-bd55cffaaa97/extract/0.log" Jun 02 17:02:01.769647 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.769625 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv_57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e/util/0.log" Jun 02 17:02:01.775473 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.775447 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv_57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e/pull/0.log" Jun 02 17:02:01.780790 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.780770 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv_57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e/extract/0.log" Jun 02 17:02:01.889370 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.889343 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5_1fb2e621-01b9-4771-b86f-80eb6b753f8c/pull/0.log" Jun 02 17:02:01.894310 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.894289 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5_1fb2e621-01b9-4771-b86f-80eb6b753f8c/extract/0.log" Jun 02 17:02:01.898956 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:01.898937 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5_1fb2e621-01b9-4771-b86f-80eb6b753f8c/util/0.log" Jun 02 17:02:02.004797 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:02.004729 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj_e1a54b55-5b0a-4f00-87e8-1a17faa6516c/util/0.log" Jun 02 17:02:02.010091 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:02.010070 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj_e1a54b55-5b0a-4f00-87e8-1a17faa6516c/pull/0.log" Jun 02 17:02:02.014934 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:02.014908 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj_e1a54b55-5b0a-4f00-87e8-1a17faa6516c/extract/0.log" Jun 02 17:02:03.508963 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:03.508929 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-vdg22_41e4425a-08b8-4165-856c-cede12ff3a95/discovery/0.log" Jun 02 17:02:03.612887 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:03.612856 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8dc448d-lwccz_88e84fb5-343d-4f23-bf47-097274669fbc/kube-auth-proxy/0.log" Jun 02 17:02:03.826886 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:03.826863 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-s98l8_c6c9c75c-e1d1-44b2-9399-e2f30375a696/istio-proxy/0.log" Jun 02 17:02:04.746367 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:04.746337 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l_8f25948b-e307-46eb-a0c1-ffd2828d88b9/storage-initializer/0.log" Jun 02 17:02:04.755860 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:04.755826 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9jbs2l_8f25948b-e307-46eb-a0c1-ffd2828d88b9/main/0.log" Jun 02 17:02:12.966632 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:12.966552 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-62jdn_7b9840e4-9fde-4598-a167-ed011b54a1d3/global-pull-secret-syncer/0.log" Jun 02 17:02:13.151068 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:13.151036 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vjmfh_2f858e67-8261-4a28-9c6e-df5cc3150ee5/konnectivity-agent/0.log" Jun 02 17:02:13.169075 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:13.169051 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-253.ec2.internal_46dd9cce261ef3bdca75d784ca677c02/haproxy/0.log" Jun 02 17:02:17.395850 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.395811 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd_8d2ababf-e383-4437-b2fd-bd55cffaaa97/extract/0.log" Jun 02 17:02:17.412001 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.411976 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd_8d2ababf-e383-4437-b2fd-bd55cffaaa97/util/0.log" Jun 02 17:02:17.432218 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.432202 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759z98wd_8d2ababf-e383-4437-b2fd-bd55cffaaa97/pull/0.log" Jun 02 17:02:17.455357 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.455333 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv_57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e/extract/0.log" Jun 02 17:02:17.475233 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.475208 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv_57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e/util/0.log" Jun 02 17:02:17.499873 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.499852 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fcmwv_57dc8adc-07e3-4c53-9e60-f7c8d33c5c4e/pull/0.log" Jun 02 17:02:17.520870 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.520846 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5_1fb2e621-01b9-4771-b86f-80eb6b753f8c/extract/0.log" Jun 02 17:02:17.537818 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.537800 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5_1fb2e621-01b9-4771-b86f-80eb6b753f8c/util/0.log" Jun 02 17:02:17.554247 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.554223 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ct5n5_1fb2e621-01b9-4771-b86f-80eb6b753f8c/pull/0.log" Jun 02 17:02:17.576214 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.576192 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj_e1a54b55-5b0a-4f00-87e8-1a17faa6516c/extract/0.log" Jun 02 17:02:17.592938 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.592923 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj_e1a54b55-5b0a-4f00-87e8-1a17faa6516c/util/0.log" Jun 02 17:02:17.612324 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:17.612293 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17zhbj_e1a54b55-5b0a-4f00-87e8-1a17faa6516c/pull/0.log" Jun 02 17:02:19.567701 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:19.567673 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-khhtl_f0473480-9722-4d12-9519-7ea61bd7ae60/node-exporter/0.log" Jun 02 17:02:19.587887 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:19.587800 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-khhtl_f0473480-9722-4d12-9519-7ea61bd7ae60/kube-rbac-proxy/0.log" Jun 02 17:02:19.612776 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:19.612758 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-khhtl_f0473480-9722-4d12-9519-7ea61bd7ae60/init-textfile/0.log" Jun 02 17:02:19.721388 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:19.721363 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-9n8h4_ec01728e-a012-498c-a46e-84627326651c/kube-rbac-proxy-main/0.log" Jun 02 17:02:19.764750 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:19.764725 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-9n8h4_ec01728e-a012-498c-a46e-84627326651c/kube-rbac-proxy-self/0.log" Jun 02 17:02:19.787028 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:19.787004 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-9n8h4_ec01728e-a012-498c-a46e-84627326651c/openshift-state-metrics/0.log" Jun 02 17:02:20.057220 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:20.057192 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-9tj7x_c4b50dc3-ed39-44a8-ad0d-75c6afb62d33/prometheus-operator-admission-webhook/0.log" Jun 02 17:02:20.082927 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:20.082894 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db845cb44-xm5q5_7e43face-e3f9-46c1-926f-ae50f249dacd/telemeter-client/0.log" Jun 02 17:02:20.103519 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:20.103495 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db845cb44-xm5q5_7e43face-e3f9-46c1-926f-ae50f249dacd/reload/0.log" Jun 02 17:02:20.119587 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:20.119567 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db845cb44-xm5q5_7e43face-e3f9-46c1-926f-ae50f249dacd/kube-rbac-proxy/0.log" Jun 02 17:02:22.351001 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.350971 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68d7484c79-2jkfw_1eec119a-6bc8-4489-9e30-a5384683150d/console/0.log" Jun 02 17:02:22.934123 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.933909 2555 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb"] Jun 02 17:02:22.934430 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.934412 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44e3988a-d066-46e4-abe3-e1b361985248" containerName="cleanup" Jun 02 17:02:22.934480 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.934432 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="44e3988a-d066-46e4-abe3-e1b361985248" containerName="cleanup" Jun 02 17:02:22.934519 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.934497 2555 memory_manager.go:356] "RemoveStaleState removing state" podUID="44e3988a-d066-46e4-abe3-e1b361985248" containerName="cleanup" Jun 02 17:02:22.937278 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.937263 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:22.940213 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.940192 2555 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9ksn2\"/\"default-dockercfg-ccmd4\"" Jun 02 17:02:22.940388 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.940215 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ksn2\"/\"openshift-service-ca.crt\"" Jun 02 17:02:22.940388 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.940236 2555 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ksn2\"/\"kube-root-ca.crt\"" Jun 02 17:02:22.946390 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:22.946367 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb"] Jun 02 17:02:23.026319 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.026290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-lib-modules\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.026427 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.026337 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-sys\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.026427 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.026385 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-proc\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.026499 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.026425 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-podres\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.026537 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.026493 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqsw2\" (UniqueName: \"kubernetes.io/projected/f3181fb2-17b2-4c00-8c82-a864b6b90454-kube-api-access-xqsw2\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.127714 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127693 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-podres\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.127827 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127734 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqsw2\" (UniqueName: \"kubernetes.io/projected/f3181fb2-17b2-4c00-8c82-a864b6b90454-kube-api-access-xqsw2\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.127827 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127759 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-lib-modules\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.127827 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127798 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-sys\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.127936 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127829 2555 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-proc\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.127936 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127880 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-podres\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.127936 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127915 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-sys\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.128037 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127953 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-proc\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.128037 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.127958 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f3181fb2-17b2-4c00-8c82-a864b6b90454-lib-modules\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.137453 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.137435 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqsw2\" (UniqueName: \"kubernetes.io/projected/f3181fb2-17b2-4c00-8c82-a864b6b90454-kube-api-access-xqsw2\") pod \"perf-node-gather-daemonset-rqhlb\" (UID: \"f3181fb2-17b2-4c00-8c82-a864b6b90454\") " pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.248599 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.248533 2555 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:23.375995 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.375969 2555 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb"] Jun 02 17:02:23.377392 ip-10-0-130-253 kubenswrapper[2555]: W0602 17:02:23.377356 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf3181fb2_17b2_4c00_8c82_a864b6b90454.slice/crio-1d07428f2aa97259f095fbbac1bd1407517650cfbee099e19996e34bdffdbf33 WatchSource:0}: Error finding container 1d07428f2aa97259f095fbbac1bd1407517650cfbee099e19996e34bdffdbf33: Status 404 returned error can't find the container with id 1d07428f2aa97259f095fbbac1bd1407517650cfbee099e19996e34bdffdbf33 Jun 02 17:02:23.855006 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.854980 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p6tqb_61567aca-4523-4e65-b0b9-1e41ab678400/dns/0.log" Jun 02 17:02:23.870556 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.870524 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p6tqb_61567aca-4523-4e65-b0b9-1e41ab678400/kube-rbac-proxy/0.log" Jun 02 17:02:23.887276 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:23.887259 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52tqs_e2664832-ce41-46a2-806b-e2176632c5be/dns-node-resolver/0.log" Jun 02 17:02:24.001578 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:24.001550 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" event={"ID":"f3181fb2-17b2-4c00-8c82-a864b6b90454","Type":"ContainerStarted","Data":"9051201bd17eba6858518ca62f8ac5e6b3ffeef14d83ef46b78308f99bdf6457"} Jun 02 17:02:24.001696 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:24.001586 2555 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" event={"ID":"f3181fb2-17b2-4c00-8c82-a864b6b90454","Type":"ContainerStarted","Data":"1d07428f2aa97259f095fbbac1bd1407517650cfbee099e19996e34bdffdbf33"} Jun 02 17:02:24.001743 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:24.001690 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:24.019092 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:24.019052 2555 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" podStartSLOduration=2.019035284 podStartE2EDuration="2.019035284s" podCreationTimestamp="2026-06-02 17:02:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:02:24.017484661 +0000 UTC m=+1267.302763399" watchObservedRunningTime="2026-06-02 17:02:24.019035284 +0000 UTC m=+1267.304314021" Jun 02 17:02:24.390430 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:24.390362 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7s97n_fbbb3cf6-c5dd-4472-b02a-7359fb1a01e4/node-ca/0.log" Jun 02 17:02:25.293920 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:25.293886 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-vdg22_41e4425a-08b8-4165-856c-cede12ff3a95/discovery/0.log" Jun 02 17:02:25.309045 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:25.309016 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8dc448d-lwccz_88e84fb5-343d-4f23-bf47-097274669fbc/kube-auth-proxy/0.log" Jun 02 17:02:25.352975 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:25.352946 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-s98l8_c6c9c75c-e1d1-44b2-9399-e2f30375a696/istio-proxy/0.log" Jun 02 17:02:25.894419 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:25.894388 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f7mv2_29e15dd3-c0af-4a23-aca4-d572bf1ede24/serve-healthcheck-canary/0.log" Jun 02 17:02:26.422085 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:26.422056 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-twsrw_3c5cb5ac-7252-4ee8-bba7-93581e6aa287/kube-rbac-proxy/0.log" Jun 02 17:02:26.438183 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:26.438152 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-twsrw_3c5cb5ac-7252-4ee8-bba7-93581e6aa287/exporter/0.log" Jun 02 17:02:26.455933 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:26.455903 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-twsrw_3c5cb5ac-7252-4ee8-bba7-93581e6aa287/extractor/0.log" Jun 02 17:02:28.627034 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:28.627002 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-584bd5886b-lbtxw_5ddf844b-d06c-4c5e-8bbd-615254057a88/nginx/0.log" Jun 02 17:02:28.673644 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:28.673617 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-psc4w_45c37a6e-9fe3-45dc-b49c-09310a59af00/manager/0.log" Jun 02 17:02:28.735253 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:28.735225 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-wcdlh_a2595e25-6fd6-4a25-a083-08a87a70670a/manager/0.log" Jun 02 17:02:28.773378 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:28.773357 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673660-ptn66_44e3988a-d066-46e4-abe3-e1b361985248/cleanup/0.log" Jun 02 17:02:28.813848 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:28.813826 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-xsfhd_7293276d-f43b-404a-8800-c7922d2e5d77/server/0.log" Jun 02 17:02:28.871914 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:28.871892 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-6tm4n_802ff626-f592-4f5f-937f-8628362815e8/manager/0.log" Jun 02 17:02:28.893155 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:28.893096 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-ffd95_99ed2148-557d-419e-8fcf-5c3cc858ed12/manager/0.log" Jun 02 17:02:28.910498 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:28.910477 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58857ff9f-ffd95_99ed2148-557d-419e-8fcf-5c3cc858ed12/copy-manifests/0.log" Jun 02 17:02:29.087235 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:29.087211 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-cjn6s_34988c02-73e8-42f2-a553-e120b27db5be/postgres/0.log" Jun 02 17:02:30.016508 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:30.016475 2555 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9ksn2/perf-node-gather-daemonset-rqhlb" Jun 02 17:02:30.382006 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:30.381934 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-p2fpd_bbd452c5-50ce-4c26-9603-1d2c0cdacba1/openshift-lws-operator/0.log" Jun 02 17:02:36.613150 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:36.613121 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9xgw_9497fe5b-b10b-4958-9709-91518d7712ee/kube-multus-additional-cni-plugins/0.log" Jun 02 17:02:36.629933 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:36.629902 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9xgw_9497fe5b-b10b-4958-9709-91518d7712ee/egress-router-binary-copy/0.log" Jun 02 17:02:36.648967 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:36.648948 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9xgw_9497fe5b-b10b-4958-9709-91518d7712ee/cni-plugins/0.log" Jun 02 17:02:36.666118 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:36.666096 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9xgw_9497fe5b-b10b-4958-9709-91518d7712ee/bond-cni-plugin/0.log" Jun 02 17:02:36.681580 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:36.681558 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9xgw_9497fe5b-b10b-4958-9709-91518d7712ee/routeoverride-cni/0.log" Jun 02 17:02:36.699380 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:36.699359 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9xgw_9497fe5b-b10b-4958-9709-91518d7712ee/whereabouts-cni-bincopy/0.log" Jun 02 17:02:36.716023 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:36.716004 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9xgw_9497fe5b-b10b-4958-9709-91518d7712ee/whereabouts-cni/0.log" Jun 02 17:02:36.923727 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:36.923671 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nmh8p_6982aada-4303-48a9-bb2a-d2d1e2a3c1a0/kube-multus/0.log" Jun 02 17:02:37.030265 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.030245 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mvmcg_eef1fcdf-cbb3-4ab9-ae11-086fc3357517/network-metrics-daemon/0.log" Jun 02 17:02:37.044460 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.044441 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mvmcg_eef1fcdf-cbb3-4ab9-ae11-086fc3357517/kube-rbac-proxy/0.log" Jun 02 17:02:37.841158 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.841131 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dmbr_8aa0ee3e-c79d-4bea-82b9-16712ccb1d21/ovn-controller/0.log" Jun 02 17:02:37.865242 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.865208 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dmbr_8aa0ee3e-c79d-4bea-82b9-16712ccb1d21/ovn-acl-logging/0.log" Jun 02 17:02:37.889289 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.889267 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dmbr_8aa0ee3e-c79d-4bea-82b9-16712ccb1d21/kube-rbac-proxy-node/0.log" Jun 02 17:02:37.908213 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.908186 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dmbr_8aa0ee3e-c79d-4bea-82b9-16712ccb1d21/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 17:02:37.921928 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.921899 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dmbr_8aa0ee3e-c79d-4bea-82b9-16712ccb1d21/northd/0.log" Jun 02 17:02:37.937462 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.937442 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dmbr_8aa0ee3e-c79d-4bea-82b9-16712ccb1d21/nbdb/0.log" Jun 02 17:02:37.952421 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:37.952402 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dmbr_8aa0ee3e-c79d-4bea-82b9-16712ccb1d21/sbdb/0.log" Jun 02 17:02:38.147989 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:38.147910 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2dmbr_8aa0ee3e-c79d-4bea-82b9-16712ccb1d21/ovnkube-controller/0.log" Jun 02 17:02:39.797579 ip-10-0-130-253 kubenswrapper[2555]: I0602 17:02:39.797550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tsrc6_5f240b59-1910-4ad3-a70e-f4e004d60bc5/network-check-target-container/0.log"