Apr 17 21:37:15.534851 ip-10-0-132-175 systemd[1]: Starting Kubernetes Kubelet... Apr 17 21:37:15.993075 ip-10-0-132-175 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 21:37:15.993075 ip-10-0-132-175 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Apr 17 21:37:15.993075 ip-10-0-132-175 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 21:37:15.993075 ip-10-0-132-175 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Apr 17 21:37:15.993075 ip-10-0-132-175 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Apr 17 21:37:15.994725 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.994642 2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Apr 17 21:37:15.996969 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996954 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 21:37:15.996969 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996968 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996972 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996976 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996979 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996982 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996986 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996990 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996994 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.996997 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997001 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997005 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997009 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997012 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997015 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997017 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997020 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997023 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997026 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997028 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 21:37:15.997029 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997030 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997033 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997036 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997040 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997042 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997045 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997048 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997050 2575 feature_gate.go:328] unrecognized feature gate: Example Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997060 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997063 2575 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997066 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997069 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997071 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997074 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997077 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997080 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997082 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997085 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997087 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 21:37:15.997483 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997090 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997093 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997095 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997098 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997100 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997103 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997105 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997107 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997110 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997113 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997115 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997118 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997120 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997123 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997125 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997129 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997132 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997134 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997137 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997139 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 21:37:15.997964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997142 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997145 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997147 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997150 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997153 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997156 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997160 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997163 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997166 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997168 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997171 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997173 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997176 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997179 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997181 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997184 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997187 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997189 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997192 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997194 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 21:37:15.998479 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997197 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997199 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997202 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997204 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997207 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997209 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.997212 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998415 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998422 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998426 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998429 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998432 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998434 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998437 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998440 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998443 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998446 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998448 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998451 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 21:37:15.998991 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998455 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998459 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998462 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998465 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998468 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998471 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998474 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998476 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998480 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998483 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998485 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998488 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998491 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998493 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998496 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998498 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998501 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998503 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998506 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998509 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 21:37:15.999460 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998512 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998514 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998517 2575 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998519 2575 feature_gate.go:328] unrecognized feature gate: Example Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998522 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998525 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998527 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998530 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998532 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998535 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998538 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998540 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998555 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998559 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998563 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998567 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998570 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998573 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998575 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998578 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 21:37:15.999964 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998581 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998585 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998587 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998590 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998592 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998595 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998598 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998600 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998603 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998605 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998608 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998612 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998615 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998618 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998620 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998623 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998626 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998628 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998631 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998634 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 21:37:16.000465 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998636 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998639 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998641 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998644 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998646 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998650 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998653 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998655 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998657 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998660 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998663 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998666 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998670 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.998673 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998747 2575 flags.go:64] FLAG: --address="0.0.0.0" Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998761 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998767 2575 flags.go:64] FLAG: --anonymous-auth="true" Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998772 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998776 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998779 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998784 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Apr 17 21:37:16.000968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998788 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998792 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998796 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998800 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998804 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998808 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998811 2575 flags.go:64] FLAG: --cgroup-root="" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998813 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998816 2575 flags.go:64] FLAG: --client-ca-file="" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998819 2575 flags.go:64] FLAG: --cloud-config="" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998822 2575 flags.go:64] FLAG: --cloud-provider="external" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998825 2575 flags.go:64] FLAG: --cluster-dns="[]" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998831 2575 flags.go:64] FLAG: --cluster-domain="" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998834 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998837 2575 flags.go:64] FLAG: --config-dir="" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998840 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998843 2575 flags.go:64] FLAG: --container-log-max-files="5" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998848 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998851 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998854 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998857 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998860 2575 flags.go:64] FLAG: --contention-profiling="false" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998863 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998867 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998870 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Apr 17 21:37:16.001464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998873 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998885 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998889 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998892 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998894 2575 flags.go:64] FLAG: --enable-load-reader="false" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998898 2575 flags.go:64] FLAG: --enable-server="true" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998901 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998905 2575 flags.go:64] FLAG: --event-burst="100" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998908 2575 flags.go:64] FLAG: --event-qps="50" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998911 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998914 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998917 2575 flags.go:64] FLAG: --eviction-hard="" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998922 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998924 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998927 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998930 2575 flags.go:64] FLAG: --eviction-soft="" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998933 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998936 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998939 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998942 2575 flags.go:64] FLAG: --experimental-mounter-path="" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998945 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998947 2575 flags.go:64] FLAG: --fail-swap-on="true" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998950 2575 flags.go:64] FLAG: --feature-gates="" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998954 2575 flags.go:64] FLAG: --file-check-frequency="20s" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998957 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Apr 17 21:37:16.002068 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998960 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998963 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998966 2575 flags.go:64] FLAG: --healthz-port="10248" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998969 2575 flags.go:64] FLAG: --help="false" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998972 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998975 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998978 2575 flags.go:64] FLAG: --http-check-frequency="20s" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998981 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998985 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998994 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.998997 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999000 2575 flags.go:64] FLAG: --image-service-endpoint="" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999003 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999006 2575 flags.go:64] FLAG: --kube-api-burst="100" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999009 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999013 2575 flags.go:64] FLAG: --kube-api-qps="50" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999016 2575 flags.go:64] FLAG: --kube-reserved="" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999019 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999022 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999025 2575 flags.go:64] FLAG: --kubelet-cgroups="" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999028 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999031 2575 flags.go:64] FLAG: --lock-file="" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999034 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999037 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Apr 17 21:37:16.002676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999040 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999046 2575 flags.go:64] FLAG: --log-json-split-stream="false" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999049 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999051 2575 flags.go:64] FLAG: --log-text-split-stream="false" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999054 2575 flags.go:64] FLAG: --logging-format="text" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999057 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999060 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999063 2575 flags.go:64] FLAG: --manifest-url="" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999066 2575 flags.go:64] FLAG: --manifest-url-header="" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999070 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999073 2575 flags.go:64] FLAG: --max-open-files="1000000" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999077 2575 flags.go:64] FLAG: --max-pods="110" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999080 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999083 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999086 2575 flags.go:64] FLAG: --memory-manager-policy="None" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999089 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999092 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999095 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999104 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999112 2575 flags.go:64] FLAG: --node-status-max-images="50" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999115 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999118 2575 flags.go:64] FLAG: --oom-score-adj="-999" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999121 2575 flags.go:64] FLAG: --pod-cidr="" Apr 17 21:37:16.003305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999124 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c8cfe89231412ff3ee8cb6207fa0be33cad0f08e88c9c0f1e9f7e8c6f14d6715" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999130 2575 flags.go:64] FLAG: --pod-manifest-path="" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999133 2575 flags.go:64] FLAG: --pod-max-pids="-1" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999136 2575 flags.go:64] FLAG: --pods-per-core="0" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999139 2575 flags.go:64] FLAG: --port="10250" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999142 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999145 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05da37de08f30ee4e" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999148 2575 flags.go:64] FLAG: --qos-reserved="" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999151 2575 flags.go:64] FLAG: --read-only-port="10255" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999154 2575 flags.go:64] FLAG: --register-node="true" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999157 2575 flags.go:64] FLAG: --register-schedulable="true" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999160 2575 flags.go:64] FLAG: --register-with-taints="" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999164 2575 flags.go:64] FLAG: --registry-burst="10" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999167 2575 flags.go:64] FLAG: --registry-qps="5" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999169 2575 flags.go:64] FLAG: --reserved-cpus="" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999172 2575 flags.go:64] FLAG: --reserved-memory="" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999176 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999179 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999182 2575 flags.go:64] FLAG: --rotate-certificates="false" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999185 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999188 2575 flags.go:64] FLAG: --runonce="false" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999190 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999194 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999196 2575 flags.go:64] FLAG: --seccomp-default="false" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999199 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999203 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Apr 17 21:37:16.003977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999206 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999209 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999215 2575 flags.go:64] FLAG: --storage-driver-password="root" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999218 2575 flags.go:64] FLAG: --storage-driver-secure="false" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999221 2575 flags.go:64] FLAG: --storage-driver-table="stats" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999224 2575 flags.go:64] FLAG: --storage-driver-user="root" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999227 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999237 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999242 2575 flags.go:64] FLAG: --system-cgroups="" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999245 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999252 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999255 2575 flags.go:64] FLAG: --tls-cert-file="" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999258 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999262 2575 flags.go:64] FLAG: --tls-min-version="" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999265 2575 flags.go:64] FLAG: --tls-private-key-file="" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999268 2575 flags.go:64] FLAG: --topology-manager-policy="none" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999271 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999274 2575 flags.go:64] FLAG: --topology-manager-scope="container" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999277 2575 flags.go:64] FLAG: --v="2" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999282 2575 flags.go:64] FLAG: --version="false" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999286 2575 flags.go:64] FLAG: --vmodule="" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999290 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999293 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999412 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 21:37:16.004603 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999416 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999419 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999423 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999426 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999429 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999431 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999434 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999439 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999442 2575 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999445 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999448 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999451 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999454 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999457 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999459 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999465 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999468 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999471 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999473 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999477 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999479 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 21:37:16.005178 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999482 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999485 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999487 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999490 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999492 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999495 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999499 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999503 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999506 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999509 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999513 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999517 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999520 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999523 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999526 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999528 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999531 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999533 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999537 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 21:37:16.005718 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999540 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999556 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999560 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999563 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999568 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999571 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999573 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999577 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999580 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999583 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999585 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999588 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999591 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999593 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999596 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999598 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999601 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999603 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999606 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999608 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 21:37:16.006182 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999611 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999614 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999616 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999619 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999621 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999624 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999626 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999629 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999631 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999634 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999637 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999641 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999644 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999646 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999649 2575 feature_gate.go:328] unrecognized feature gate: Example Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999651 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999654 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999657 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999659 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 21:37:16.006719 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999663 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 21:37:16.007196 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999666 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 21:37:16.007196 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999668 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 21:37:16.007196 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999671 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 21:37:16.007196 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999673 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 21:37:16.007196 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:15.999676 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 21:37:16.007196 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:15.999683 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 21:37:16.007863 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.007844 2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.9" Apr 17 21:37:16.007895 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.007865 2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Apr 17 21:37:16.007922 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007917 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007923 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007926 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007929 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007933 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007936 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007939 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007942 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007945 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007948 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 21:37:16.007949 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007951 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007954 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007957 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007960 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007963 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007966 2575 feature_gate.go:328] unrecognized feature gate: Example Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007968 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007971 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007974 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007976 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007979 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007981 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007984 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007987 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007989 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007991 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007994 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007997 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.007999 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008002 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 21:37:16.008200 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008004 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008008 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008011 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008013 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008016 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008019 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008021 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008024 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008026 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008029 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008032 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008034 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008037 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008039 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008042 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008045 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008049 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008054 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008058 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 21:37:16.008697 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008063 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008066 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008069 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008072 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008075 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008078 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008080 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008083 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008086 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008089 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008091 2575 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008094 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008096 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008099 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008101 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008105 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008108 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008111 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008114 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008117 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 21:37:16.009166 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008120 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008123 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008126 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008128 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008131 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008134 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008137 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008139 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008142 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008144 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008147 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008150 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008152 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008155 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008158 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008160 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 21:37:16.009666 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008163 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.008169 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008278 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008283 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008286 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008289 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008292 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008294 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008297 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008299 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008301 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008304 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008307 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008310 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008312 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008315 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Apr 17 21:37:16.010055 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008318 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008320 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008323 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008326 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008329 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008332 2575 feature_gate.go:328] unrecognized feature gate: Example Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008335 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008337 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008340 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008344 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008348 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008351 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008353 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008356 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008359 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008361 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008364 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008366 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008369 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Apr 17 21:37:16.010457 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008371 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008374 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008376 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008378 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008381 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008383 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008386 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008388 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008391 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008394 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008397 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008400 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008402 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008406 2575 feature_gate.go:328] unrecognized feature gate: Example2 Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008408 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008411 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008413 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008416 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008419 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Apr 17 21:37:16.010932 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008421 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008424 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008427 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008429 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008432 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008435 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008437 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008440 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008442 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008445 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008449 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008452 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008455 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008458 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008461 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008463 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008465 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008468 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008471 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Apr 17 21:37:16.011400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008473 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008476 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008478 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008481 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008483 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008486 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008489 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008492 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008494 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008497 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008499 2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008502 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008505 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008507 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:16.008510 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.008515 2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Apr 17 21:37:16.011893 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.009315 2575 server.go:962] "Client rotation is on, will bootstrap in background" Apr 17 21:37:16.012279 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.011447 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Apr 17 21:37:16.012445 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.012434 2575 server.go:1019] "Starting client certificate rotation" Apr 17 21:37:16.012558 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.012531 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 21:37:16.012589 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.012584 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Apr 17 21:37:16.038615 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.038595 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 21:37:16.041369 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.041345 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Apr 17 21:37:16.059629 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.059601 2575 log.go:25] "Validated CRI v1 runtime API" Apr 17 21:37:16.065604 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.065587 2575 log.go:25] "Validated CRI v1 image API" Apr 17 21:37:16.067591 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.067575 2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Apr 17 21:37:16.068139 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.068118 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 21:37:16.072224 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.072204 2575 fs.go:135] Filesystem UUIDs: map[3ef15e6d-31d9-4a48-87e6-49d3d03e9fb2:/dev/nvme0n1p3 4da05e3b-c542-4193-bcd6-33ed29e44495:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Apr 17 21:37:16.072305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.072224 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Apr 17 21:37:16.078685 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.078575 2575 manager.go:217] Machine: {Timestamp:2026-04-17 21:37:16.076610025 +0000 UTC m=+0.417773256 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094591 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a9ba826011f76d53b5470a3c68b9d SystemUUID:ec2a9ba8-2601-1f76-d53b-5470a3c68b9d BootID:1a982cde-f7cc-48e3-8c6a-93f305c11c8f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:9d:ec:41:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:9d:ec:41:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:9b:28:8d:5d:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Apr 17 21:37:16.078685 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.078681 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Apr 17 21:37:16.078785 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.078769 2575 manager.go:233] Version: {KernelVersion:5.14.0-570.107.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260414-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Apr 17 21:37:16.079889 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.079860 2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Apr 17 21:37:16.080043 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.079892 2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Apr 17 21:37:16.080089 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.080051 2575 topology_manager.go:138] "Creating topology manager with none policy" Apr 17 21:37:16.080089 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.080059 2575 container_manager_linux.go:306] "Creating device plugin manager" Apr 17 21:37:16.080089 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.080073 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 21:37:16.081014 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.081001 2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Apr 17 21:37:16.082306 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.082295 2575 state_mem.go:36] "Initialized new in-memory state store" Apr 17 21:37:16.082420 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.082410 2575 server.go:1267] "Using root directory" path="/var/lib/kubelet" Apr 17 21:37:16.084690 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.084675 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vx2h4" Apr 17 21:37:16.084899 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.084890 2575 kubelet.go:491] "Attempting to sync node with API server" Apr 17 21:37:16.084934 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.084906 2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Apr 17 21:37:16.084934 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.084920 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Apr 17 21:37:16.084934 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.084930 2575 kubelet.go:397] "Adding apiserver pod source" Apr 17 21:37:16.085053 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.084945 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Apr 17 21:37:16.086079 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.086066 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 21:37:16.086148 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.086084 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Apr 17 21:37:16.089266 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.089250 2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.10-2.rhaos4.20.gita4d0894.el9" apiVersion="v1" Apr 17 21:37:16.089976 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.089960 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vx2h4" Apr 17 21:37:16.090592 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.090579 2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Apr 17 21:37:16.092338 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092326 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Apr 17 21:37:16.092384 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092352 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Apr 17 21:37:16.092384 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092360 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Apr 17 21:37:16.092384 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092366 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Apr 17 21:37:16.092384 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092372 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Apr 17 21:37:16.092384 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092378 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Apr 17 21:37:16.092384 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092383 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Apr 17 21:37:16.092538 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092389 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Apr 17 21:37:16.092538 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092396 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Apr 17 21:37:16.092538 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092402 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Apr 17 21:37:16.092538 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092414 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Apr 17 21:37:16.092538 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.092422 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Apr 17 21:37:16.093473 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.093456 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Apr 17 21:37:16.093473 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.093472 2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Apr 17 21:37:16.099017 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.098976 2575 watchdog_linux.go:99] "Systemd watchdog is not enabled" Apr 17 21:37:16.099216 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.099206 2575 server.go:1295] "Started kubelet" Apr 17 21:37:16.099873 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.099795 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Apr 17 21:37:16.099978 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.099881 2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Apr 17 21:37:16.100066 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.100051 2575 server_v1.go:47] "podresources" method="list" useActivePods=true Apr 17 21:37:16.100233 ip-10-0-132-175 systemd[1]: Started Kubernetes Kubelet. Apr 17 21:37:16.101862 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.101813 2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Apr 17 21:37:16.103581 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.103556 2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 21:37:16.105353 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.105337 2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-175.ec2.internal" not found Apr 17 21:37:16.108522 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.108507 2575 server.go:317] "Adding debug handlers to kubelet server" Apr 17 21:37:16.108767 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.108747 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 21:37:16.109428 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:16.109410 2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Apr 17 21:37:16.113516 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.113495 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Apr 17 21:37:16.114110 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.114096 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Apr 17 21:37:16.114975 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.114957 2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Apr 17 21:37:16.114975 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.114959 2575 factory.go:55] Registering systemd factory Apr 17 21:37:16.115117 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115005 2575 factory.go:223] Registration of the systemd container factory successfully Apr 17 21:37:16.115117 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.114958 2575 volume_manager.go:295] "The desired_state_of_world populator starts" Apr 17 21:37:16.115117 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115048 2575 volume_manager.go:297] "Starting Kubelet Volume Manager" Apr 17 21:37:16.115117 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115114 2575 reconstruct.go:97] "Volume reconstruction finished" Apr 17 21:37:16.115287 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115128 2575 reconciler.go:26] "Reconciler: start to sync state" Apr 17 21:37:16.115287 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115220 2575 factory.go:153] Registering CRI-O factory Apr 17 21:37:16.115287 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115242 2575 factory.go:223] Registration of the crio container factory successfully Apr 17 21:37:16.115287 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:16.115259 2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-175.ec2.internal\" not found" Apr 17 21:37:16.115433 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115299 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Apr 17 21:37:16.115433 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115324 2575 factory.go:103] Registering Raw factory Apr 17 21:37:16.115433 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115337 2575 manager.go:1196] Started watching for new ooms in manager Apr 17 21:37:16.116004 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.115990 2575 manager.go:319] Starting recovery of all containers Apr 17 21:37:16.116439 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.116411 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 21:37:16.118018 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:16.117996 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-175.ec2.internal\" not found" node="ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.125536 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.125362 2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-175.ec2.internal" not found Apr 17 21:37:16.126785 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.126770 2575 manager.go:324] Recovery completed Apr 17 21:37:16.131445 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.131432 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 21:37:16.134949 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.134175 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-175.ec2.internal" event="NodeHasSufficientMemory" Apr 17 21:37:16.134949 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.134211 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-175.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 21:37:16.134949 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.134234 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-175.ec2.internal" event="NodeHasSufficientPID" Apr 17 21:37:16.136368 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.136350 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Apr 17 21:37:16.136368 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.136368 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Apr 17 21:37:16.136475 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.136389 2575 state_mem.go:36] "Initialized new in-memory state store" Apr 17 21:37:16.138663 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.138646 2575 policy_none.go:49] "None policy: Start" Apr 17 21:37:16.138663 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.138662 2575 memory_manager.go:186] "Starting memorymanager" policy="None" Apr 17 21:37:16.138814 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.138672 2575 state_mem.go:35] "Initializing new in-memory state store" Apr 17 21:37:16.181253 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.181237 2575 manager.go:341] "Starting Device Plugin manager" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:16.181269 2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.181279 2575 server.go:85] "Starting device plugin registration server" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.181572 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.181585 2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.181753 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.181841 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.181851 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:16.182339 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:16.182372 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-175.ec2.internal\" not found" Apr 17 21:37:16.191163 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.183510 2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-175.ec2.internal" not found Apr 17 21:37:16.256430 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.256394 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Apr 17 21:37:16.257654 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.257634 2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Apr 17 21:37:16.257724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.257670 2575 status_manager.go:230] "Starting to sync pod status with apiserver" Apr 17 21:37:16.257724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.257701 2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Apr 17 21:37:16.257724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.257711 2575 kubelet.go:2451] "Starting kubelet main sync loop" Apr 17 21:37:16.257829 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:16.257754 2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Apr 17 21:37:16.259258 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.259240 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 21:37:16.282376 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.282355 2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Apr 17 21:37:16.283206 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.283189 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-175.ec2.internal" event="NodeHasSufficientMemory" Apr 17 21:37:16.283281 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.283221 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-175.ec2.internal" event="NodeHasNoDiskPressure" Apr 17 21:37:16.283281 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.283238 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-175.ec2.internal" event="NodeHasSufficientPID" Apr 17 21:37:16.283281 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.283272 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.291825 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.291809 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.291915 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:16.291831 2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-175.ec2.internal\": node \"ip-10-0-132-175.ec2.internal\" not found" Apr 17 21:37:16.358634 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.358581 2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal"] Apr 17 21:37:16.361005 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.360986 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.361087 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.360985 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.379054 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.379033 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.383364 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.383350 2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.404270 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.404247 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 21:37:16.406660 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.406643 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Apr 17 21:37:16.516803 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.516735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85105f29a84fa8d756a0ecf19eb1f178-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal\" (UID: \"85105f29a84fa8d756a0ecf19eb1f178\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.516803 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.516765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85105f29a84fa8d756a0ecf19eb1f178-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal\" (UID: \"85105f29a84fa8d756a0ecf19eb1f178\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.516803 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.516784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ba8082f338ee1f27e5bc360da980737-config\") pod \"kube-apiserver-proxy-ip-10-0-132-175.ec2.internal\" (UID: \"0ba8082f338ee1f27e5bc360da980737\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.617875 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.617846 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85105f29a84fa8d756a0ecf19eb1f178-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal\" (UID: \"85105f29a84fa8d756a0ecf19eb1f178\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.617875 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.617879 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85105f29a84fa8d756a0ecf19eb1f178-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal\" (UID: \"85105f29a84fa8d756a0ecf19eb1f178\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.618019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.617894 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ba8082f338ee1f27e5bc360da980737-config\") pod \"kube-apiserver-proxy-ip-10-0-132-175.ec2.internal\" (UID: \"0ba8082f338ee1f27e5bc360da980737\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.618019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.617954 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85105f29a84fa8d756a0ecf19eb1f178-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal\" (UID: \"85105f29a84fa8d756a0ecf19eb1f178\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.618019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.617997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ba8082f338ee1f27e5bc360da980737-config\") pod \"kube-apiserver-proxy-ip-10-0-132-175.ec2.internal\" (UID: \"0ba8082f338ee1f27e5bc360da980737\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.618111 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.618026 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85105f29a84fa8d756a0ecf19eb1f178-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal\" (UID: \"85105f29a84fa8d756a0ecf19eb1f178\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.707079 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.707046 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" Apr 17 21:37:16.708711 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:16.708685 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" Apr 17 21:37:17.011769 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.011746 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Apr 17 21:37:17.012409 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.011891 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 21:37:17.012409 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.011894 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 21:37:17.012409 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.011948 2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Apr 17 21:37:17.085754 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.085723 2575 apiserver.go:52] "Watching apiserver" Apr 17 21:37:17.092283 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.092248 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-04-16 21:32:16 +0000 UTC" deadline="2027-10-19 15:45:34.815935012 +0000 UTC" Apr 17 21:37:17.092283 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.092277 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13194h8m17.72366024s" Apr 17 21:37:17.093684 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.093666 2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Apr 17 21:37:17.094019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.094002 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-tb94q","kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal","openshift-cluster-node-tuning-operator/tuned-zdvfd","openshift-dns/node-resolver-xmr7n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal","openshift-multus/multus-additional-cni-plugins-7sqxl","openshift-multus/network-metrics-daemon-nj256","openshift-network-operator/iptables-alerter-9r4d2","openshift-ovn-kubernetes/ovnkube-node-wvrm9","kube-system/konnectivity-agent-7jg4t","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp","openshift-image-registry/node-ca-hlpdf","openshift-multus/multus-kgddm"] Apr 17 21:37:17.096409 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.096379 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:17.096491 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.096473 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:17.097443 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.097428 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.099334 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.098886 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.100884 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.100859 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Apr 17 21:37:17.100997 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.100885 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Apr 17 21:37:17.100997 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.100884 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqp4x\"" Apr 17 21:37:17.100997 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.100968 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.101505 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.101460 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t6ql7\"" Apr 17 21:37:17.101636 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.101621 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Apr 17 21:37:17.101752 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.101741 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Apr 17 21:37:17.102336 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.102320 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:17.102407 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.102393 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.102465 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.102398 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:17.103439 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.103420 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Apr 17 21:37:17.103537 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.103417 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Apr 17 21:37:17.103537 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.103481 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Apr 17 21:37:17.103664 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.103607 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Apr 17 21:37:17.103774 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.103760 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.103810 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.103788 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Apr 17 21:37:17.104046 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.104015 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mkjg4\"" Apr 17 21:37:17.104769 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.104744 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Apr 17 21:37:17.104885 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.104871 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Apr 17 21:37:17.104885 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.104878 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-68vhj\"" Apr 17 21:37:17.105003 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.104877 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Apr 17 21:37:17.105003 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.104999 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:17.105845 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.105826 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Apr 17 21:37:17.105950 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.105928 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Apr 17 21:37:17.105989 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.105981 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Apr 17 21:37:17.106316 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.106303 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.106868 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.106852 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Apr 17 21:37:17.106945 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.106861 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Apr 17 21:37:17.107466 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.107450 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Apr 17 21:37:17.107536 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.107484 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Apr 17 21:37:17.107674 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.107654 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mk7h2\"" Apr 17 21:37:17.107815 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.107684 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-757tt\"" Apr 17 21:37:17.107815 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.107734 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.108584 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.108565 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-shwkf\"" Apr 17 21:37:17.108584 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.108575 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Apr 17 21:37:17.108727 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.108607 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Apr 17 21:37:17.109216 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.109173 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Apr 17 21:37:17.109351 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.109333 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.109639 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.109621 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Apr 17 21:37:17.110284 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.110269 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Apr 17 21:37:17.110361 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.110305 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Apr 17 21:37:17.110361 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.110314 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Apr 17 21:37:17.110361 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.110339 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9pl4m\"" Apr 17 21:37:17.111933 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.111916 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5lft9\"" Apr 17 21:37:17.111999 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.111966 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Apr 17 21:37:17.113623 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.113607 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Apr 17 21:37:17.116485 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.116469 2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Apr 17 21:37:17.119704 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-systemd\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.119759 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-cni-bin\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.119759 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-daemon-config\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.119759 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-cnibin\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.119886 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.119886 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-run\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.119886 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-cni-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.119972 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119888 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-multus-certs\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.119972 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119935 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.120034 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.119975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysctl-conf\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.120065 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.120096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-ovnkube-config\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.120130 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120104 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-netns\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.120165 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-hosts-file\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.120198 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q42l\" (UniqueName: \"kubernetes.io/projected/acf375eb-382e-4e70-8999-46983d601f3f-kube-api-access-2q42l\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:17.120251 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120208 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95668458-8555-48b3-ad99-7cd7312a3d17-serviceca\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.120251 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-systemd\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.120319 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-sys\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.120319 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-kubelet\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.120382 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120320 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-cni-binary-copy\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.120382 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120338 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-etc-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.120382 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-tmp-dir\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.120382 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120373 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-socket-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.120494 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95668458-8555-48b3-ad99-7cd7312a3d17-host\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.120494 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-host-slash\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.120494 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120449 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-run-netns\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.120593 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-var-lib-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.120593 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-log-socket\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.120593 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-k8s-cni-cncf-io\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.120693 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-etc-selinux\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.120693 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-tuned\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.120693 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvntp\" (UniqueName: \"kubernetes.io/projected/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-kube-api-access-nvntp\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.120782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-cni-binary-copy\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.120782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-registration-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.120782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120736 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-device-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.120782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7b5\" (UniqueName: \"kubernetes.io/projected/68d599f3-227d-4454-8b21-20be54842494-kube-api-access-xr7b5\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.120782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120769 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30b798b6-20ec-4671-ab7c-f63db01270b8-ovn-node-metrics-cert\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.120937 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce77b2c3-16e4-4b59-8329-1d34893d72ff-agent-certs\") pod \"konnectivity-agent-7jg4t\" (UID: \"ce77b2c3-16e4-4b59-8329-1d34893d72ff\") " pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:17.120937 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120805 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce77b2c3-16e4-4b59-8329-1d34893d72ff-konnectivity-ca\") pod \"konnectivity-agent-7jg4t\" (UID: \"ce77b2c3-16e4-4b59-8329-1d34893d72ff\") " pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:17.120937 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120819 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-socket-dir-parent\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.120937 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-cni-multus\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121043 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-os-release\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.121043 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jp9h\" (UniqueName: \"kubernetes.io/projected/05bd8d69-b2f3-40bb-8438-b41adbd30152-kube-api-access-6jp9h\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.121043 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-node-log\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121043 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.120987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-ovnkube-script-lib\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121043 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-cni-bin\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121043 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-conf-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121206 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:17.121206 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121157 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-host\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.121206 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121174 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-slash\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121206 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-cni-netd\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121325 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cg9j\" (UniqueName: \"kubernetes.io/projected/30b798b6-20ec-4671-ab7c-f63db01270b8-kube-api-access-5cg9j\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121325 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-695hh\" (UniqueName: \"kubernetes.io/projected/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-kube-api-access-695hh\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121325 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121285 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:17.121410 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.121410 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6492h\" (UniqueName: \"kubernetes.io/projected/5ca56a41-5fef-481d-93e3-755405050744-kube-api-access-6492h\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.121410 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.121410 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121396 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-iptables-alerter-script\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.121524 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121412 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdtpl\" (UniqueName: \"kubernetes.io/projected/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-kube-api-access-kdtpl\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.121524 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121524 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-kubelet\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121524 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121477 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-hostroot\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121524 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-etc-kubernetes\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121705 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121532 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-system-cni-dir\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.121705 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-sys-fs\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.121705 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-systemd-units\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121705 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121603 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-env-overrides\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121705 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121626 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-os-release\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121705 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g822l\" (UniqueName: \"kubernetes.io/projected/95668458-8555-48b3-ad99-7cd7312a3d17-kube-api-access-g822l\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.121705 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysctl-d\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-var-lib-kubelet\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121728 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05bd8d69-b2f3-40bb-8438-b41adbd30152-tmp\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-system-cni-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-modprobe-d\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysconfig\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-lib-modules\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121853 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-ovn\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-cnibin\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.121900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.121892 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-kubernetes\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.124290 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.124273 2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Apr 17 21:37:17.160094 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.160069 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7j6sg" Apr 17 21:37:17.172199 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.172177 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7j6sg" Apr 17 21:37:17.223167 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223135 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-tuned\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.223304 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223185 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvntp\" (UniqueName: \"kubernetes.io/projected/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-kube-api-access-nvntp\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.223304 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223211 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-cni-binary-copy\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.223304 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223243 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-registration-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.223304 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223268 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-device-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.223304 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223296 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7b5\" (UniqueName: \"kubernetes.io/projected/68d599f3-227d-4454-8b21-20be54842494-kube-api-access-xr7b5\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223359 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-registration-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223390 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-device-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223408 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30b798b6-20ec-4671-ab7c-f63db01270b8-ovn-node-metrics-cert\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223442 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce77b2c3-16e4-4b59-8329-1d34893d72ff-agent-certs\") pod \"konnectivity-agent-7jg4t\" (UID: \"ce77b2c3-16e4-4b59-8329-1d34893d72ff\") " pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223467 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce77b2c3-16e4-4b59-8329-1d34893d72ff-konnectivity-ca\") pod \"konnectivity-agent-7jg4t\" (UID: \"ce77b2c3-16e4-4b59-8329-1d34893d72ff\") " pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223491 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-socket-dir-parent\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223519 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-cni-multus\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223513 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Apr 17 21:37:17.223571 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223567 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-os-release\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223594 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jp9h\" (UniqueName: \"kubernetes.io/projected/05bd8d69-b2f3-40bb-8438-b41adbd30152-kube-api-access-6jp9h\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223619 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-node-log\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223643 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-ovnkube-script-lib\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223669 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-cni-bin\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223694 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-conf-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223718 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223745 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-host\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223771 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-slash\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223795 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-cni-netd\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223820 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cg9j\" (UniqueName: \"kubernetes.io/projected/30b798b6-20ec-4671-ab7c-f63db01270b8-kube-api-access-5cg9j\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223848 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-695hh\" (UniqueName: \"kubernetes.io/projected/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-kube-api-access-695hh\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223878 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223874 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-cni-binary-copy\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223926 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-conf-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223957 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.223973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223958 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-cni-netd\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223989 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6492h\" (UniqueName: \"kubernetes.io/projected/5ca56a41-5fef-481d-93e3-755405050744-kube-api-access-6492h\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224042 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ce77b2c3-16e4-4b59-8329-1d34893d72ff-konnectivity-ca\") pod \"konnectivity-agent-7jg4t\" (UID: \"ce77b2c3-16e4-4b59-8329-1d34893d72ff\") " pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224108 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-slash\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224116 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-host\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224202 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-os-release\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224354 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-cni-bin\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.223620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-socket-dir-parent\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224396 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-node-log\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224486 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-cni-multus\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224502 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224528 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224578 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-iptables-alerter-script\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224613 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdtpl\" (UniqueName: \"kubernetes.io/projected/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-kube-api-access-kdtpl\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224629 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.224630 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224638 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224663 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-kubelet\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224685 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-hostroot\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.224691 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224708 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-etc-kubernetes\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224747 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-system-cni-dir\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.224818 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs podName:acf375eb-382e-4e70-8999-46983d601f3f nodeName:}" failed. No retries permitted until 2026-04-17 21:37:17.724764564 +0000 UTC m=+2.065927800 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs") pod "network-metrics-daemon-nj256" (UID: "acf375eb-382e-4e70-8999-46983d601f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224816 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-system-cni-dir\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224875 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-sys-fs\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224917 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-systemd-units\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224964 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-var-lib-kubelet\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-ovnkube-script-lib\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224981 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-sys-fs\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.224985 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-hostroot\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225014 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-systemd-units\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225042 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-env-overrides\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.225452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225047 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-etc-kubernetes\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225078 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-os-release\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225103 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g822l\" (UniqueName: \"kubernetes.io/projected/95668458-8555-48b3-ad99-7cd7312a3d17-kube-api-access-g822l\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225142 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysctl-d\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225176 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-var-lib-kubelet\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225203 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05bd8d69-b2f3-40bb-8438-b41adbd30152-tmp\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225248 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-os-release\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225300 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-var-lib-kubelet\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225247 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225381 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-system-cni-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysctl-d\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-modprobe-d\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225449 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-system-cni-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225455 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysconfig\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225486 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-env-overrides\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225499 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-lib-modules\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225529 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-modprobe-d\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.226313 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysconfig\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225534 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-ovn\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225590 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-ovn\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225652 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-lib-modules\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225655 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-cnibin\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225693 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-kubernetes\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225694 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-cnibin\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225730 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-kubernetes\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225722 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-systemd\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225756 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-systemd\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225767 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-cni-bin\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225793 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-daemon-config\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225808 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-cni-bin\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225817 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-cnibin\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225849 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ca56a41-5fef-481d-93e3-755405050744-cnibin\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225851 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225883 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-run\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225909 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-cni-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.227085 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225934 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-multus-certs\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.225962 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226000 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysctl-conf\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-run\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226034 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226059 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-ovnkube-config\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226085 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-netns\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226131 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-iptables-alerter-script\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226147 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-hosts-file\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226174 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q42l\" (UniqueName: \"kubernetes.io/projected/acf375eb-382e-4e70-8999-46983d601f3f-kube-api-access-2q42l\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226200 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95668458-8555-48b3-ad99-7cd7312a3d17-serviceca\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226223 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-systemd\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226243 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-sysctl-conf\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-run-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226290 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-sys\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226349 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-cni-dir\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226399 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-multus-certs\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.227796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226570 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226564 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-multus-daemon-config\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226625 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-netns\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226689 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-hosts-file\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226246 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-sys\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226734 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-kubelet\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226796 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-cni-binary-copy\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226825 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-etc-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226848 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-kubelet\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-etc-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226896 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-tmp-dir\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ca56a41-5fef-481d-93e3-755405050744-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226924 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-socket-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226944 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-systemd\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226950 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95668458-8555-48b3-ad99-7cd7312a3d17-host\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226980 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95668458-8555-48b3-ad99-7cd7312a3d17-host\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.226996 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-host-slash\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227020 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-socket-dir\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.228299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227040 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/05bd8d69-b2f3-40bb-8438-b41adbd30152-etc-tuned\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227116 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-run-netns\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227144 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-host-slash\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227209 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-host-run-netns\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227220 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-var-lib-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227256 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-log-socket\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227282 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-k8s-cni-cncf-io\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227290 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-var-lib-openvswitch\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227307 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-etc-selinux\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30b798b6-20ec-4671-ab7c-f63db01270b8-log-socket\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227377 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-host-run-k8s-cni-cncf-io\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227406 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68d599f3-227d-4454-8b21-20be54842494-etc-selinux\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227495 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05bd8d69-b2f3-40bb-8438-b41adbd30152-tmp\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227611 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/95668458-8555-48b3-ad99-7cd7312a3d17-serviceca\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227621 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-cni-binary-copy\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227646 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-tmp-dir\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227707 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30b798b6-20ec-4671-ab7c-f63db01270b8-ovnkube-config\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.227756 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ce77b2c3-16e4-4b59-8329-1d34893d72ff-agent-certs\") pod \"konnectivity-agent-7jg4t\" (UID: \"ce77b2c3-16e4-4b59-8329-1d34893d72ff\") " pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:17.228832 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.228158 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30b798b6-20ec-4671-ab7c-f63db01270b8-ovn-node-metrics-cert\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.234413 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.234136 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 21:37:17.234413 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.234165 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 21:37:17.234413 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.234180 2575 projected.go:194] Error preparing data for projected volume kube-api-access-nr7ff for pod openshift-network-diagnostics/network-check-target-tb94q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:17.234413 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.234244 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvntp\" (UniqueName: \"kubernetes.io/projected/baeb04dc-2d22-4ffb-8e04-34da91f1c68a-kube-api-access-nvntp\") pod \"node-resolver-xmr7n\" (UID: \"baeb04dc-2d22-4ffb-8e04-34da91f1c68a\") " pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.234939 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.234459 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff podName:239dc9d6-2782-48f3-82ef-7b176001f318 nodeName:}" failed. No retries permitted until 2026-04-17 21:37:17.734430579 +0000 UTC m=+2.075593801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nr7ff" (UniqueName: "kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff") pod "network-check-target-tb94q" (UID: "239dc9d6-2782-48f3-82ef-7b176001f318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:17.235614 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.235514 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdtpl\" (UniqueName: \"kubernetes.io/projected/2e87cf2f-9b8a-44ce-ba7a-196f71e84a39-kube-api-access-kdtpl\") pod \"iptables-alerter-9r4d2\" (UID: \"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39\") " pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.238841 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.236500 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g822l\" (UniqueName: \"kubernetes.io/projected/95668458-8555-48b3-ad99-7cd7312a3d17-kube-api-access-g822l\") pod \"node-ca-hlpdf\" (UID: \"95668458-8555-48b3-ad99-7cd7312a3d17\") " pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.238841 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.236742 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-695hh\" (UniqueName: \"kubernetes.io/projected/5c64ce05-7e06-41fc-9313-2b7ba52ca0c4-kube-api-access-695hh\") pod \"multus-kgddm\" (UID: \"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4\") " pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.238841 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.236859 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7b5\" (UniqueName: \"kubernetes.io/projected/68d599f3-227d-4454-8b21-20be54842494-kube-api-access-xr7b5\") pod \"aws-ebs-csi-driver-node-sd4rp\" (UID: \"68d599f3-227d-4454-8b21-20be54842494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.238841 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.236923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6492h\" (UniqueName: \"kubernetes.io/projected/5ca56a41-5fef-481d-93e3-755405050744-kube-api-access-6492h\") pod \"multus-additional-cni-plugins-7sqxl\" (UID: \"5ca56a41-5fef-481d-93e3-755405050744\") " pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.238841 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.237745 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cg9j\" (UniqueName: \"kubernetes.io/projected/30b798b6-20ec-4671-ab7c-f63db01270b8-kube-api-access-5cg9j\") pod \"ovnkube-node-wvrm9\" (UID: \"30b798b6-20ec-4671-ab7c-f63db01270b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.238841 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.237797 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jp9h\" (UniqueName: \"kubernetes.io/projected/05bd8d69-b2f3-40bb-8438-b41adbd30152-kube-api-access-6jp9h\") pod \"tuned-zdvfd\" (UID: \"05bd8d69-b2f3-40bb-8438-b41adbd30152\") " pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.240385 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.240363 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q42l\" (UniqueName: \"kubernetes.io/projected/acf375eb-382e-4e70-8999-46983d601f3f-kube-api-access-2q42l\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:17.249079 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.249060 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hlpdf" Apr 17 21:37:17.254651 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.254631 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kgddm" Apr 17 21:37:17.310163 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.310113 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85105f29a84fa8d756a0ecf19eb1f178.slice/crio-a28f0668a7c5f1cb41756f262b964315fee7fda2e6da44781be6f0c6d37d758d WatchSource:0}: Error finding container a28f0668a7c5f1cb41756f262b964315fee7fda2e6da44781be6f0c6d37d758d: Status 404 returned error can't find the container with id a28f0668a7c5f1cb41756f262b964315fee7fda2e6da44781be6f0c6d37d758d Apr 17 21:37:17.310349 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.310328 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba8082f338ee1f27e5bc360da980737.slice/crio-344901d0ea3ff87d90be0534cc331526e4c9f7a1083479e24f0dde8c94472684 WatchSource:0}: Error finding container 344901d0ea3ff87d90be0534cc331526e4c9f7a1083479e24f0dde8c94472684: Status 404 returned error can't find the container with id 344901d0ea3ff87d90be0534cc331526e4c9f7a1083479e24f0dde8c94472684 Apr 17 21:37:17.314749 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.314721 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 21:37:17.432977 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.432952 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" Apr 17 21:37:17.438402 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.438379 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bd8d69_b2f3_40bb_8438_b41adbd30152.slice/crio-ccc08e97ce5860252bf2c675792298f3fb480c4d3c98a67506d7794c6e923753 WatchSource:0}: Error finding container ccc08e97ce5860252bf2c675792298f3fb480c4d3c98a67506d7794c6e923753: Status 404 returned error can't find the container with id ccc08e97ce5860252bf2c675792298f3fb480c4d3c98a67506d7794c6e923753 Apr 17 21:37:17.441204 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.441187 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xmr7n" Apr 17 21:37:17.446732 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.446709 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaeb04dc_2d22_4ffb_8e04_34da91f1c68a.slice/crio-dc0d9514824d21ced33efacd5a9f0feb4201e249832b4ea7db76ce09f81f3db4 WatchSource:0}: Error finding container dc0d9514824d21ced33efacd5a9f0feb4201e249832b4ea7db76ce09f81f3db4: Status 404 returned error can't find the container with id dc0d9514824d21ced33efacd5a9f0feb4201e249832b4ea7db76ce09f81f3db4 Apr 17 21:37:17.466918 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.466895 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" Apr 17 21:37:17.473372 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.473350 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca56a41_5fef_481d_93e3_755405050744.slice/crio-f7a30d2fbbb7596c85ebb930313e83ba6083d53719cfec72ac9ebedfd717aab6 WatchSource:0}: Error finding container f7a30d2fbbb7596c85ebb930313e83ba6083d53719cfec72ac9ebedfd717aab6: Status 404 returned error can't find the container with id f7a30d2fbbb7596c85ebb930313e83ba6083d53719cfec72ac9ebedfd717aab6 Apr 17 21:37:17.480865 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.480845 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9r4d2" Apr 17 21:37:17.487117 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.487091 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e87cf2f_9b8a_44ce_ba7a_196f71e84a39.slice/crio-bfbba7b1c0fc9b35d7f01e58099c8065b4a5592dd03f7ee851fe6b5fb13a7cc0 WatchSource:0}: Error finding container bfbba7b1c0fc9b35d7f01e58099c8065b4a5592dd03f7ee851fe6b5fb13a7cc0: Status 404 returned error can't find the container with id bfbba7b1c0fc9b35d7f01e58099c8065b4a5592dd03f7ee851fe6b5fb13a7cc0 Apr 17 21:37:17.493617 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.493600 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:17.499478 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.499454 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:17.500088 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.500060 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b798b6_20ec_4671_ab7c_f63db01270b8.slice/crio-5b75f171798dfd90d098fc19c55d4aa7a91b42f203e78460f974b68d6a5646d4 WatchSource:0}: Error finding container 5b75f171798dfd90d098fc19c55d4aa7a91b42f203e78460f974b68d6a5646d4: Status 404 returned error can't find the container with id 5b75f171798dfd90d098fc19c55d4aa7a91b42f203e78460f974b68d6a5646d4 Apr 17 21:37:17.504755 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.504725 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" Apr 17 21:37:17.505781 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.505756 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce77b2c3_16e4_4b59_8329_1d34893d72ff.slice/crio-d68f91e26c0ec4700ac9c5361cb8bff16cb0e65d68ad43dad5279abb73a9e2cb WatchSource:0}: Error finding container d68f91e26c0ec4700ac9c5361cb8bff16cb0e65d68ad43dad5279abb73a9e2cb: Status 404 returned error can't find the container with id d68f91e26c0ec4700ac9c5361cb8bff16cb0e65d68ad43dad5279abb73a9e2cb Apr 17 21:37:17.512931 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.512907 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d599f3_227d_4454_8b21_20be54842494.slice/crio-66b06116a98bb853fdb588cfd9a45160c5db0580de521d88d5c375734d417395 WatchSource:0}: Error finding container 66b06116a98bb853fdb588cfd9a45160c5db0580de521d88d5c375734d417395: Status 404 returned error can't find the container with id 66b06116a98bb853fdb588cfd9a45160c5db0580de521d88d5c375734d417395 Apr 17 21:37:17.608887 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.608858 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95668458_8555_48b3_ad99_7cd7312a3d17.slice/crio-c3bd4c8f664e6a36d38c861c32a1a6f652d271ea09d1e226d4c25b8c3b75d17c WatchSource:0}: Error finding container c3bd4c8f664e6a36d38c861c32a1a6f652d271ea09d1e226d4c25b8c3b75d17c: Status 404 returned error can't find the container with id c3bd4c8f664e6a36d38c861c32a1a6f652d271ea09d1e226d4c25b8c3b75d17c Apr 17 21:37:17.730979 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.730943 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:17.731196 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.731098 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:17.731196 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.731166 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs podName:acf375eb-382e-4e70-8999-46983d601f3f nodeName:}" failed. No retries permitted until 2026-04-17 21:37:18.73114686 +0000 UTC m=+3.072310097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs") pod "network-metrics-daemon-nj256" (UID: "acf375eb-382e-4e70-8999-46983d601f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:17.767067 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:17.767031 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c64ce05_7e06_41fc_9313_2b7ba52ca0c4.slice/crio-5617ec67a6f79a709263df5ea660a808748a332f2cd9a81756c67fe5ddc92b61 WatchSource:0}: Error finding container 5617ec67a6f79a709263df5ea660a808748a332f2cd9a81756c67fe5ddc92b61: Status 404 returned error can't find the container with id 5617ec67a6f79a709263df5ea660a808748a332f2cd9a81756c67fe5ddc92b61 Apr 17 21:37:17.825122 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.824813 2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 21:37:17.832512 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:17.832344 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:17.832670 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.832530 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 21:37:17.832670 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.832566 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 21:37:17.832670 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.832579 2575 projected.go:194] Error preparing data for projected volume kube-api-access-nr7ff for pod openshift-network-diagnostics/network-check-target-tb94q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:17.832670 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:17.832641 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff podName:239dc9d6-2782-48f3-82ef-7b176001f318 nodeName:}" failed. No retries permitted until 2026-04-17 21:37:18.832621466 +0000 UTC m=+3.173784686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nr7ff" (UniqueName: "kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff") pod "network-check-target-tb94q" (UID: "239dc9d6-2782-48f3-82ef-7b176001f318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:18.173777 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.173677 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 21:32:17 +0000 UTC" deadline="2027-10-28 05:54:29.351891289 +0000 UTC" Apr 17 21:37:18.173777 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.173717 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13400h17m11.178178441s" Apr 17 21:37:18.244300 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.244268 2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 21:37:18.260722 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.260691 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:18.260883 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:18.260834 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:18.265185 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.265159 2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Apr 17 21:37:18.274970 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.274912 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" event={"ID":"0ba8082f338ee1f27e5bc360da980737","Type":"ContainerStarted","Data":"344901d0ea3ff87d90be0534cc331526e4c9f7a1083479e24f0dde8c94472684"} Apr 17 21:37:18.285508 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.285476 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7jg4t" event={"ID":"ce77b2c3-16e4-4b59-8329-1d34893d72ff","Type":"ContainerStarted","Data":"d68f91e26c0ec4700ac9c5361cb8bff16cb0e65d68ad43dad5279abb73a9e2cb"} Apr 17 21:37:18.304289 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.304255 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"5b75f171798dfd90d098fc19c55d4aa7a91b42f203e78460f974b68d6a5646d4"} Apr 17 21:37:18.314135 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.314104 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9r4d2" event={"ID":"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39","Type":"ContainerStarted","Data":"bfbba7b1c0fc9b35d7f01e58099c8065b4a5592dd03f7ee851fe6b5fb13a7cc0"} Apr 17 21:37:18.328734 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.328671 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmr7n" event={"ID":"baeb04dc-2d22-4ffb-8e04-34da91f1c68a","Type":"ContainerStarted","Data":"dc0d9514824d21ced33efacd5a9f0feb4201e249832b4ea7db76ce09f81f3db4"} Apr 17 21:37:18.340281 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.340251 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" event={"ID":"05bd8d69-b2f3-40bb-8438-b41adbd30152","Type":"ContainerStarted","Data":"ccc08e97ce5860252bf2c675792298f3fb480c4d3c98a67506d7794c6e923753"} Apr 17 21:37:18.355728 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.355697 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" event={"ID":"85105f29a84fa8d756a0ecf19eb1f178","Type":"ContainerStarted","Data":"a28f0668a7c5f1cb41756f262b964315fee7fda2e6da44781be6f0c6d37d758d"} Apr 17 21:37:18.375359 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.375286 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kgddm" event={"ID":"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4","Type":"ContainerStarted","Data":"5617ec67a6f79a709263df5ea660a808748a332f2cd9a81756c67fe5ddc92b61"} Apr 17 21:37:18.385664 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.385628 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hlpdf" event={"ID":"95668458-8555-48b3-ad99-7cd7312a3d17","Type":"ContainerStarted","Data":"c3bd4c8f664e6a36d38c861c32a1a6f652d271ea09d1e226d4c25b8c3b75d17c"} Apr 17 21:37:18.398207 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.398134 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" event={"ID":"68d599f3-227d-4454-8b21-20be54842494","Type":"ContainerStarted","Data":"66b06116a98bb853fdb588cfd9a45160c5db0580de521d88d5c375734d417395"} Apr 17 21:37:18.409042 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.408995 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" event={"ID":"5ca56a41-5fef-481d-93e3-755405050744","Type":"ContainerStarted","Data":"f7a30d2fbbb7596c85ebb930313e83ba6083d53719cfec72ac9ebedfd717aab6"} Apr 17 21:37:18.740849 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.740195 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:18.740849 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:18.740393 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:18.740849 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:18.740464 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs podName:acf375eb-382e-4e70-8999-46983d601f3f nodeName:}" failed. No retries permitted until 2026-04-17 21:37:20.740444356 +0000 UTC m=+5.081607582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs") pod "network-metrics-daemon-nj256" (UID: "acf375eb-382e-4e70-8999-46983d601f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:18.840871 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:18.840829 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:18.841039 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:18.841009 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 21:37:18.841039 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:18.841029 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 21:37:18.841139 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:18.841043 2575 projected.go:194] Error preparing data for projected volume kube-api-access-nr7ff for pod openshift-network-diagnostics/network-check-target-tb94q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:18.841139 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:18.841103 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff podName:239dc9d6-2782-48f3-82ef-7b176001f318 nodeName:}" failed. No retries permitted until 2026-04-17 21:37:20.841084984 +0000 UTC m=+5.182248202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nr7ff" (UniqueName: "kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff") pod "network-check-target-tb94q" (UID: "239dc9d6-2782-48f3-82ef-7b176001f318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:19.174634 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:19.174561 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-04-16 21:32:17 +0000 UTC" deadline="2027-11-10 11:03:58.913103987 +0000 UTC" Apr 17 21:37:19.174634 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:19.174600 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13717h26m39.738508091s" Apr 17 21:37:19.258370 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:19.258312 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:19.258535 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:19.258466 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:20.259007 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:20.258468 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:20.259007 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:20.258629 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:20.758415 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:20.758378 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:20.758724 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:20.758693 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:20.758806 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:20.758795 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs podName:acf375eb-382e-4e70-8999-46983d601f3f nodeName:}" failed. No retries permitted until 2026-04-17 21:37:24.758770485 +0000 UTC m=+9.099933784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs") pod "network-metrics-daemon-nj256" (UID: "acf375eb-382e-4e70-8999-46983d601f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:20.859285 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:20.859245 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:20.859481 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:20.859403 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 21:37:20.859481 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:20.859434 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 21:37:20.859481 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:20.859448 2575 projected.go:194] Error preparing data for projected volume kube-api-access-nr7ff for pod openshift-network-diagnostics/network-check-target-tb94q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:20.859700 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:20.859514 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff podName:239dc9d6-2782-48f3-82ef-7b176001f318 nodeName:}" failed. No retries permitted until 2026-04-17 21:37:24.85949352 +0000 UTC m=+9.200656759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nr7ff" (UniqueName: "kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff") pod "network-check-target-tb94q" (UID: "239dc9d6-2782-48f3-82ef-7b176001f318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:21.258124 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:21.258068 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:21.258294 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:21.258205 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:22.262279 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:22.261998 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:22.262752 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:22.262368 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:23.258388 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:23.258348 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:23.258578 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:23.258479 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:24.258861 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:24.258714 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:24.259318 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:24.258860 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:24.792897 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:24.792865 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:24.793063 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:24.793036 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:24.793140 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:24.793126 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs podName:acf375eb-382e-4e70-8999-46983d601f3f nodeName:}" failed. No retries permitted until 2026-04-17 21:37:32.793104061 +0000 UTC m=+17.134267278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs") pod "network-metrics-daemon-nj256" (UID: "acf375eb-382e-4e70-8999-46983d601f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:24.894070 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:24.894032 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:24.894250 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:24.894226 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 21:37:24.894311 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:24.894254 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 21:37:24.894311 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:24.894267 2575 projected.go:194] Error preparing data for projected volume kube-api-access-nr7ff for pod openshift-network-diagnostics/network-check-target-tb94q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:24.894415 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:24.894335 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff podName:239dc9d6-2782-48f3-82ef-7b176001f318 nodeName:}" failed. No retries permitted until 2026-04-17 21:37:32.894315318 +0000 UTC m=+17.235478536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nr7ff" (UniqueName: "kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff") pod "network-check-target-tb94q" (UID: "239dc9d6-2782-48f3-82ef-7b176001f318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:25.258880 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:25.258853 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:25.259366 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:25.258988 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:26.258652 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:26.258615 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:26.258870 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:26.258756 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:27.258408 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:27.258372 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:27.258859 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:27.258511 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:28.258052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:28.258018 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:28.258206 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:28.258165 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:29.258633 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:29.258602 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:29.259084 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:29.258716 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:30.258751 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:30.258712 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:30.259174 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:30.258863 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:31.258139 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:31.258101 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:31.258322 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:31.258226 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:32.258894 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:32.258858 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:32.259358 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:32.259011 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:32.847381 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:32.847344 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:32.847637 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:32.847534 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:32.847637 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:32.847635 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs podName:acf375eb-382e-4e70-8999-46983d601f3f nodeName:}" failed. No retries permitted until 2026-04-17 21:37:48.847610814 +0000 UTC m=+33.188774044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs") pod "network-metrics-daemon-nj256" (UID: "acf375eb-382e-4e70-8999-46983d601f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:32.948040 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:32.948001 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:32.948226 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:32.948148 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 21:37:32.948226 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:32.948170 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 21:37:32.948226 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:32.948182 2575 projected.go:194] Error preparing data for projected volume kube-api-access-nr7ff for pod openshift-network-diagnostics/network-check-target-tb94q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:32.948380 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:32.948246 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff podName:239dc9d6-2782-48f3-82ef-7b176001f318 nodeName:}" failed. No retries permitted until 2026-04-17 21:37:48.948227201 +0000 UTC m=+33.289390434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nr7ff" (UniqueName: "kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff") pod "network-check-target-tb94q" (UID: "239dc9d6-2782-48f3-82ef-7b176001f318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:33.258600 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:33.258575 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:33.258771 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:33.258688 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:34.258493 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:34.258445 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:34.258924 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:34.258588 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:35.258451 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:35.258419 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:35.258647 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:35.258538 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:36.259452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.259421 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:36.259931 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:36.259518 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:36.444758 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.444486 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" event={"ID":"05bd8d69-b2f3-40bb-8438-b41adbd30152","Type":"ContainerStarted","Data":"f829e638b7f89e73858ced9ca84069c1bc5985bdbe5b8b1c9b6eb9f2f84b567f"} Apr 17 21:37:36.446248 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.446180 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kgddm" event={"ID":"5c64ce05-7e06-41fc-9313-2b7ba52ca0c4","Type":"ContainerStarted","Data":"f6fbad1127ade24a0028b6fce1d6112a2364bd6e5d84cae33abcec100b184fc2"} Apr 17 21:37:36.447828 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.447785 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" event={"ID":"0ba8082f338ee1f27e5bc360da980737","Type":"ContainerStarted","Data":"89883f970f57800d960e0d0ac6d4d65c380f7367cce177d441e10c4ba3ade20e"} Apr 17 21:37:36.450233 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.450197 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"68e0a1b70d32c8705bb7bf6dcda36d8063c3a4eaecad66080be180591df55f77"} Apr 17 21:37:36.450233 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.450228 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"ec7faaf6a83ed2c6faa15691c3b87c897cf75c0a336f0f496043ea97c01b5941"} Apr 17 21:37:36.459728 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.459685 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zdvfd" podStartSLOduration=2.110563122 podStartE2EDuration="20.459673108s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.439875896 +0000 UTC m=+1.781039111" lastFinishedPulling="2026-04-17 21:37:35.788985866 +0000 UTC m=+20.130149097" observedRunningTime="2026-04-17 21:37:36.459533241 +0000 UTC m=+20.800696480" watchObservedRunningTime="2026-04-17 21:37:36.459673108 +0000 UTC m=+20.800836345" Apr 17 21:37:36.487299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.487229 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-kgddm" podStartSLOduration=2.415127885 podStartE2EDuration="20.487209792s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.769265538 +0000 UTC m=+2.110428755" lastFinishedPulling="2026-04-17 21:37:35.841347444 +0000 UTC m=+20.182510662" observedRunningTime="2026-04-17 21:37:36.486686184 +0000 UTC m=+20.827849423" watchObservedRunningTime="2026-04-17 21:37:36.487209792 +0000 UTC m=+20.828373030" Apr 17 21:37:36.487456 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:36.487433 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-175.ec2.internal" podStartSLOduration=20.487423044 podStartE2EDuration="20.487423044s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 21:37:36.47174306 +0000 UTC m=+20.812906296" watchObservedRunningTime="2026-04-17 21:37:36.487423044 +0000 UTC m=+20.828586283" Apr 17 21:37:37.258621 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.258593 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:37.258765 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:37.258716 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:37.453652 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.453614 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7jg4t" event={"ID":"ce77b2c3-16e4-4b59-8329-1d34893d72ff","Type":"ContainerStarted","Data":"7da3fd8e855890e1c68d5d883128c8093c33a66f403b5688d49fa6799901c03f"} Apr 17 21:37:37.457057 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.457026 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"c400502d8f50345e542bc03b90b08bb34368038a9e92a62d178e3f11fa397e09"} Apr 17 21:37:37.457248 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.457063 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"4e40f96d1dcd71d12c8257b6d1eb07840c02af95a6ff871ea5439311625da899"} Apr 17 21:37:37.457248 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.457078 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"56d466e596eb150a0d31144eb02a47ee6da3e8236456b7545e43914c96422817"} Apr 17 21:37:37.457248 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.457090 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"4aee7521c04a159e492e3d765b994d9a1328c06f6761b93cf31ea749bb19e532"} Apr 17 21:37:37.458505 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.458477 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xmr7n" event={"ID":"baeb04dc-2d22-4ffb-8e04-34da91f1c68a","Type":"ContainerStarted","Data":"4a2a7094dcdb6c43dd04f632966c0f280f79711526c67b53ee9211298913cfb1"} Apr 17 21:37:37.459981 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.459954 2575 generic.go:358] "Generic (PLEG): container finished" podID="85105f29a84fa8d756a0ecf19eb1f178" containerID="c1401fbf9ccd10b1df09abdd81d2afd8a8884519050ec778b1404f2272bbf666" exitCode=0 Apr 17 21:37:37.460081 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.460050 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" event={"ID":"85105f29a84fa8d756a0ecf19eb1f178","Type":"ContainerDied","Data":"c1401fbf9ccd10b1df09abdd81d2afd8a8884519050ec778b1404f2272bbf666"} Apr 17 21:37:37.461476 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.461454 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hlpdf" event={"ID":"95668458-8555-48b3-ad99-7cd7312a3d17","Type":"ContainerStarted","Data":"72d985947e75ce372c7c445b1d816f3a36d5ac47204a5f1d75cb88cc03ee04a7"} Apr 17 21:37:37.462908 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.462879 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" event={"ID":"68d599f3-227d-4454-8b21-20be54842494","Type":"ContainerStarted","Data":"8b72bb4bf2e29097c6e4955d5b12369a128c3306bae192f5b2b0e5e2b448c728"} Apr 17 21:37:37.464358 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.464334 2575 generic.go:358] "Generic (PLEG): container finished" podID="5ca56a41-5fef-481d-93e3-755405050744" containerID="4f6e3b4b6cbbb1bc682d93c9bf1d567fb732087bc2b0c6c4b3a2fbe5778a4e19" exitCode=0 Apr 17 21:37:37.464463 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.464442 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" event={"ID":"5ca56a41-5fef-481d-93e3-755405050744","Type":"ContainerDied","Data":"4f6e3b4b6cbbb1bc682d93c9bf1d567fb732087bc2b0c6c4b3a2fbe5778a4e19"} Apr 17 21:37:37.468928 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.468893 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7jg4t" podStartSLOduration=3.555755212 podStartE2EDuration="21.46888188s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.508997976 +0000 UTC m=+1.850161193" lastFinishedPulling="2026-04-17 21:37:35.42212463 +0000 UTC m=+19.763287861" observedRunningTime="2026-04-17 21:37:37.468438011 +0000 UTC m=+21.809601248" watchObservedRunningTime="2026-04-17 21:37:37.46888188 +0000 UTC m=+21.810045118" Apr 17 21:37:37.497968 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.497939 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:37.498855 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.498808 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:37.517301 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.517195 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-xmr7n" podStartSLOduration=3.176348159 podStartE2EDuration="21.517175068s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.448157958 +0000 UTC m=+1.789321178" lastFinishedPulling="2026-04-17 21:37:35.788984855 +0000 UTC m=+20.130148087" observedRunningTime="2026-04-17 21:37:37.495400373 +0000 UTC m=+21.836563610" watchObservedRunningTime="2026-04-17 21:37:37.517175068 +0000 UTC m=+21.858338306" Apr 17 21:37:37.530238 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.530185 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hlpdf" podStartSLOduration=3.308721832 podStartE2EDuration="21.530167341s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.610384208 +0000 UTC m=+1.951547423" lastFinishedPulling="2026-04-17 21:37:35.831829717 +0000 UTC m=+20.172992932" observedRunningTime="2026-04-17 21:37:37.529902598 +0000 UTC m=+21.871065837" watchObservedRunningTime="2026-04-17 21:37:37.530167341 +0000 UTC m=+21.871330581" Apr 17 21:37:37.842899 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:37.842872 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Apr 17 21:37:38.192402 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.192232 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-04-17T21:37:37.842895686Z","UUID":"7a80a0d1-1815-4197-a822-f2d528beacd5","Handler":null,"Name":"","Endpoint":""} Apr 17 21:37:38.195138 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.194736 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Apr 17 21:37:38.195138 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.194768 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Apr 17 21:37:38.258442 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.258408 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:38.258620 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:38.258569 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:38.468892 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.468802 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" event={"ID":"68d599f3-227d-4454-8b21-20be54842494","Type":"ContainerStarted","Data":"4e940cb6dcf90bd50f319c0327a4adb6442c020a4e282733085718ba87c4eda7"} Apr 17 21:37:38.470497 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.470464 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9r4d2" event={"ID":"2e87cf2f-9b8a-44ce-ba7a-196f71e84a39","Type":"ContainerStarted","Data":"6a4e18a967ac93fe7d63c18a281a7604a047c1059244a416eeafe151ae93e75f"} Apr 17 21:37:38.472627 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.472512 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" event={"ID":"85105f29a84fa8d756a0ecf19eb1f178","Type":"ContainerStarted","Data":"6a5cb28fa274e7a6354b3dd3742b2d781a0fd873c98b04be31f3b428b2424e1c"} Apr 17 21:37:38.473283 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.473253 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:38.473851 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.473829 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7jg4t" Apr 17 21:37:38.484344 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:38.484291 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9r4d2" podStartSLOduration=4.141627232 podStartE2EDuration="22.484275507s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.489168244 +0000 UTC m=+1.830331463" lastFinishedPulling="2026-04-17 21:37:35.831816508 +0000 UTC m=+20.172979738" observedRunningTime="2026-04-17 21:37:38.484027455 +0000 UTC m=+22.825190708" watchObservedRunningTime="2026-04-17 21:37:38.484275507 +0000 UTC m=+22.825438745" Apr 17 21:37:39.257896 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:39.257864 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:39.258069 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:39.257977 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:39.478652 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:39.478617 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" event={"ID":"68d599f3-227d-4454-8b21-20be54842494","Type":"ContainerStarted","Data":"4305ac8dd615496c5f6759194bfa7da7b38001176cc11104349992b2bb2282cb"} Apr 17 21:37:39.481585 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:39.481532 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"7816f9af730fed82b0ba3e63794f54be820ae65d051c5bc27f0e3772b5ac728a"} Apr 17 21:37:39.496853 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:39.496813 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-175.ec2.internal" podStartSLOduration=23.496800558 podStartE2EDuration="23.496800558s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 21:37:38.512293242 +0000 UTC m=+22.853456483" watchObservedRunningTime="2026-04-17 21:37:39.496800558 +0000 UTC m=+23.837963796" Apr 17 21:37:39.497288 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:39.497259 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sd4rp" podStartSLOduration=2.39670058 podStartE2EDuration="23.497250868s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.514650177 +0000 UTC m=+1.855813394" lastFinishedPulling="2026-04-17 21:37:38.615200461 +0000 UTC m=+22.956363682" observedRunningTime="2026-04-17 21:37:39.496618068 +0000 UTC m=+23.837781306" watchObservedRunningTime="2026-04-17 21:37:39.497250868 +0000 UTC m=+23.838414106" Apr 17 21:37:40.258176 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:40.258142 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:40.258365 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:40.258282 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:41.258927 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:41.258901 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:41.259344 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:41.259029 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:42.259326 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:42.258864 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:42.259326 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:42.259184 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:42.490725 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:42.490696 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" event={"ID":"30b798b6-20ec-4671-ab7c-f63db01270b8","Type":"ContainerStarted","Data":"e18f068e78c7d2d5a884a6da36663990aec79ef4cb3e27cb594b6b03d93b9660"} Apr 17 21:37:42.490997 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:42.490982 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:42.491062 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:42.491003 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:42.505326 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:42.505297 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:42.518222 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:42.517258 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" podStartSLOduration=7.7438694980000005 podStartE2EDuration="26.517239308s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.502262141 +0000 UTC m=+1.843425357" lastFinishedPulling="2026-04-17 21:37:36.275631944 +0000 UTC m=+20.616795167" observedRunningTime="2026-04-17 21:37:42.515345916 +0000 UTC m=+26.856509154" watchObservedRunningTime="2026-04-17 21:37:42.517239308 +0000 UTC m=+26.858402547" Apr 17 21:37:43.258895 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:43.258701 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:43.259073 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:43.258975 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:43.494606 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:43.494516 2575 generic.go:358] "Generic (PLEG): container finished" podID="5ca56a41-5fef-481d-93e3-755405050744" containerID="58260905b43d0f49e3cfc236ee05134553158c53147d0f73819926da5673f10a" exitCode=0 Apr 17 21:37:43.494606 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:43.494594 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" event={"ID":"5ca56a41-5fef-481d-93e3-755405050744","Type":"ContainerDied","Data":"58260905b43d0f49e3cfc236ee05134553158c53147d0f73819926da5673f10a"} Apr 17 21:37:43.495890 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:43.495423 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:43.521653 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:43.521429 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:37:44.165142 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:44.165108 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nj256"] Apr 17 21:37:44.165388 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:44.165273 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:44.165456 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:44.165428 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:44.167694 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:44.167431 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tb94q"] Apr 17 21:37:44.167694 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:44.167514 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:44.167694 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:44.167623 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:45.258135 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:45.258106 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:45.258600 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:45.258265 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:45.499826 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:45.499740 2575 generic.go:358] "Generic (PLEG): container finished" podID="5ca56a41-5fef-481d-93e3-755405050744" containerID="2076fd55b9c7802643a2390decd059def9544285b929d8fc8fe99d765685add0" exitCode=0 Apr 17 21:37:45.499997 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:45.499833 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" event={"ID":"5ca56a41-5fef-481d-93e3-755405050744","Type":"ContainerDied","Data":"2076fd55b9c7802643a2390decd059def9544285b929d8fc8fe99d765685add0"} Apr 17 21:37:46.258821 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:46.258789 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:46.259153 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:46.258872 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:46.504065 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:46.504033 2575 generic.go:358] "Generic (PLEG): container finished" podID="5ca56a41-5fef-481d-93e3-755405050744" containerID="c0a56fb78d151ecd555bd85dee5ace42e616c089943cc77e51042e3f6a7ff1bf" exitCode=0 Apr 17 21:37:46.504212 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:46.504092 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" event={"ID":"5ca56a41-5fef-481d-93e3-755405050744","Type":"ContainerDied","Data":"c0a56fb78d151ecd555bd85dee5ace42e616c089943cc77e51042e3f6a7ff1bf"} Apr 17 21:37:47.258507 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:47.258256 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:47.258677 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:47.258651 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj256" podUID="acf375eb-382e-4e70-8999-46983d601f3f" Apr 17 21:37:48.258237 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:48.258198 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:48.258721 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:48.258335 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb94q" podUID="239dc9d6-2782-48f3-82ef-7b176001f318" Apr 17 21:37:48.868219 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:48.868188 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:48.868399 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:48.868347 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:48.868461 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:48.868419 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs podName:acf375eb-382e-4e70-8999-46983d601f3f nodeName:}" failed. No retries permitted until 2026-04-17 21:38:20.868396621 +0000 UTC m=+65.209559852 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs") pod "network-metrics-daemon-nj256" (UID: "acf375eb-382e-4e70-8999-46983d601f3f") : object "openshift-multus"/"metrics-daemon-secret" not registered Apr 17 21:37:48.961661 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:48.961585 2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-175.ec2.internal" event="NodeReady" Apr 17 21:37:48.961815 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:48.961741 2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Apr 17 21:37:48.968599 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:48.968573 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:48.968744 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:48.968716 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Apr 17 21:37:48.968744 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:48.968733 2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Apr 17 21:37:48.968744 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:48.968742 2575 projected.go:194] Error preparing data for projected volume kube-api-access-nr7ff for pod openshift-network-diagnostics/network-check-target-tb94q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:48.968892 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:37:48.968795 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff podName:239dc9d6-2782-48f3-82ef-7b176001f318 nodeName:}" failed. No retries permitted until 2026-04-17 21:38:20.968778398 +0000 UTC m=+65.309941630 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nr7ff" (UniqueName: "kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff") pod "network-check-target-tb94q" (UID: "239dc9d6-2782-48f3-82ef-7b176001f318") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Apr 17 21:37:49.005957 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.005930 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-925tc"] Apr 17 21:37:49.010427 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.010406 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s2kln"] Apr 17 21:37:49.010587 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.010568 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-925tc" Apr 17 21:37:49.013235 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.013208 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Apr 17 21:37:49.013419 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.013394 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Apr 17 21:37:49.013520 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.013461 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Apr 17 21:37:49.013606 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.013567 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-m9tzd\"" Apr 17 21:37:49.014400 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.014379 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.016563 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.016525 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Apr 17 21:37:49.016785 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.016764 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Apr 17 21:37:49.016885 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.016839 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z6th7\"" Apr 17 21:37:49.016945 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.016906 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Apr 17 21:37:49.016999 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.016958 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Apr 17 21:37:49.022724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.022690 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-925tc"] Apr 17 21:37:49.023220 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.023186 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s2kln"] Apr 17 21:37:49.069105 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.069066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s88r2\" (UniqueName: \"kubernetes.io/projected/0762a6a9-50ab-41b1-b029-2a12a45708fd-kube-api-access-s88r2\") pod \"ingress-canary-925tc\" (UID: \"0762a6a9-50ab-41b1-b029-2a12a45708fd\") " pod="openshift-ingress-canary/ingress-canary-925tc" Apr 17 21:37:49.069105 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.069105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0762a6a9-50ab-41b1-b029-2a12a45708fd-cert\") pod \"ingress-canary-925tc\" (UID: \"0762a6a9-50ab-41b1-b029-2a12a45708fd\") " pod="openshift-ingress-canary/ingress-canary-925tc" Apr 17 21:37:49.105500 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.105471 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kj82w"] Apr 17 21:37:49.108598 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.108576 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.111136 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.111082 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Apr 17 21:37:49.111136 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.111113 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wjbk2\"" Apr 17 21:37:49.111322 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.111244 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Apr 17 21:37:49.117923 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.117872 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kj82w"] Apr 17 21:37:49.169564 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169512 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/127e564e-bab1-48ad-a3cb-f4a23e099acf-data-volume\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.169714 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-config-volume\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.169714 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169657 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-metrics-tls\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.169714 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/127e564e-bab1-48ad-a3cb-f4a23e099acf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.169714 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169704 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/127e564e-bab1-48ad-a3cb-f4a23e099acf-crio-socket\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.169857 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-tmp-dir\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.169857 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djww7\" (UniqueName: \"kubernetes.io/projected/127e564e-bab1-48ad-a3cb-f4a23e099acf-kube-api-access-djww7\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.169857 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vtj\" (UniqueName: \"kubernetes.io/projected/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-kube-api-access-j5vtj\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.169857 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/127e564e-bab1-48ad-a3cb-f4a23e099acf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.169993 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169882 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s88r2\" (UniqueName: \"kubernetes.io/projected/0762a6a9-50ab-41b1-b029-2a12a45708fd-kube-api-access-s88r2\") pod \"ingress-canary-925tc\" (UID: \"0762a6a9-50ab-41b1-b029-2a12a45708fd\") " pod="openshift-ingress-canary/ingress-canary-925tc" Apr 17 21:37:49.169993 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.169903 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0762a6a9-50ab-41b1-b029-2a12a45708fd-cert\") pod \"ingress-canary-925tc\" (UID: \"0762a6a9-50ab-41b1-b029-2a12a45708fd\") " pod="openshift-ingress-canary/ingress-canary-925tc" Apr 17 21:37:49.174337 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.174308 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0762a6a9-50ab-41b1-b029-2a12a45708fd-cert\") pod \"ingress-canary-925tc\" (UID: \"0762a6a9-50ab-41b1-b029-2a12a45708fd\") " pod="openshift-ingress-canary/ingress-canary-925tc" Apr 17 21:37:49.180561 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.180527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s88r2\" (UniqueName: \"kubernetes.io/projected/0762a6a9-50ab-41b1-b029-2a12a45708fd-kube-api-access-s88r2\") pod \"ingress-canary-925tc\" (UID: \"0762a6a9-50ab-41b1-b029-2a12a45708fd\") " pod="openshift-ingress-canary/ingress-canary-925tc" Apr 17 21:37:49.258769 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.258743 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:37:49.261484 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.261463 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 21:37:49.261681 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.261502 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlncx\"" Apr 17 21:37:49.270973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.270953 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djww7\" (UniqueName: \"kubernetes.io/projected/127e564e-bab1-48ad-a3cb-f4a23e099acf-kube-api-access-djww7\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.271071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.270980 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vtj\" (UniqueName: \"kubernetes.io/projected/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-kube-api-access-j5vtj\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.271071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271004 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/127e564e-bab1-48ad-a3cb-f4a23e099acf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.271071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271032 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/127e564e-bab1-48ad-a3cb-f4a23e099acf-data-volume\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.271071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271049 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-config-volume\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.271271 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271087 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-metrics-tls\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.271271 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271114 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/127e564e-bab1-48ad-a3cb-f4a23e099acf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.271271 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271143 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/127e564e-bab1-48ad-a3cb-f4a23e099acf-crio-socket\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.271271 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271168 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-tmp-dir\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.271435 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271351 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/127e564e-bab1-48ad-a3cb-f4a23e099acf-crio-socket\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.271493 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/127e564e-bab1-48ad-a3cb-f4a23e099acf-data-volume\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.271610 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271588 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-tmp-dir\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.271743 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271727 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-config-volume\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.271797 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.271779 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/127e564e-bab1-48ad-a3cb-f4a23e099acf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.273279 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.273259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/127e564e-bab1-48ad-a3cb-f4a23e099acf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.273589 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.273571 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-metrics-tls\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.278472 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.278446 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djww7\" (UniqueName: \"kubernetes.io/projected/127e564e-bab1-48ad-a3cb-f4a23e099acf-kube-api-access-djww7\") pod \"insights-runtime-extractor-s2kln\" (UID: \"127e564e-bab1-48ad-a3cb-f4a23e099acf\") " pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.278604 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.278589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vtj\" (UniqueName: \"kubernetes.io/projected/5e3a6237-2706-4d1d-ac8c-b075f011d7a0-kube-api-access-j5vtj\") pod \"dns-default-kj82w\" (UID: \"5e3a6237-2706-4d1d-ac8c-b075f011d7a0\") " pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.323636 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.323597 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-925tc" Apr 17 21:37:49.329295 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.329249 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s2kln" Apr 17 21:37:49.420874 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.420812 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:49.467301 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.467248 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s2kln"] Apr 17 21:37:49.472573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.472330 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-925tc"] Apr 17 21:37:49.473756 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:49.473727 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127e564e_bab1_48ad_a3cb_f4a23e099acf.slice/crio-a0af0ab96faa8f3aafb8a4e51c1f27f0da55c4f409d4390ccba2ff5a8553b4b5 WatchSource:0}: Error finding container a0af0ab96faa8f3aafb8a4e51c1f27f0da55c4f409d4390ccba2ff5a8553b4b5: Status 404 returned error can't find the container with id a0af0ab96faa8f3aafb8a4e51c1f27f0da55c4f409d4390ccba2ff5a8553b4b5 Apr 17 21:37:49.478025 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:49.477994 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0762a6a9_50ab_41b1_b029_2a12a45708fd.slice/crio-d0827657f75de345d2f8e7cbe08a25050a13749a28dc2a4bcbb78a08a92389a5 WatchSource:0}: Error finding container d0827657f75de345d2f8e7cbe08a25050a13749a28dc2a4bcbb78a08a92389a5: Status 404 returned error can't find the container with id d0827657f75de345d2f8e7cbe08a25050a13749a28dc2a4bcbb78a08a92389a5 Apr 17 21:37:49.512810 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.512770 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-925tc" event={"ID":"0762a6a9-50ab-41b1-b029-2a12a45708fd","Type":"ContainerStarted","Data":"d0827657f75de345d2f8e7cbe08a25050a13749a28dc2a4bcbb78a08a92389a5"} Apr 17 21:37:49.515019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.514975 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2kln" event={"ID":"127e564e-bab1-48ad-a3cb-f4a23e099acf","Type":"ContainerStarted","Data":"a0af0ab96faa8f3aafb8a4e51c1f27f0da55c4f409d4390ccba2ff5a8553b4b5"} Apr 17 21:37:49.558796 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:49.558763 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kj82w"] Apr 17 21:37:49.562302 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:37:49.562273 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e3a6237_2706_4d1d_ac8c_b075f011d7a0.slice/crio-13181de42510bfd232328f622739843a4f62edc60be8cbdf125b2f61f9422fb1 WatchSource:0}: Error finding container 13181de42510bfd232328f622739843a4f62edc60be8cbdf125b2f61f9422fb1: Status 404 returned error can't find the container with id 13181de42510bfd232328f622739843a4f62edc60be8cbdf125b2f61f9422fb1 Apr 17 21:37:50.259911 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:50.259227 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:37:50.262358 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:50.262330 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9r26l\"" Apr 17 21:37:50.262617 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:50.262595 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 21:37:50.262941 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:50.262604 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 21:37:50.520244 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:50.520158 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kj82w" event={"ID":"5e3a6237-2706-4d1d-ac8c-b075f011d7a0","Type":"ContainerStarted","Data":"13181de42510bfd232328f622739843a4f62edc60be8cbdf125b2f61f9422fb1"} Apr 17 21:37:50.522734 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:50.522695 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2kln" event={"ID":"127e564e-bab1-48ad-a3cb-f4a23e099acf","Type":"ContainerStarted","Data":"c27eae279b38799fd5ac96bcf8fb0c71b5dc0c651a7bab67bd55df2d8af60a10"} Apr 17 21:37:50.522734 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:50.522734 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2kln" event={"ID":"127e564e-bab1-48ad-a3cb-f4a23e099acf","Type":"ContainerStarted","Data":"a60c5b26d36b8d70c02398522a465595aea0f54a291f094ffa45870ba87d0c25"} Apr 17 21:37:52.530197 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:52.529961 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-925tc" event={"ID":"0762a6a9-50ab-41b1-b029-2a12a45708fd","Type":"ContainerStarted","Data":"9565b21122c70f6011f2161f83234db5ad2832703d10de2d104a0812040707c6"} Apr 17 21:37:52.532151 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:52.532121 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kj82w" event={"ID":"5e3a6237-2706-4d1d-ac8c-b075f011d7a0","Type":"ContainerStarted","Data":"96bba4e48069a1636523438ae0acce87d16908b5b49a7c0a72c9b0dcc0ffb84d"} Apr 17 21:37:52.545121 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:52.544690 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-925tc" podStartSLOduration=1.652195034 podStartE2EDuration="4.544671747s" podCreationTimestamp="2026-04-17 21:37:48 +0000 UTC" firstStartedPulling="2026-04-17 21:37:49.479980832 +0000 UTC m=+33.821144049" lastFinishedPulling="2026-04-17 21:37:52.372457531 +0000 UTC m=+36.713620762" observedRunningTime="2026-04-17 21:37:52.544087967 +0000 UTC m=+36.885251207" watchObservedRunningTime="2026-04-17 21:37:52.544671747 +0000 UTC m=+36.885834986" Apr 17 21:37:53.536339 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:53.536292 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2kln" event={"ID":"127e564e-bab1-48ad-a3cb-f4a23e099acf","Type":"ContainerStarted","Data":"84b634a1e12ca46fc6dc7871c6df45119b7e85ff0d925d84f3ce05f30b24b866"} Apr 17 21:37:53.538042 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:53.538003 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kj82w" event={"ID":"5e3a6237-2706-4d1d-ac8c-b075f011d7a0","Type":"ContainerStarted","Data":"62ebfeed4fc791fa3affdecc8b9ccfd59ce3d0a75f467d501cd574cdee472adc"} Apr 17 21:37:53.538191 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:53.538148 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kj82w" Apr 17 21:37:53.553594 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:53.553520 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s2kln" podStartSLOduration=2.540769115 podStartE2EDuration="5.553500401s" podCreationTimestamp="2026-04-17 21:37:48 +0000 UTC" firstStartedPulling="2026-04-17 21:37:49.552841312 +0000 UTC m=+33.894004542" lastFinishedPulling="2026-04-17 21:37:52.565572608 +0000 UTC m=+36.906735828" observedRunningTime="2026-04-17 21:37:53.552404783 +0000 UTC m=+37.893568047" watchObservedRunningTime="2026-04-17 21:37:53.553500401 +0000 UTC m=+37.894663641" Apr 17 21:37:53.568139 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:53.568093 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kj82w" podStartSLOduration=1.786302147 podStartE2EDuration="4.568072665s" podCreationTimestamp="2026-04-17 21:37:49 +0000 UTC" firstStartedPulling="2026-04-17 21:37:49.564306719 +0000 UTC m=+33.905469935" lastFinishedPulling="2026-04-17 21:37:52.346077225 +0000 UTC m=+36.687240453" observedRunningTime="2026-04-17 21:37:53.567102694 +0000 UTC m=+37.908265932" watchObservedRunningTime="2026-04-17 21:37:53.568072665 +0000 UTC m=+37.909235904" Apr 17 21:37:56.546145 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:56.546109 2575 generic.go:358] "Generic (PLEG): container finished" podID="5ca56a41-5fef-481d-93e3-755405050744" containerID="a8820e808266fe66cca95686cd97ca55f878e3c44c771bbd806aa29f93b39c73" exitCode=0 Apr 17 21:37:56.546610 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:56.546168 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" event={"ID":"5ca56a41-5fef-481d-93e3-755405050744","Type":"ContainerDied","Data":"a8820e808266fe66cca95686cd97ca55f878e3c44c771bbd806aa29f93b39c73"} Apr 17 21:37:57.550717 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:57.550680 2575 generic.go:358] "Generic (PLEG): container finished" podID="5ca56a41-5fef-481d-93e3-755405050744" containerID="d46a11e2d4d6b968246016c8b1e35a8a665e37342867cb1aed87cb818adcf238" exitCode=0 Apr 17 21:37:57.551070 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:57.550724 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" event={"ID":"5ca56a41-5fef-481d-93e3-755405050744","Type":"ContainerDied","Data":"d46a11e2d4d6b968246016c8b1e35a8a665e37342867cb1aed87cb818adcf238"} Apr 17 21:37:58.555762 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:58.555723 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" event={"ID":"5ca56a41-5fef-481d-93e3-755405050744","Type":"ContainerStarted","Data":"fc467174a4e3f9d8aa3fbc06d0e2f7e794deea1b02b3a2d4ac517a5dd8fa9db2"} Apr 17 21:37:58.577181 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:37:58.577127 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7sqxl" podStartSLOduration=4.622279679 podStartE2EDuration="42.57710597s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:37:17.474834862 +0000 UTC m=+1.815998079" lastFinishedPulling="2026-04-17 21:37:55.42966115 +0000 UTC m=+39.770824370" observedRunningTime="2026-04-17 21:37:58.575773224 +0000 UTC m=+42.916936463" watchObservedRunningTime="2026-04-17 21:37:58.57710597 +0000 UTC m=+42.918269207" Apr 17 21:38:03.542369 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:03.542331 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kj82w" Apr 17 21:38:04.839854 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.839818 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-79f9d86c79-xxzwc"] Apr 17 21:38:04.851328 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.851301 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:04.855073 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.855042 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Apr 17 21:38:04.855210 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.855050 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-prhgc\"" Apr 17 21:38:04.855210 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.855120 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Apr 17 21:38:04.855210 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.855049 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Apr 17 21:38:04.855210 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.855201 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Apr 17 21:38:04.855404 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.855326 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Apr 17 21:38:04.855404 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.855349 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Apr 17 21:38:04.855500 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.855483 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Apr 17 21:38:04.856274 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.856232 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f9d86c79-xxzwc"] Apr 17 21:38:04.987210 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.987170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ncdf\" (UniqueName: \"kubernetes.io/projected/be716b2a-fe46-4058-a0e9-7c76efd710e3-kube-api-access-2ncdf\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:04.987210 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.987213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-config\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:04.987415 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.987244 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-serving-cert\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:04.987415 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.987295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-oauth-config\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:04.987415 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.987343 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-service-ca\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:04.987415 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:04.987380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-oauth-serving-cert\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.087784 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.087750 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-oauth-config\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.087784 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.087795 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-service-ca\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.088005 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.087835 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-oauth-serving-cert\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.088005 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.087887 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ncdf\" (UniqueName: \"kubernetes.io/projected/be716b2a-fe46-4058-a0e9-7c76efd710e3-kube-api-access-2ncdf\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.088005 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.087913 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-config\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.088005 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.087948 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-serving-cert\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.088696 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.088668 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-service-ca\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.088807 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.088701 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-config\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.092112 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.092057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-oauth-config\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.092112 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.092060 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-serving-cert\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.095212 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.095190 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ncdf\" (UniqueName: \"kubernetes.io/projected/be716b2a-fe46-4058-a0e9-7c76efd710e3-kube-api-access-2ncdf\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.099206 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.099182 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-oauth-serving-cert\") pod \"console-79f9d86c79-xxzwc\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.160780 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.160748 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:05.276701 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.276666 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f9d86c79-xxzwc"] Apr 17 21:38:05.279946 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:05.279922 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe716b2a_fe46_4058_a0e9_7c76efd710e3.slice/crio-de1c84e0dcd42504080dee53bb6a309dc1590c17a81f5e40a2eab4b6292536ff WatchSource:0}: Error finding container de1c84e0dcd42504080dee53bb6a309dc1590c17a81f5e40a2eab4b6292536ff: Status 404 returned error can't find the container with id de1c84e0dcd42504080dee53bb6a309dc1590c17a81f5e40a2eab4b6292536ff Apr 17 21:38:05.577518 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:05.577483 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9d86c79-xxzwc" event={"ID":"be716b2a-fe46-4058-a0e9-7c76efd710e3","Type":"ContainerStarted","Data":"de1c84e0dcd42504080dee53bb6a309dc1590c17a81f5e40a2eab4b6292536ff"} Apr 17 21:38:06.815562 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.815504 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd6974c9d-pnhbr"] Apr 17 21:38:06.818681 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.818657 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:06.819167 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.818831 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29"] Apr 17 21:38:06.822204 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.822186 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" Apr 17 21:38:06.827810 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.827434 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Apr 17 21:38:06.827941 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.827877 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dmzn2\"" Apr 17 21:38:06.828170 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.828049 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Apr 17 21:38:06.830242 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.829605 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd6974c9d-pnhbr"] Apr 17 21:38:06.831624 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:06.831602 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29"] Apr 17 21:38:07.001594 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.001522 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-oauth-config\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.001782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.001642 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-config\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.001782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.001693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-oauth-serving-cert\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.001782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.001765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-service-ca\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.001973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.001830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/53154e66-f3ee-4684-85c9-62e754c4f8f5-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-jwm29\" (UID: \"53154e66-f3ee-4684-85c9-62e754c4f8f5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" Apr 17 21:38:07.001973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.001859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-serving-cert\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.001973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.001889 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-trusted-ca-bundle\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.001973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.001960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmjh6\" (UniqueName: \"kubernetes.io/projected/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-kube-api-access-rmjh6\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.103325 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.103223 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/53154e66-f3ee-4684-85c9-62e754c4f8f5-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-jwm29\" (UID: \"53154e66-f3ee-4684-85c9-62e754c4f8f5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" Apr 17 21:38:07.103325 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.103277 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-serving-cert\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.103325 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.103300 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-trusted-ca-bundle\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.103676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.103336 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rmjh6\" (UniqueName: \"kubernetes.io/projected/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-kube-api-access-rmjh6\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.103676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.103364 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-oauth-config\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.103676 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.103393 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-config\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.103833 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.103702 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-oauth-serving-cert\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.103833 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.103788 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-service-ca\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.104348 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.104322 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-trusted-ca-bundle\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.104523 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.104472 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-service-ca\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.104862 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.104835 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-oauth-serving-cert\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.104941 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.104878 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-config\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.106335 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.106301 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/53154e66-f3ee-4684-85c9-62e754c4f8f5-tls-certificates\") pod \"prometheus-operator-admission-webhook-57cf98b594-jwm29\" (UID: \"53154e66-f3ee-4684-85c9-62e754c4f8f5\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" Apr 17 21:38:07.106566 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.106528 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-oauth-config\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.107029 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.107002 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-serving-cert\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.113827 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.113787 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmjh6\" (UniqueName: \"kubernetes.io/projected/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-kube-api-access-rmjh6\") pod \"console-7bd6974c9d-pnhbr\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.134715 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.134682 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:07.139434 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:07.139409 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" Apr 17 21:38:08.036021 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:08.035991 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29"] Apr 17 21:38:08.038890 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:08.038859 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53154e66_f3ee_4684_85c9_62e754c4f8f5.slice/crio-78923111b5e7a5b85fae4852450331edd59bd47817d2e529ceceabb65275fa0a WatchSource:0}: Error finding container 78923111b5e7a5b85fae4852450331edd59bd47817d2e529ceceabb65275fa0a: Status 404 returned error can't find the container with id 78923111b5e7a5b85fae4852450331edd59bd47817d2e529ceceabb65275fa0a Apr 17 21:38:08.052329 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:08.052298 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd6974c9d-pnhbr"] Apr 17 21:38:08.055888 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:08.055859 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a88b7a0_b9ef_49db_a2f8_9782cb6c7960.slice/crio-af8d3a639152b0a6ce84581120182de2229e25040337ef205806aa34df28bf69 WatchSource:0}: Error finding container af8d3a639152b0a6ce84581120182de2229e25040337ef205806aa34df28bf69: Status 404 returned error can't find the container with id af8d3a639152b0a6ce84581120182de2229e25040337ef205806aa34df28bf69 Apr 17 21:38:08.589858 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:08.589818 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd6974c9d-pnhbr" event={"ID":"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960","Type":"ContainerStarted","Data":"c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d"} Apr 17 21:38:08.589858 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:08.589863 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd6974c9d-pnhbr" event={"ID":"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960","Type":"ContainerStarted","Data":"af8d3a639152b0a6ce84581120182de2229e25040337ef205806aa34df28bf69"} Apr 17 21:38:08.591474 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:08.591443 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9d86c79-xxzwc" event={"ID":"be716b2a-fe46-4058-a0e9-7c76efd710e3","Type":"ContainerStarted","Data":"7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d"} Apr 17 21:38:08.592683 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:08.592657 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" event={"ID":"53154e66-f3ee-4684-85c9-62e754c4f8f5","Type":"ContainerStarted","Data":"78923111b5e7a5b85fae4852450331edd59bd47817d2e529ceceabb65275fa0a"} Apr 17 21:38:08.606183 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:08.606136 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7bd6974c9d-pnhbr" podStartSLOduration=2.606118458 podStartE2EDuration="2.606118458s" podCreationTimestamp="2026-04-17 21:38:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 21:38:08.605955566 +0000 UTC m=+52.947118805" watchObservedRunningTime="2026-04-17 21:38:08.606118458 +0000 UTC m=+52.947281697" Apr 17 21:38:08.628995 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:08.628951 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-79f9d86c79-xxzwc" podStartSLOduration=1.956826721 podStartE2EDuration="4.628938299s" podCreationTimestamp="2026-04-17 21:38:04 +0000 UTC" firstStartedPulling="2026-04-17 21:38:05.285578031 +0000 UTC m=+49.626741252" lastFinishedPulling="2026-04-17 21:38:07.95768959 +0000 UTC m=+52.298852830" observedRunningTime="2026-04-17 21:38:08.628198727 +0000 UTC m=+52.969361967" watchObservedRunningTime="2026-04-17 21:38:08.628938299 +0000 UTC m=+52.970101537" Apr 17 21:38:09.597032 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:09.596995 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" event={"ID":"53154e66-f3ee-4684-85c9-62e754c4f8f5","Type":"ContainerStarted","Data":"f992203e3b1ff061731c3c2b0edb1157e557f7dee2395514ec80d8f7e884214c"} Apr 17 21:38:09.597503 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:09.597270 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" Apr 17 21:38:09.601666 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:09.601645 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" Apr 17 21:38:09.613053 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:09.613012 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-57cf98b594-jwm29" podStartSLOduration=2.588514442 podStartE2EDuration="3.612999926s" podCreationTimestamp="2026-04-17 21:38:06 +0000 UTC" firstStartedPulling="2026-04-17 21:38:08.041281163 +0000 UTC m=+52.382444382" lastFinishedPulling="2026-04-17 21:38:09.065766636 +0000 UTC m=+53.406929866" observedRunningTime="2026-04-17 21:38:09.611869363 +0000 UTC m=+53.953032602" watchObservedRunningTime="2026-04-17 21:38:09.612999926 +0000 UTC m=+53.954163163" Apr 17 21:38:15.161126 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.161083 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:15.161613 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.161139 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:15.165539 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.165513 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:15.198029 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.197997 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf"] Apr 17 21:38:15.202370 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.202354 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.205267 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.205237 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Apr 17 21:38:15.205396 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.205286 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Apr 17 21:38:15.205396 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.205296 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ln9xt\"" Apr 17 21:38:15.205529 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.205512 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Apr 17 21:38:15.205624 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.205607 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Apr 17 21:38:15.205681 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.205666 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Apr 17 21:38:15.210028 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.210005 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf"] Apr 17 21:38:15.227988 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.227958 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-7mgc9"] Apr 17 21:38:15.230925 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.230900 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.232287 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.232263 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x6phw"] Apr 17 21:38:15.233620 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.233570 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Apr 17 21:38:15.233727 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.233570 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Apr 17 21:38:15.233800 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.233570 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gw29h\"" Apr 17 21:38:15.233800 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.233669 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Apr 17 21:38:15.235367 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.235346 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.237878 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.237860 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Apr 17 21:38:15.237878 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.237870 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Apr 17 21:38:15.238044 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.237920 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Apr 17 21:38:15.238044 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.238010 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n69pg\"" Apr 17 21:38:15.244733 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.244711 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-7mgc9"] Apr 17 21:38:15.267450 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267419 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-textfile\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.267616 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.267616 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267479 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.267616 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-wtmp\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.267616 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.267616 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-tls\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.267828 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267683 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.267828 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267711 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq8hh\" (UniqueName: \"kubernetes.io/projected/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-kube-api-access-qq8hh\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.267828 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267739 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.267828 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267798 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.267828 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267818 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.268011 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267832 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-sys\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.268011 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.268011 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05a733bd-f581-4306-a492-cc81ddf6c2f9-metrics-client-ca\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.268011 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.268011 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdpcq\" (UniqueName: \"kubernetes.io/projected/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-api-access-vdpcq\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.268011 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-root\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.268011 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.267954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9hhq\" (UniqueName: \"kubernetes.io/projected/05a733bd-f581-4306-a492-cc81ddf6c2f9-kube-api-access-t9hhq\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.268011 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.268008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.368457 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368421 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.368457 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368463 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-textfile\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.368688 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368490 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.368688 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368514 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.368688 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:15.368634 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Apr 17 21:38:15.368887 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368699 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-wtmp\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.368887 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:15.368710 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-tls podName:f55baa0d-b33f-4d79-8b23-4f80f5cbe536 nodeName:}" failed. No retries permitted until 2026-04-17 21:38:15.868689947 +0000 UTC m=+60.209853180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-tls") pod "kube-state-metrics-69db897b98-7mgc9" (UID: "f55baa0d-b33f-4d79-8b23-4f80f5cbe536") : secret "kube-state-metrics-tls" not found Apr 17 21:38:15.368887 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368767 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.368887 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368801 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-tls\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.368887 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368830 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.368887 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368858 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qq8hh\" (UniqueName: \"kubernetes.io/projected/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-kube-api-access-qq8hh\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.368887 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368885 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.369231 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368893 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-wtmp\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.369231 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.368915 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-textfile\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.369231 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:15.369011 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Apr 17 21:38:15.369231 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:15.369063 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-tls podName:05a733bd-f581-4306-a492-cc81ddf6c2f9 nodeName:}" failed. No retries permitted until 2026-04-17 21:38:15.869044388 +0000 UTC m=+60.210207614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-tls") pod "node-exporter-x6phw" (UID: "05a733bd-f581-4306-a492-cc81ddf6c2f9") : secret "node-exporter-tls" not found Apr 17 21:38:15.369231 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369209 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.369488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369250 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.369488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369259 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-metrics-client-ca\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.369488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369281 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-sys\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.369488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369315 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.369488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369342 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05a733bd-f581-4306-a492-cc81ddf6c2f9-metrics-client-ca\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.369488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369362 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-sys\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.369488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369371 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.369488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369400 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdpcq\" (UniqueName: \"kubernetes.io/projected/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-api-access-vdpcq\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369508 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-root\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.370393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05a733bd-f581-4306-a492-cc81ddf6c2f9-metrics-client-ca\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.369459 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05a733bd-f581-4306-a492-cc81ddf6c2f9-root\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.370606 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9hhq\" (UniqueName: \"kubernetes.io/projected/05a733bd-f581-4306-a492-cc81ddf6c2f9-kube-api-access-t9hhq\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.370899 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.371148 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-volume-directive-shadow\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.371303 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-accelerators-collector-config\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.371802 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.373052 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.372272 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-metrics-client-ca\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.373471 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.373143 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.373471 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.373291 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.373687 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.373664 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.383047 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.383015 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq8hh\" (UniqueName: \"kubernetes.io/projected/5b36f5f6-06a3-4f05-8ddc-042211be3e7b-kube-api-access-qq8hh\") pod \"openshift-state-metrics-9d44df66c-qxnxf\" (UID: \"5b36f5f6-06a3-4f05-8ddc-042211be3e7b\") " pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.384026 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.384007 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9hhq\" (UniqueName: \"kubernetes.io/projected/05a733bd-f581-4306-a492-cc81ddf6c2f9-kube-api-access-t9hhq\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.384170 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.384151 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdpcq\" (UniqueName: \"kubernetes.io/projected/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-api-access-vdpcq\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.510959 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.510934 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvrm9" Apr 17 21:38:15.511274 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.511247 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" Apr 17 21:38:15.614807 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.614780 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:15.631724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.631700 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf"] Apr 17 21:38:15.634794 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:15.634762 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b36f5f6_06a3_4f05_8ddc_042211be3e7b.slice/crio-b2a99d08fa2f22c15f824c32e03fd9acd37c4cbd38482925758a01a3b0bb4e71 WatchSource:0}: Error finding container b2a99d08fa2f22c15f824c32e03fd9acd37c4cbd38482925758a01a3b0bb4e71: Status 404 returned error can't find the container with id b2a99d08fa2f22c15f824c32e03fd9acd37c4cbd38482925758a01a3b0bb4e71 Apr 17 21:38:15.876119 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.876008 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:15.876119 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.876086 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-tls\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.878522 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.878491 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05a733bd-f581-4306-a492-cc81ddf6c2f9-node-exporter-tls\") pod \"node-exporter-x6phw\" (UID: \"05a733bd-f581-4306-a492-cc81ddf6c2f9\") " pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:15.878657 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:15.878531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f55baa0d-b33f-4d79-8b23-4f80f5cbe536-kube-state-metrics-tls\") pod \"kube-state-metrics-69db897b98-7mgc9\" (UID: \"f55baa0d-b33f-4d79-8b23-4f80f5cbe536\") " pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:16.143370 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.143037 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gw29h\"" Apr 17 21:38:16.148541 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.148504 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n69pg\"" Apr 17 21:38:16.150221 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.150198 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" Apr 17 21:38:16.156054 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.156030 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x6phw" Apr 17 21:38:16.166300 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:16.166272 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a733bd_f581_4306_a492_cc81ddf6c2f9.slice/crio-4e01f412ed6249ad332e70dc885b456eabb9c68c11c2ac4f1d5756fcdf798b51 WatchSource:0}: Error finding container 4e01f412ed6249ad332e70dc885b456eabb9c68c11c2ac4f1d5756fcdf798b51: Status 404 returned error can't find the container with id 4e01f412ed6249ad332e70dc885b456eabb9c68c11c2ac4f1d5756fcdf798b51 Apr 17 21:38:16.268384 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.268352 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 21:38:16.272103 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.272073 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.274450 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.274423 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Apr 17 21:38:16.274606 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.274498 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Apr 17 21:38:16.274701 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.274678 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Apr 17 21:38:16.274771 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.274716 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Apr 17 21:38:16.275031 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.275011 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Apr 17 21:38:16.275108 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.275060 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Apr 17 21:38:16.275226 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.275206 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Apr 17 21:38:16.275366 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.275347 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Apr 17 21:38:16.275456 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.275396 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7jblq\"" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.278658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8988736-278d-4d25-b0aa-85538c273612-config-out\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.278708 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f8988736-278d-4d25-b0aa-85538c273612-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.278759 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxlfk\" (UniqueName: \"kubernetes.io/projected/f8988736-278d-4d25-b0aa-85538c273612-kube-api-access-jxlfk\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.278788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.278852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.278897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-web-config\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.278947 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8988736-278d-4d25-b0aa-85538c273612-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.278993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.279061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.279086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8988736-278d-4d25-b0aa-85538c273612-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279671 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.279130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-config-volume\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279671 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.279172 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.279671 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.279229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8988736-278d-4d25-b0aa-85538c273612-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.281348 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.280691 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Apr 17 21:38:16.281348 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.280763 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-69db897b98-7mgc9"] Apr 17 21:38:16.283805 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.283784 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 21:38:16.284400 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:16.284375 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf55baa0d_b33f_4d79_8b23_4f80f5cbe536.slice/crio-aa4e4e90072bf43af6192ad04d2a6b3e089122c7cb72375c2350cbabda6bf2de WatchSource:0}: Error finding container aa4e4e90072bf43af6192ad04d2a6b3e089122c7cb72375c2350cbabda6bf2de: Status 404 returned error can't find the container with id aa4e4e90072bf43af6192ad04d2a6b3e089122c7cb72375c2350cbabda6bf2de Apr 17 21:38:16.380074 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380040 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380074 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380078 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8988736-278d-4d25-b0aa-85538c273612-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380284 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380149 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8988736-278d-4d25-b0aa-85538c273612-config-out\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380284 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380185 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f8988736-278d-4d25-b0aa-85538c273612-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380284 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380210 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxlfk\" (UniqueName: \"kubernetes.io/projected/f8988736-278d-4d25-b0aa-85538c273612-kube-api-access-jxlfk\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380453 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380373 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380453 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380437 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380572 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380462 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-web-config\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380572 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380502 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8988736-278d-4d25-b0aa-85538c273612-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380572 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380518 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380730 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380579 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380730 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380605 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8988736-278d-4d25-b0aa-85538c273612-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380730 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380629 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-config-volume\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.380925 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.380903 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f8988736-278d-4d25-b0aa-85538c273612-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.381040 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:16.381020 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Apr 17 21:38:16.381096 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:16.381089 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls podName:f8988736-278d-4d25-b0aa-85538c273612 nodeName:}" failed. No retries permitted until 2026-04-17 21:38:16.881068713 +0000 UTC m=+61.222231943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f8988736-278d-4d25-b0aa-85538c273612") : secret "alertmanager-main-tls" not found Apr 17 21:38:16.382178 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.381822 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8988736-278d-4d25-b0aa-85538c273612-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.383458 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.383431 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8988736-278d-4d25-b0aa-85538c273612-config-out\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.383600 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.383531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.383936 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.383910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.384144 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.384118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8988736-278d-4d25-b0aa-85538c273612-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.385940 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.385648 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-config-volume\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.385940 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.385890 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.385940 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.385896 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-web-config\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.386143 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.386046 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.386592 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.386535 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8988736-278d-4d25-b0aa-85538c273612-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.388739 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.388718 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxlfk\" (UniqueName: \"kubernetes.io/projected/f8988736-278d-4d25-b0aa-85538c273612-kube-api-access-jxlfk\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.615703 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.615656 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x6phw" event={"ID":"05a733bd-f581-4306-a492-cc81ddf6c2f9","Type":"ContainerStarted","Data":"4e01f412ed6249ad332e70dc885b456eabb9c68c11c2ac4f1d5756fcdf798b51"} Apr 17 21:38:16.617866 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.617828 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" event={"ID":"5b36f5f6-06a3-4f05-8ddc-042211be3e7b","Type":"ContainerStarted","Data":"8c30a178d2e8380c1abfe46a5c366e134689bb59e8b08884435f0ed020b64785"} Apr 17 21:38:16.617986 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.617873 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" event={"ID":"5b36f5f6-06a3-4f05-8ddc-042211be3e7b","Type":"ContainerStarted","Data":"ee77e882a19e715c283a32917b54e2359759eaf6e3e3f14c4403df3475d12a37"} Apr 17 21:38:16.617986 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.617888 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" event={"ID":"5b36f5f6-06a3-4f05-8ddc-042211be3e7b","Type":"ContainerStarted","Data":"b2a99d08fa2f22c15f824c32e03fd9acd37c4cbd38482925758a01a3b0bb4e71"} Apr 17 21:38:16.619077 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.619044 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" event={"ID":"f55baa0d-b33f-4d79-8b23-4f80f5cbe536","Type":"ContainerStarted","Data":"aa4e4e90072bf43af6192ad04d2a6b3e089122c7cb72375c2350cbabda6bf2de"} Apr 17 21:38:16.886093 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:16.886002 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:16.886234 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:16.886194 2575 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Apr 17 21:38:16.886291 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:16.886279 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls podName:f8988736-278d-4d25-b0aa-85538c273612 nodeName:}" failed. No retries permitted until 2026-04-17 21:38:17.88625781 +0000 UTC m=+62.227421040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f8988736-278d-4d25-b0aa-85538c273612") : secret "alertmanager-main-tls" not found Apr 17 21:38:17.134848 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.134813 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:17.135003 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.134861 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:17.140693 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.140621 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:17.623446 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.623413 2575 generic.go:358] "Generic (PLEG): container finished" podID="05a733bd-f581-4306-a492-cc81ddf6c2f9" containerID="8cd4cb90ab5804a69914f5d1eae0ba9f51c56ae562d2ca942778f8d846addcde" exitCode=0 Apr 17 21:38:17.623810 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.623496 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x6phw" event={"ID":"05a733bd-f581-4306-a492-cc81ddf6c2f9","Type":"ContainerDied","Data":"8cd4cb90ab5804a69914f5d1eae0ba9f51c56ae562d2ca942778f8d846addcde"} Apr 17 21:38:17.625562 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.625519 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" event={"ID":"5b36f5f6-06a3-4f05-8ddc-042211be3e7b","Type":"ContainerStarted","Data":"e6124c7d900f9cd807a6d2972eecd89fbd50d2830f4fad5627c43ae489106b93"} Apr 17 21:38:17.629917 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.629894 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:38:17.657762 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.657719 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9d44df66c-qxnxf" podStartSLOduration=1.714083751 podStartE2EDuration="2.657704742s" podCreationTimestamp="2026-04-17 21:38:15 +0000 UTC" firstStartedPulling="2026-04-17 21:38:15.758150414 +0000 UTC m=+60.099313629" lastFinishedPulling="2026-04-17 21:38:16.701771401 +0000 UTC m=+61.042934620" observedRunningTime="2026-04-17 21:38:17.65694321 +0000 UTC m=+61.998106449" watchObservedRunningTime="2026-04-17 21:38:17.657704742 +0000 UTC m=+61.998867982" Apr 17 21:38:17.698069 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.698039 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f9d86c79-xxzwc"] Apr 17 21:38:17.895605 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.895513 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:17.897895 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:17.897872 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f8988736-278d-4d25-b0aa-85538c273612-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f8988736-278d-4d25-b0aa-85538c273612\") " pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:18.084688 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.084651 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Apr 17 21:38:18.198001 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.197968 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c79454d6-6qrg8"] Apr 17 21:38:18.202739 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.202718 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.205533 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.205505 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ds1rqgno5qloh\"" Apr 17 21:38:18.205682 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.205574 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Apr 17 21:38:18.205682 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.205592 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q4ff5\"" Apr 17 21:38:18.205682 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.205626 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Apr 17 21:38:18.205682 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.205630 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Apr 17 21:38:18.205682 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.205504 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Apr 17 21:38:18.205682 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.205630 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Apr 17 21:38:18.212115 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.212092 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c79454d6-6qrg8"] Apr 17 21:38:18.222390 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.222364 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Apr 17 21:38:18.225190 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:18.225163 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8988736_278d_4d25_b0aa_85538c273612.slice/crio-0219d1bf8d7da890daf9db1361f60e20899f9795a05397958db540755b76e639 WatchSource:0}: Error finding container 0219d1bf8d7da890daf9db1361f60e20899f9795a05397958db540755b76e639: Status 404 returned error can't find the container with id 0219d1bf8d7da890daf9db1361f60e20899f9795a05397958db540755b76e639 Apr 17 21:38:18.299240 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.299210 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.299240 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.299243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmcqt\" (UniqueName: \"kubernetes.io/projected/4ecbaf65-5737-4694-927b-05044e8606c1-kube-api-access-hmcqt\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.299470 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.299267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-grpc-tls\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.299470 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.299288 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.299470 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.299357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-tls\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.299470 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.299374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.299470 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.299392 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.299470 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.299417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ecbaf65-5737-4694-927b-05044e8606c1-metrics-client-ca\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.400161 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.400126 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.400161 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.400161 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcqt\" (UniqueName: \"kubernetes.io/projected/4ecbaf65-5737-4694-927b-05044e8606c1-kube-api-access-hmcqt\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.400381 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.400184 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-grpc-tls\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.400381 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.400205 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.400484 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.400383 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-tls\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.400484 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.400428 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.400484 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.400465 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.400642 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.400525 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ecbaf65-5737-4694-927b-05044e8606c1-metrics-client-ca\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.401360 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.401330 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ecbaf65-5737-4694-927b-05044e8606c1-metrics-client-ca\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.402926 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.402898 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-grpc-tls\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.403074 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.403055 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.403158 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.403058 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-tls\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.403235 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.403215 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.403292 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.403257 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.403292 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.403276 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ecbaf65-5737-4694-927b-05044e8606c1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.408143 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.408122 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmcqt\" (UniqueName: \"kubernetes.io/projected/4ecbaf65-5737-4694-927b-05044e8606c1-kube-api-access-hmcqt\") pod \"thanos-querier-6c79454d6-6qrg8\" (UID: \"4ecbaf65-5737-4694-927b-05044e8606c1\") " pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.512706 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.512677 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:18.629564 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.629482 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8988736-278d-4d25-b0aa-85538c273612","Type":"ContainerStarted","Data":"0219d1bf8d7da890daf9db1361f60e20899f9795a05397958db540755b76e639"} Apr 17 21:38:18.631934 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.631908 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c79454d6-6qrg8"] Apr 17 21:38:18.632238 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.632193 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x6phw" event={"ID":"05a733bd-f581-4306-a492-cc81ddf6c2f9","Type":"ContainerStarted","Data":"b9095f2b44427daaf646848e1274f2ba4e6e3b9e5d29db1a6885dd94efa39105"} Apr 17 21:38:18.632238 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.632223 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x6phw" event={"ID":"05a733bd-f581-4306-a492-cc81ddf6c2f9","Type":"ContainerStarted","Data":"b549812758abc043275ee740f86e0e2836d124598b2a0310814bdc3611bc5b91"} Apr 17 21:38:18.634137 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.634111 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" event={"ID":"f55baa0d-b33f-4d79-8b23-4f80f5cbe536","Type":"ContainerStarted","Data":"2afdcac0968a24c8a98161c5b0e02a15677bcd573d3e9d76271caac7ed614872"} Apr 17 21:38:18.634219 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.634141 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" event={"ID":"f55baa0d-b33f-4d79-8b23-4f80f5cbe536","Type":"ContainerStarted","Data":"6d62e9e4df573d1aee91af39b2b48bd708d651a6afd85576bd1091dcdc4b8157"} Apr 17 21:38:18.634219 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.634153 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" event={"ID":"f55baa0d-b33f-4d79-8b23-4f80f5cbe536","Type":"ContainerStarted","Data":"8e64d8df4a2758ff6cdb5fe4498f6fb99880fcee0ac0f4410082d9afb13d9f57"} Apr 17 21:38:18.635007 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:18.634988 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ecbaf65_5737_4694_927b_05044e8606c1.slice/crio-a594c357c3182c5395e97cd02f07d154f5c2e53d3dd686ed9408ee406b19577e WatchSource:0}: Error finding container a594c357c3182c5395e97cd02f07d154f5c2e53d3dd686ed9408ee406b19577e: Status 404 returned error can't find the container with id a594c357c3182c5395e97cd02f07d154f5c2e53d3dd686ed9408ee406b19577e Apr 17 21:38:18.651403 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.651362 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x6phw" podStartSLOduration=2.897289678 podStartE2EDuration="3.651350535s" podCreationTimestamp="2026-04-17 21:38:15 +0000 UTC" firstStartedPulling="2026-04-17 21:38:16.168277089 +0000 UTC m=+60.509440306" lastFinishedPulling="2026-04-17 21:38:16.922337943 +0000 UTC m=+61.263501163" observedRunningTime="2026-04-17 21:38:18.650224271 +0000 UTC m=+62.991387509" watchObservedRunningTime="2026-04-17 21:38:18.651350535 +0000 UTC m=+62.992513767" Apr 17 21:38:18.665695 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:18.665653 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-69db897b98-7mgc9" podStartSLOduration=2.362867836 podStartE2EDuration="3.665639623s" podCreationTimestamp="2026-04-17 21:38:15 +0000 UTC" firstStartedPulling="2026-04-17 21:38:16.287114804 +0000 UTC m=+60.628278025" lastFinishedPulling="2026-04-17 21:38:17.589886585 +0000 UTC m=+61.931049812" observedRunningTime="2026-04-17 21:38:18.665120287 +0000 UTC m=+63.006283526" watchObservedRunningTime="2026-04-17 21:38:18.665639623 +0000 UTC m=+63.006802854" Apr 17 21:38:19.639043 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:19.638954 2575 generic.go:358] "Generic (PLEG): container finished" podID="f8988736-278d-4d25-b0aa-85538c273612" containerID="ecff053114df9b686bf4904695335e29d16bd6691d9e4fffc9029899868ea717" exitCode=0 Apr 17 21:38:19.639617 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:19.639065 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8988736-278d-4d25-b0aa-85538c273612","Type":"ContainerDied","Data":"ecff053114df9b686bf4904695335e29d16bd6691d9e4fffc9029899868ea717"} Apr 17 21:38:19.640395 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:19.640358 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" event={"ID":"4ecbaf65-5737-4694-927b-05044e8606c1","Type":"ContainerStarted","Data":"a594c357c3182c5395e97cd02f07d154f5c2e53d3dd686ed9408ee406b19577e"} Apr 17 21:38:20.382533 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.382493 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-786f7c65fc-89p9h"] Apr 17 21:38:20.386604 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.386466 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.394643 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.394617 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786f7c65fc-89p9h"] Apr 17 21:38:20.408285 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.408259 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7dfd584d58-pbx5c"] Apr 17 21:38:20.415254 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.415225 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.417861 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.417834 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Apr 17 21:38:20.417996 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.417925 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Apr 17 21:38:20.417996 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.417963 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Apr 17 21:38:20.418120 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.417838 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Apr 17 21:38:20.418120 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.418083 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Apr 17 21:38:20.418120 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.417840 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bsl87\"" Apr 17 21:38:20.418819 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.418796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-config\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.418917 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.418831 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-oauth-serving-cert\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.418917 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.418878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-oauth-config\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.419020 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.418934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-serving-cert\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.419020 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.418964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj7fb\" (UniqueName: \"kubernetes.io/projected/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-kube-api-access-gj7fb\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.419020 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.419010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-trusted-ca-bundle\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.419161 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.419141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-service-ca\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.422852 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.422832 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dfd584d58-pbx5c"] Apr 17 21:38:20.424071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.424044 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Apr 17 21:38:20.520675 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.520633 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj7fb\" (UniqueName: \"kubernetes.io/projected/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-kube-api-access-gj7fb\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.520857 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.520686 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-telemeter-client-tls\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.520857 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.520726 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-trusted-ca-bundle\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.520857 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.520762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-metrics-client-ca\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.521017 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.520869 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-service-ca\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.521017 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.520934 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-config\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.521017 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.520973 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-federate-client-tls\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.521017 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521008 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-oauth-serving-cert\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.521254 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9rzx\" (UniqueName: \"kubernetes.io/projected/1be66022-a026-418d-9603-35f0917b4aec-kube-api-access-l9rzx\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.521254 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-secret-telemeter-client\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.521254 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.521254 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521199 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-serving-certs-ca-bundle\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.521254 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521240 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-oauth-config\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.521503 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521272 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.521503 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521322 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-serving-cert\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.521642 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521624 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-service-ca\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.521721 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521702 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-trusted-ca-bundle\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.521791 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521727 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-config\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.521862 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.521833 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-oauth-serving-cert\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.525908 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.525725 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-oauth-config\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.525908 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.525733 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-serving-cert\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.533343 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.533315 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj7fb\" (UniqueName: \"kubernetes.io/projected/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-kube-api-access-gj7fb\") pod \"console-786f7c65fc-89p9h\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.621858 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.621810 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-telemeter-client-tls\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.622094 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.621889 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-metrics-client-ca\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.622094 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.621973 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-federate-client-tls\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.622094 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.622003 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9rzx\" (UniqueName: \"kubernetes.io/projected/1be66022-a026-418d-9603-35f0917b4aec-kube-api-access-l9rzx\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.622094 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.622040 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-secret-telemeter-client\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.622094 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.622067 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.622094 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.622094 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-serving-certs-ca-bundle\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.622407 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.622128 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.623042 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.623012 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-serving-certs-ca-bundle\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.623177 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.623036 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.623177 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.623045 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be66022-a026-418d-9603-35f0917b4aec-metrics-client-ca\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.624965 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.624932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-telemeter-client-tls\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.626001 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.625970 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.626096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.626076 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-secret-telemeter-client\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.626445 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.626415 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1be66022-a026-418d-9603-35f0917b4aec-federate-client-tls\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.630643 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.630620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9rzx\" (UniqueName: \"kubernetes.io/projected/1be66022-a026-418d-9603-35f0917b4aec-kube-api-access-l9rzx\") pod \"telemeter-client-7dfd584d58-pbx5c\" (UID: \"1be66022-a026-418d-9603-35f0917b4aec\") " pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.699926 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.699622 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:20.728586 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.728121 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" Apr 17 21:38:20.926257 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.926219 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:38:20.928989 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.928957 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Apr 17 21:38:20.939541 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:20.939512 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/acf375eb-382e-4e70-8999-46983d601f3f-metrics-certs\") pod \"network-metrics-daemon-nj256\" (UID: \"acf375eb-382e-4e70-8999-46983d601f3f\") " pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:38:21.027167 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.027131 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:38:21.029809 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.029781 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Apr 17 21:38:21.040059 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.040032 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Apr 17 21:38:21.050998 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.050974 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr7ff\" (UniqueName: \"kubernetes.io/projected/239dc9d6-2782-48f3-82ef-7b176001f318-kube-api-access-nr7ff\") pod \"network-check-target-tb94q\" (UID: \"239dc9d6-2782-48f3-82ef-7b176001f318\") " pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:38:21.069527 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.069494 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlncx\"" Apr 17 21:38:21.077694 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.077669 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj256" Apr 17 21:38:21.178819 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.178789 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9r26l\"" Apr 17 21:38:21.185061 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.185032 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:38:21.374896 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.374844 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dfd584d58-pbx5c"] Apr 17 21:38:21.377919 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:21.377881 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be66022_a026_418d_9603_35f0917b4aec.slice/crio-343004eb9cc6584f0d1b5d46924c39a89edbc9dcef10d1f1fe0b6df7570f55b8 WatchSource:0}: Error finding container 343004eb9cc6584f0d1b5d46924c39a89edbc9dcef10d1f1fe0b6df7570f55b8: Status 404 returned error can't find the container with id 343004eb9cc6584f0d1b5d46924c39a89edbc9dcef10d1f1fe0b6df7570f55b8 Apr 17 21:38:21.419469 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.419442 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tb94q"] Apr 17 21:38:21.423599 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:21.423188 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239dc9d6_2782_48f3_82ef_7b176001f318.slice/crio-a29568e5017efbd2b453f789bd8aaa930a25626ecf8f583c0918a9e00eb06696 WatchSource:0}: Error finding container a29568e5017efbd2b453f789bd8aaa930a25626ecf8f583c0918a9e00eb06696: Status 404 returned error can't find the container with id a29568e5017efbd2b453f789bd8aaa930a25626ecf8f583c0918a9e00eb06696 Apr 17 21:38:21.424226 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.424074 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 21:38:21.429973 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.429955 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.433069 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.432828 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Apr 17 21:38:21.433069 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.432835 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Apr 17 21:38:21.433873 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.433849 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Apr 17 21:38:21.433974 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.433878 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Apr 17 21:38:21.434040 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.433966 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Apr 17 21:38:21.434040 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.433976 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Apr 17 21:38:21.435044 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.435000 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Apr 17 21:38:21.435274 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.435247 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-p4lkn\"" Apr 17 21:38:21.435724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.435526 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Apr 17 21:38:21.435724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.435570 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Apr 17 21:38:21.436084 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.435976 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Apr 17 21:38:21.436084 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.436011 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-andm130lb4um4\"" Apr 17 21:38:21.436084 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.436067 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Apr 17 21:38:21.444579 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.443762 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Apr 17 21:38:21.444579 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.444254 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 21:38:21.446800 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.446771 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533147 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533178 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-config\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533274 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533293 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533350 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pwj4\" (UniqueName: \"kubernetes.io/projected/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-kube-api-access-7pwj4\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.533570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.534142 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.534142 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.533525 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.593464 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.593433 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nj256"] Apr 17 21:38:21.595465 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.595444 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786f7c65fc-89p9h"] Apr 17 21:38:21.597101 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:21.597077 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf375eb_382e_4e70_8999_46983d601f3f.slice/crio-b5615f0c76472a60a9d311e34fd41e5d6b02c84183c8eebbc6fb7bf2ea43b292 WatchSource:0}: Error finding container b5615f0c76472a60a9d311e34fd41e5d6b02c84183c8eebbc6fb7bf2ea43b292: Status 404 returned error can't find the container with id b5615f0c76472a60a9d311e34fd41e5d6b02c84183c8eebbc6fb7bf2ea43b292 Apr 17 21:38:21.598453 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:21.598426 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5d2fbf_ccb6_4524_bafd_09ac81c9a3fb.slice/crio-4bb3134a4443dbaa4e28ef01284a40e80b11df02534db2a5da0a8e75ce2dd2c6 WatchSource:0}: Error finding container 4bb3134a4443dbaa4e28ef01284a40e80b11df02534db2a5da0a8e75ce2dd2c6: Status 404 returned error can't find the container with id 4bb3134a4443dbaa4e28ef01284a40e80b11df02534db2a5da0a8e75ce2dd2c6 Apr 17 21:38:21.634533 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634502 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pwj4\" (UniqueName: \"kubernetes.io/projected/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-kube-api-access-7pwj4\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.634658 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634576 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.634658 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.634658 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634648 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.634827 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634676 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.634827 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634716 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.634827 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634742 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.634827 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634767 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.634827 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634819 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634855 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634889 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-config\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634918 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634954 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.634994 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.635031 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.635057 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.635084 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635475 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.635110 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635475 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.635228 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.635981 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.635952 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.636080 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.636054 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.636303 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.636285 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.638933 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.638157 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.638933 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.638599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.638933 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.638626 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.639132 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.638932 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.640385 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.640333 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-config-out\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.642577 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.641910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.642577 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.642006 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.642577 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.642056 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-web-config\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.642577 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.642117 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.642577 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.642415 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-config\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.642872 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.642642 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.642872 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.642645 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.642970 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.642896 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.643187 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.643169 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pwj4\" (UniqueName: \"kubernetes.io/projected/4f284c77-ef5d-4fa5-bb48-57a03e95cf83-kube-api-access-7pwj4\") pod \"prometheus-k8s-0\" (UID: \"4f284c77-ef5d-4fa5-bb48-57a03e95cf83\") " pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.648358 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.648333 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" event={"ID":"4ecbaf65-5737-4694-927b-05044e8606c1","Type":"ContainerStarted","Data":"0eec6c8251db4196da61a82e30b80d4f89b7e3f3e9029ffd6d6de0f0ccfb3c10"} Apr 17 21:38:21.648455 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.648366 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" event={"ID":"4ecbaf65-5737-4694-927b-05044e8606c1","Type":"ContainerStarted","Data":"6331373c8922a2e5b482b36060cb00dccf8d0fc566d19533de596bc71525288c"} Apr 17 21:38:21.648455 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.648375 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" event={"ID":"4ecbaf65-5737-4694-927b-05044e8606c1","Type":"ContainerStarted","Data":"ab6fab0fca8123a25b798e115c74ee7701c3d614c768c89c93bb8ae4d76ac81a"} Apr 17 21:38:21.649364 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.649340 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nj256" event={"ID":"acf375eb-382e-4e70-8999-46983d601f3f","Type":"ContainerStarted","Data":"b5615f0c76472a60a9d311e34fd41e5d6b02c84183c8eebbc6fb7bf2ea43b292"} Apr 17 21:38:21.650285 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.650262 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" event={"ID":"1be66022-a026-418d-9603-35f0917b4aec","Type":"ContainerStarted","Data":"343004eb9cc6584f0d1b5d46924c39a89edbc9dcef10d1f1fe0b6df7570f55b8"} Apr 17 21:38:21.651200 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.651178 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tb94q" event={"ID":"239dc9d6-2782-48f3-82ef-7b176001f318","Type":"ContainerStarted","Data":"a29568e5017efbd2b453f789bd8aaa930a25626ecf8f583c0918a9e00eb06696"} Apr 17 21:38:21.653995 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.653973 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8988736-278d-4d25-b0aa-85538c273612","Type":"ContainerStarted","Data":"7ac8d6203b305d7fab1c8516d3c3eca9c444b6e24bb2a09fbf9953c3c321a5bc"} Apr 17 21:38:21.654067 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.654001 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8988736-278d-4d25-b0aa-85538c273612","Type":"ContainerStarted","Data":"6ea8db4d89f1e1d0ec779aa935f6a7a6f5de8ded20b8282b092a52eefb22cdf1"} Apr 17 21:38:21.654067 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.654012 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8988736-278d-4d25-b0aa-85538c273612","Type":"ContainerStarted","Data":"1dc724e46b9f383c770a368388c85c46f9ac6f412d26fb7b35309cfefd45291b"} Apr 17 21:38:21.654067 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.654020 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8988736-278d-4d25-b0aa-85538c273612","Type":"ContainerStarted","Data":"fc079a9601b196ef1703016b49fea9b1a46e0e2012de6911ace73ee33c60c8fc"} Apr 17 21:38:21.654067 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.654032 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8988736-278d-4d25-b0aa-85538c273612","Type":"ContainerStarted","Data":"4f5e20fc049df22374806a27644480719152aa54cda2beacc6f01751faa7c6b5"} Apr 17 21:38:21.654976 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.654960 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786f7c65fc-89p9h" event={"ID":"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb","Type":"ContainerStarted","Data":"4bb3134a4443dbaa4e28ef01284a40e80b11df02534db2a5da0a8e75ce2dd2c6"} Apr 17 21:38:21.751312 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.751276 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:21.876620 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:21.876592 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Apr 17 21:38:21.879675 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:21.879645 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f284c77_ef5d_4fa5_bb48_57a03e95cf83.slice/crio-08b5c52139d4ac83a9162261ea8548c8b68d5d0f03ee260fa3901de0b9bfe513 WatchSource:0}: Error finding container 08b5c52139d4ac83a9162261ea8548c8b68d5d0f03ee260fa3901de0b9bfe513: Status 404 returned error can't find the container with id 08b5c52139d4ac83a9162261ea8548c8b68d5d0f03ee260fa3901de0b9bfe513 Apr 17 21:38:22.667289 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:22.667194 2575 generic.go:358] "Generic (PLEG): container finished" podID="4f284c77-ef5d-4fa5-bb48-57a03e95cf83" containerID="7f92d68521a23c786c35172e4787f5679fd496dea1bd75a7148e1352df63a845" exitCode=0 Apr 17 21:38:22.667582 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:22.667533 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f284c77-ef5d-4fa5-bb48-57a03e95cf83","Type":"ContainerDied","Data":"7f92d68521a23c786c35172e4787f5679fd496dea1bd75a7148e1352df63a845"} Apr 17 21:38:22.667693 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:22.667622 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f284c77-ef5d-4fa5-bb48-57a03e95cf83","Type":"ContainerStarted","Data":"08b5c52139d4ac83a9162261ea8548c8b68d5d0f03ee260fa3901de0b9bfe513"} Apr 17 21:38:22.674013 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:22.673986 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f8988736-278d-4d25-b0aa-85538c273612","Type":"ContainerStarted","Data":"6759af62583da16a369635208e8aedebaa58c3801c88a683a4af9dce036385e5"} Apr 17 21:38:22.676518 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:22.676432 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786f7c65fc-89p9h" event={"ID":"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb","Type":"ContainerStarted","Data":"0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb"} Apr 17 21:38:22.680105 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:22.680077 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" event={"ID":"4ecbaf65-5737-4694-927b-05044e8606c1","Type":"ContainerStarted","Data":"a3b61185ecd3dc393005ec6d1671d784cff950b48c3b09bb632b1e6eef9ecb64"} Apr 17 21:38:22.680178 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:22.680113 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" event={"ID":"4ecbaf65-5737-4694-927b-05044e8606c1","Type":"ContainerStarted","Data":"cde6bd470538eccdeab84ad09edebe06a06d22b977dcb83ce1895b58c604b84a"} Apr 17 21:38:22.718189 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:22.717961 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5323768490000003 podStartE2EDuration="6.717945473s" podCreationTimestamp="2026-04-17 21:38:16 +0000 UTC" firstStartedPulling="2026-04-17 21:38:18.22716818 +0000 UTC m=+62.568331396" lastFinishedPulling="2026-04-17 21:38:22.412736789 +0000 UTC m=+66.753900020" observedRunningTime="2026-04-17 21:38:22.717900646 +0000 UTC m=+67.059063887" watchObservedRunningTime="2026-04-17 21:38:22.717945473 +0000 UTC m=+67.059108710" Apr 17 21:38:23.694032 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:23.693948 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" event={"ID":"4ecbaf65-5737-4694-927b-05044e8606c1","Type":"ContainerStarted","Data":"4ab40c1470ae4200dc1d70ac5d9dc145c077ab5b81b96e7dfe78a01a806d6551"} Apr 17 21:38:23.694518 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:23.694499 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:23.695970 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:23.695942 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nj256" event={"ID":"acf375eb-382e-4e70-8999-46983d601f3f","Type":"ContainerStarted","Data":"83b0930d07ce39a85b2ff573efb46d186b89f4100bb71f0d2d77742fd4723d90"} Apr 17 21:38:23.698765 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:23.698748 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" event={"ID":"1be66022-a026-418d-9603-35f0917b4aec","Type":"ContainerStarted","Data":"100be14929201c7910318b9be9f323cdd46f31094c9f0f42c12e840bf0653457"} Apr 17 21:38:23.698918 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:23.698902 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" event={"ID":"1be66022-a026-418d-9603-35f0917b4aec","Type":"ContainerStarted","Data":"061c047255255e24cee24779e37d2f6184006f4e87732c2725dc77496a07fb60"} Apr 17 21:38:23.716240 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:23.715811 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" podStartSLOduration=1.942994139 podStartE2EDuration="5.715792881s" podCreationTimestamp="2026-04-17 21:38:18 +0000 UTC" firstStartedPulling="2026-04-17 21:38:18.637158261 +0000 UTC m=+62.978321478" lastFinishedPulling="2026-04-17 21:38:22.40995699 +0000 UTC m=+66.751120220" observedRunningTime="2026-04-17 21:38:23.71427101 +0000 UTC m=+68.055434254" watchObservedRunningTime="2026-04-17 21:38:23.715792881 +0000 UTC m=+68.056956119" Apr 17 21:38:23.716712 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:23.716664 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-786f7c65fc-89p9h" podStartSLOduration=3.71665238 podStartE2EDuration="3.71665238s" podCreationTimestamp="2026-04-17 21:38:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 21:38:22.738951231 +0000 UTC m=+67.080114480" watchObservedRunningTime="2026-04-17 21:38:23.71665238 +0000 UTC m=+68.057815618" Apr 17 21:38:25.710015 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:25.709977 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" event={"ID":"1be66022-a026-418d-9603-35f0917b4aec","Type":"ContainerStarted","Data":"dd75baf514b74e3222bc6d0a1c77ff969bde921fcbbcc53fb276a9d76e43a4b0"} Apr 17 21:38:25.732727 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:25.731517 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7dfd584d58-pbx5c" podStartSLOduration=3.674244234 podStartE2EDuration="5.731497248s" podCreationTimestamp="2026-04-17 21:38:20 +0000 UTC" firstStartedPulling="2026-04-17 21:38:21.38019035 +0000 UTC m=+65.721353571" lastFinishedPulling="2026-04-17 21:38:23.437443365 +0000 UTC m=+67.778606585" observedRunningTime="2026-04-17 21:38:25.730681312 +0000 UTC m=+70.071844551" watchObservedRunningTime="2026-04-17 21:38:25.731497248 +0000 UTC m=+70.072660487" Apr 17 21:38:25.756420 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:25.756390 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-925tc_0762a6a9-50ab-41b1-b029-2a12a45708fd/serve-healthcheck-canary/0.log" Apr 17 21:38:26.345071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.345039 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786f7c65fc-89p9h"] Apr 17 21:38:26.382517 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.381501 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f664d7d65-bhdqr"] Apr 17 21:38:26.403449 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.402931 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f664d7d65-bhdqr"] Apr 17 21:38:26.403449 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.403097 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.487573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.483309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-trusted-ca-bundle\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.487573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.483414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-service-ca\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.487573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.483447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-oauth-config\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.487573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.483502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-oauth-serving-cert\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.487573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.483620 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nfvj\" (UniqueName: \"kubernetes.io/projected/7b55338f-b890-4b21-b119-e564bf62f35e-kube-api-access-5nfvj\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.487573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.483722 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-serving-cert\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.487573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.483799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-console-config\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.584521 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.584483 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-console-config\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.584663 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.584594 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-trusted-ca-bundle\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.584663 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.584636 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-service-ca\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.584787 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.584663 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-oauth-config\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.584787 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.584685 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-oauth-serving-cert\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.584787 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.584723 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nfvj\" (UniqueName: \"kubernetes.io/projected/7b55338f-b890-4b21-b119-e564bf62f35e-kube-api-access-5nfvj\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.584948 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.584785 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-serving-cert\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.585975 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.585944 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-service-ca\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.586165 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.586132 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-console-config\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.586306 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.586252 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-oauth-serving-cert\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.597341 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.597310 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-oauth-config\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.597494 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.597314 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-serving-cert\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.597610 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.597589 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-trusted-ca-bundle\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.599367 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.599344 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nfvj\" (UniqueName: \"kubernetes.io/projected/7b55338f-b890-4b21-b119-e564bf62f35e-kube-api-access-5nfvj\") pod \"console-6f664d7d65-bhdqr\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.714086 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.714047 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tb94q" event={"ID":"239dc9d6-2782-48f3-82ef-7b176001f318","Type":"ContainerStarted","Data":"7d9a65516b9ec08e848efcb987caacc4434856a8308c1ad4d213aaec1cc34fd3"} Apr 17 21:38:26.714449 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.714282 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:38:26.717206 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.717179 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f284c77-ef5d-4fa5-bb48-57a03e95cf83","Type":"ContainerStarted","Data":"dfdd68824c59a0fad4dd78a8a09409e8c0d3f0e0212340d743646c6bfdb4279c"} Apr 17 21:38:26.717328 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.717213 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f284c77-ef5d-4fa5-bb48-57a03e95cf83","Type":"ContainerStarted","Data":"9eb6fae26b9bb214262174e3ca1dae656f97a221c784b265e9f7b32a90c51ae8"} Apr 17 21:38:26.717328 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.717227 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f284c77-ef5d-4fa5-bb48-57a03e95cf83","Type":"ContainerStarted","Data":"ae8165c142bd493246a91b072612a4c452ed1d4bdbd41f155be4ab970f7679b7"} Apr 17 21:38:26.717328 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.717239 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f284c77-ef5d-4fa5-bb48-57a03e95cf83","Type":"ContainerStarted","Data":"65e7c9027abd2ec186408914a9ed196b245f5ea2710734eb2cf6987cc2a654eb"} Apr 17 21:38:26.718982 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.718869 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nj256" event={"ID":"acf375eb-382e-4e70-8999-46983d601f3f","Type":"ContainerStarted","Data":"44364a208be09fa39e7009a734e876539d49da5fc57c3abdcea5427aa736e103"} Apr 17 21:38:26.723521 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.723500 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:26.728740 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.728692 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tb94q" podStartSLOduration=66.055792086 podStartE2EDuration="1m10.728677903s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:38:21.426135462 +0000 UTC m=+65.767298685" lastFinishedPulling="2026-04-17 21:38:26.099021273 +0000 UTC m=+70.440184502" observedRunningTime="2026-04-17 21:38:26.728382769 +0000 UTC m=+71.069546008" watchObservedRunningTime="2026-04-17 21:38:26.728677903 +0000 UTC m=+71.069841180" Apr 17 21:38:26.742865 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.742774 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nj256" podStartSLOduration=68.907370645 podStartE2EDuration="1m10.742757911s" podCreationTimestamp="2026-04-17 21:37:16 +0000 UTC" firstStartedPulling="2026-04-17 21:38:21.599119404 +0000 UTC m=+65.940282620" lastFinishedPulling="2026-04-17 21:38:23.434506652 +0000 UTC m=+67.775669886" observedRunningTime="2026-04-17 21:38:26.742091746 +0000 UTC m=+71.083254985" watchObservedRunningTime="2026-04-17 21:38:26.742757911 +0000 UTC m=+71.083921150" Apr 17 21:38:26.854775 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:26.854739 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f664d7d65-bhdqr"] Apr 17 21:38:26.857330 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:38:26.857301 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b55338f_b890_4b21_b119_e564bf62f35e.slice/crio-f481281024ad567f73f1aa551482a62feb5d2299077355f0a5c678ab2d7d155a WatchSource:0}: Error finding container f481281024ad567f73f1aa551482a62feb5d2299077355f0a5c678ab2d7d155a: Status 404 returned error can't find the container with id f481281024ad567f73f1aa551482a62feb5d2299077355f0a5c678ab2d7d155a Apr 17 21:38:27.724168 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:27.724131 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f664d7d65-bhdqr" event={"ID":"7b55338f-b890-4b21-b119-e564bf62f35e","Type":"ContainerStarted","Data":"736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c"} Apr 17 21:38:27.724168 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:27.724174 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f664d7d65-bhdqr" event={"ID":"7b55338f-b890-4b21-b119-e564bf62f35e","Type":"ContainerStarted","Data":"f481281024ad567f73f1aa551482a62feb5d2299077355f0a5c678ab2d7d155a"} Apr 17 21:38:27.727076 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:27.727050 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f284c77-ef5d-4fa5-bb48-57a03e95cf83","Type":"ContainerStarted","Data":"c18932ab59e57b8d1012c59e0253bbd34a2dcdae3feb5e80d37db87efa4597c7"} Apr 17 21:38:27.727191 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:27.727081 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4f284c77-ef5d-4fa5-bb48-57a03e95cf83","Type":"ContainerStarted","Data":"d98f973a36680efc6dd5c1279a9af9fd171434928f2abc8824d216c6398f9be5"} Apr 17 21:38:27.754882 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:27.754830 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6f664d7d65-bhdqr" podStartSLOduration=1.754813143 podStartE2EDuration="1.754813143s" podCreationTimestamp="2026-04-17 21:38:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 21:38:27.753312389 +0000 UTC m=+72.094475639" watchObservedRunningTime="2026-04-17 21:38:27.754813143 +0000 UTC m=+72.095976381" Apr 17 21:38:27.782245 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:27.782188 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.34745003 podStartE2EDuration="6.782173036s" podCreationTimestamp="2026-04-17 21:38:21 +0000 UTC" firstStartedPulling="2026-04-17 21:38:22.669365355 +0000 UTC m=+67.010528575" lastFinishedPulling="2026-04-17 21:38:26.10408835 +0000 UTC m=+70.445251581" observedRunningTime="2026-04-17 21:38:27.780264317 +0000 UTC m=+72.121427556" watchObservedRunningTime="2026-04-17 21:38:27.782173036 +0000 UTC m=+72.123336273" Apr 17 21:38:29.708874 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:29.708843 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c79454d6-6qrg8" Apr 17 21:38:30.700488 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:30.700446 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:31.752128 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:31.752095 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:38:36.724295 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:36.724156 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:36.724295 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:36.724216 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:36.730198 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:36.730175 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:36.760088 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:36.760057 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:38:36.805327 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:36.805292 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd6974c9d-pnhbr"] Apr 17 21:38:42.728780 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:42.728715 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-79f9d86c79-xxzwc" podUID="be716b2a-fe46-4058-a0e9-7c76efd710e3" containerName="console" containerID="cri-o://7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d" gracePeriod=15 Apr 17 21:38:42.971070 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:42.971046 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79f9d86c79-xxzwc_be716b2a-fe46-4058-a0e9-7c76efd710e3/console/0.log" Apr 17 21:38:42.971182 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:42.971118 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:43.035691 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.035663 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-serving-cert\") pod \"be716b2a-fe46-4058-a0e9-7c76efd710e3\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " Apr 17 21:38:43.035834 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.035745 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ncdf\" (UniqueName: \"kubernetes.io/projected/be716b2a-fe46-4058-a0e9-7c76efd710e3-kube-api-access-2ncdf\") pod \"be716b2a-fe46-4058-a0e9-7c76efd710e3\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " Apr 17 21:38:43.035834 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.035772 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-config\") pod \"be716b2a-fe46-4058-a0e9-7c76efd710e3\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " Apr 17 21:38:43.035834 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.035788 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-service-ca\") pod \"be716b2a-fe46-4058-a0e9-7c76efd710e3\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " Apr 17 21:38:43.035834 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.035805 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-oauth-serving-cert\") pod \"be716b2a-fe46-4058-a0e9-7c76efd710e3\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " Apr 17 21:38:43.036034 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.035874 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-oauth-config\") pod \"be716b2a-fe46-4058-a0e9-7c76efd710e3\" (UID: \"be716b2a-fe46-4058-a0e9-7c76efd710e3\") " Apr 17 21:38:43.036284 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.036246 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-config" (OuterVolumeSpecName: "console-config") pod "be716b2a-fe46-4058-a0e9-7c76efd710e3" (UID: "be716b2a-fe46-4058-a0e9-7c76efd710e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:38:43.036284 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.036271 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "be716b2a-fe46-4058-a0e9-7c76efd710e3" (UID: "be716b2a-fe46-4058-a0e9-7c76efd710e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:38:43.036468 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.036254 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "be716b2a-fe46-4058-a0e9-7c76efd710e3" (UID: "be716b2a-fe46-4058-a0e9-7c76efd710e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:38:43.038028 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.038005 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "be716b2a-fe46-4058-a0e9-7c76efd710e3" (UID: "be716b2a-fe46-4058-a0e9-7c76efd710e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:38:43.038152 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.038130 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be716b2a-fe46-4058-a0e9-7c76efd710e3-kube-api-access-2ncdf" (OuterVolumeSpecName: "kube-api-access-2ncdf") pod "be716b2a-fe46-4058-a0e9-7c76efd710e3" (UID: "be716b2a-fe46-4058-a0e9-7c76efd710e3"). InnerVolumeSpecName "kube-api-access-2ncdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 21:38:43.038201 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.038130 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "be716b2a-fe46-4058-a0e9-7c76efd710e3" (UID: "be716b2a-fe46-4058-a0e9-7c76efd710e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:38:43.137006 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.136951 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ncdf\" (UniqueName: \"kubernetes.io/projected/be716b2a-fe46-4058-a0e9-7c76efd710e3-kube-api-access-2ncdf\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:43.137006 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.137001 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:43.137006 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.137014 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-service-ca\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:43.137242 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.137027 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be716b2a-fe46-4058-a0e9-7c76efd710e3-oauth-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:43.137242 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.137043 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-oauth-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:43.137242 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.137055 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be716b2a-fe46-4058-a0e9-7c76efd710e3-console-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:43.782760 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.782732 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79f9d86c79-xxzwc_be716b2a-fe46-4058-a0e9-7c76efd710e3/console/0.log" Apr 17 21:38:43.783200 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.782772 2575 generic.go:358] "Generic (PLEG): container finished" podID="be716b2a-fe46-4058-a0e9-7c76efd710e3" containerID="7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d" exitCode=2 Apr 17 21:38:43.783200 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.782808 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9d86c79-xxzwc" event={"ID":"be716b2a-fe46-4058-a0e9-7c76efd710e3","Type":"ContainerDied","Data":"7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d"} Apr 17 21:38:43.783200 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.782838 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f9d86c79-xxzwc" Apr 17 21:38:43.783200 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.782849 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f9d86c79-xxzwc" event={"ID":"be716b2a-fe46-4058-a0e9-7c76efd710e3","Type":"ContainerDied","Data":"de1c84e0dcd42504080dee53bb6a309dc1590c17a81f5e40a2eab4b6292536ff"} Apr 17 21:38:43.783200 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.782868 2575 scope.go:117] "RemoveContainer" containerID="7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d" Apr 17 21:38:43.792289 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.792271 2575 scope.go:117] "RemoveContainer" containerID="7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d" Apr 17 21:38:43.792540 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:43.792518 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d\": container with ID starting with 7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d not found: ID does not exist" containerID="7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d" Apr 17 21:38:43.792687 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.792653 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d"} err="failed to get container status \"7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d\": rpc error: code = NotFound desc = could not find container \"7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d\": container with ID starting with 7ca2b0b6cf39e11b652143c3ab24bc031a1916b9400fd3101faba5f80491641d not found: ID does not exist" Apr 17 21:38:43.805173 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.805150 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f9d86c79-xxzwc"] Apr 17 21:38:43.808870 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:43.808847 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79f9d86c79-xxzwc"] Apr 17 21:38:44.261896 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:44.261861 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be716b2a-fe46-4058-a0e9-7c76efd710e3" path="/var/lib/kubelet/pods/be716b2a-fe46-4058-a0e9-7c76efd710e3/volumes" Apr 17 21:38:51.366215 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.366154 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-786f7c65fc-89p9h" podUID="6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" containerName="console" containerID="cri-o://0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb" gracePeriod=15 Apr 17 21:38:51.627511 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.627456 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-786f7c65fc-89p9h_6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb/console/0.log" Apr 17 21:38:51.627648 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.627516 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:51.807126 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.807096 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-786f7c65fc-89p9h_6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb/console/0.log" Apr 17 21:38:51.807292 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.807141 2575 generic.go:358] "Generic (PLEG): container finished" podID="6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" containerID="0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb" exitCode=2 Apr 17 21:38:51.807292 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.807201 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786f7c65fc-89p9h" Apr 17 21:38:51.807292 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.807228 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786f7c65fc-89p9h" event={"ID":"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb","Type":"ContainerDied","Data":"0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb"} Apr 17 21:38:51.807292 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.807271 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786f7c65fc-89p9h" event={"ID":"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb","Type":"ContainerDied","Data":"4bb3134a4443dbaa4e28ef01284a40e80b11df02534db2a5da0a8e75ce2dd2c6"} Apr 17 21:38:51.807292 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.807287 2575 scope.go:117] "RemoveContainer" containerID="0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb" Apr 17 21:38:51.810471 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810453 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-serving-cert\") pod \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " Apr 17 21:38:51.810570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810491 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-config\") pod \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " Apr 17 21:38:51.810570 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810522 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-trusted-ca-bundle\") pod \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " Apr 17 21:38:51.810652 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810573 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj7fb\" (UniqueName: \"kubernetes.io/projected/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-kube-api-access-gj7fb\") pod \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " Apr 17 21:38:51.810652 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810603 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-oauth-config\") pod \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " Apr 17 21:38:51.810652 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810638 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-oauth-serving-cert\") pod \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " Apr 17 21:38:51.810787 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810686 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-service-ca\") pod \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\" (UID: \"6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb\") " Apr 17 21:38:51.810995 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810919 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" (UID: "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:38:51.811101 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.810988 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-config" (OuterVolumeSpecName: "console-config") pod "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" (UID: "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:38:51.811283 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.811237 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" (UID: "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:38:51.811283 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.811264 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" (UID: "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:38:51.813127 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.813087 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-kube-api-access-gj7fb" (OuterVolumeSpecName: "kube-api-access-gj7fb") pod "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" (UID: "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb"). InnerVolumeSpecName "kube-api-access-gj7fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 21:38:51.813214 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.813170 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" (UID: "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:38:51.813214 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.813183 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" (UID: "6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:38:51.815627 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.815603 2575 scope.go:117] "RemoveContainer" containerID="0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb" Apr 17 21:38:51.815900 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:38:51.815880 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb\": container with ID starting with 0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb not found: ID does not exist" containerID="0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb" Apr 17 21:38:51.815974 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.815907 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb"} err="failed to get container status \"0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb\": rpc error: code = NotFound desc = could not find container \"0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb\": container with ID starting with 0ca8d362f47db619f7c7cb932102c1534103a5bf13dcb0eb6cad1d7e4ce1e7bb not found: ID does not exist" Apr 17 21:38:51.911813 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.911735 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-oauth-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:51.911813 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.911765 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-service-ca\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:51.911813 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.911775 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:51.911813 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.911786 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:51.911813 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.911794 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-trusted-ca-bundle\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:51.911813 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.911803 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj7fb\" (UniqueName: \"kubernetes.io/projected/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-kube-api-access-gj7fb\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:51.911813 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:51.911812 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb-console-oauth-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:38:52.128672 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:52.128637 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786f7c65fc-89p9h"] Apr 17 21:38:52.133452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:52.133421 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-786f7c65fc-89p9h"] Apr 17 21:38:52.263349 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:52.263314 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" path="/var/lib/kubelet/pods/6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb/volumes" Apr 17 21:38:57.729610 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:38:57.729581 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tb94q" Apr 17 21:39:01.828759 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:01.828697 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7bd6974c9d-pnhbr" podUID="3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" containerName="console" containerID="cri-o://c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d" gracePeriod=15 Apr 17 21:39:02.077298 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.077275 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd6974c9d-pnhbr_3a88b7a0-b9ef-49db-a2f8-9782cb6c7960/console/0.log" Apr 17 21:39:02.077408 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.077337 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:39:02.096071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096004 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-oauth-config\") pod \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " Apr 17 21:39:02.096071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096044 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-oauth-serving-cert\") pod \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " Apr 17 21:39:02.096290 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096075 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-service-ca\") pod \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " Apr 17 21:39:02.096290 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096202 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-config\") pod \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " Apr 17 21:39:02.096290 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096258 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmjh6\" (UniqueName: \"kubernetes.io/projected/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-kube-api-access-rmjh6\") pod \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " Apr 17 21:39:02.096443 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096307 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-serving-cert\") pod \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " Apr 17 21:39:02.096597 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096571 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" (UID: "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:39:02.096677 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096571 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" (UID: "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:39:02.096677 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096612 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-config" (OuterVolumeSpecName: "console-config") pod "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" (UID: "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:39:02.096777 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096588 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-trusted-ca-bundle\") pod \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\" (UID: \"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960\") " Apr 17 21:39:02.097024 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.096995 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" (UID: "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:39:02.097115 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.097037 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-oauth-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:39:02.097115 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.097057 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-service-ca\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:39:02.097115 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.097073 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:39:02.098960 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.098725 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-kube-api-access-rmjh6" (OuterVolumeSpecName: "kube-api-access-rmjh6") pod "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" (UID: "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960"). InnerVolumeSpecName "kube-api-access-rmjh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 21:39:02.098960 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.098814 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" (UID: "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:39:02.099105 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.098973 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" (UID: "3a88b7a0-b9ef-49db-a2f8-9782cb6c7960"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:39:02.197476 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.197429 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmjh6\" (UniqueName: \"kubernetes.io/projected/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-kube-api-access-rmjh6\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:39:02.197476 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.197469 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:39:02.197476 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.197482 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-trusted-ca-bundle\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:39:02.197718 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.197496 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960-console-oauth-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:39:02.843827 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.843797 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd6974c9d-pnhbr_3a88b7a0-b9ef-49db-a2f8-9782cb6c7960/console/0.log" Apr 17 21:39:02.844224 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.843836 2575 generic.go:358] "Generic (PLEG): container finished" podID="3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" containerID="c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d" exitCode=2 Apr 17 21:39:02.844224 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.843895 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd6974c9d-pnhbr" event={"ID":"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960","Type":"ContainerDied","Data":"c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d"} Apr 17 21:39:02.844224 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.843905 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd6974c9d-pnhbr" Apr 17 21:39:02.844224 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.843921 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd6974c9d-pnhbr" event={"ID":"3a88b7a0-b9ef-49db-a2f8-9782cb6c7960","Type":"ContainerDied","Data":"af8d3a639152b0a6ce84581120182de2229e25040337ef205806aa34df28bf69"} Apr 17 21:39:02.844224 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.843935 2575 scope.go:117] "RemoveContainer" containerID="c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d" Apr 17 21:39:02.851641 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.851623 2575 scope.go:117] "RemoveContainer" containerID="c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d" Apr 17 21:39:02.851917 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:39:02.851897 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d\": container with ID starting with c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d not found: ID does not exist" containerID="c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d" Apr 17 21:39:02.851986 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.851930 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d"} err="failed to get container status \"c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d\": rpc error: code = NotFound desc = could not find container \"c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d\": container with ID starting with c637ac4d2b3f0bc36ada65888f67d339d0b5fca937dc808d0d060eac70645c3d not found: ID does not exist" Apr 17 21:39:02.862109 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.862080 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd6974c9d-pnhbr"] Apr 17 21:39:02.864656 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:02.864632 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd6974c9d-pnhbr"] Apr 17 21:39:04.262826 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:04.262793 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" path="/var/lib/kubelet/pods/3a88b7a0-b9ef-49db-a2f8-9782cb6c7960/volumes" Apr 17 21:39:21.752097 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:21.752052 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:39:21.771695 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:21.771664 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:39:21.915361 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:21.915333 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Apr 17 21:39:34.285102 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285066 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5994969bd9-qc8g5"] Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285408 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be716b2a-fe46-4058-a0e9-7c76efd710e3" containerName="console" Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285421 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="be716b2a-fe46-4058-a0e9-7c76efd710e3" containerName="console" Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285434 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" containerName="console" Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285439 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" containerName="console" Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285451 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" containerName="console" Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285456 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" containerName="console" Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285502 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="be716b2a-fe46-4058-a0e9-7c76efd710e3" containerName="console" Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285514 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a88b7a0-b9ef-49db-a2f8-9782cb6c7960" containerName="console" Apr 17 21:39:34.285877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.285522 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e5d2fbf-ccb6-4524-bafd-09ac81c9a3fb" containerName="console" Apr 17 21:39:34.288394 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.288377 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.298685 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.298658 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5994969bd9-qc8g5"] Apr 17 21:39:34.361065 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.361025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-oauth-serving-cert\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.361065 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.361066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-console-config\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.361282 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.361085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb6s4\" (UniqueName: \"kubernetes.io/projected/3922af99-8921-431f-83b3-2aeebc5265b4-kube-api-access-mb6s4\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.361282 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.361105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-trusted-ca-bundle\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.361282 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.361183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-oauth-config\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.361282 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.361222 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-serving-cert\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.361282 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.361273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-service-ca\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.462191 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.462148 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-oauth-serving-cert\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.462191 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.462194 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-console-config\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.462392 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.462311 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mb6s4\" (UniqueName: \"kubernetes.io/projected/3922af99-8921-431f-83b3-2aeebc5265b4-kube-api-access-mb6s4\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.462392 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.462359 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-trusted-ca-bundle\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.462458 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.462418 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-oauth-config\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.462620 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.462592 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-serving-cert\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.462713 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.462692 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-service-ca\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.463014 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.462992 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-console-config\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.463014 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.463003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-oauth-serving-cert\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.463258 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.463230 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-service-ca\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.463397 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.463378 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-trusted-ca-bundle\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.464920 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.464903 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-oauth-config\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.465024 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.465006 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-serving-cert\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.469660 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.469642 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb6s4\" (UniqueName: \"kubernetes.io/projected/3922af99-8921-431f-83b3-2aeebc5265b4-kube-api-access-mb6s4\") pod \"console-5994969bd9-qc8g5\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.597359 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.597268 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:34.736934 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.736902 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5994969bd9-qc8g5"] Apr 17 21:39:34.739831 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:39:34.739802 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3922af99_8921_431f_83b3_2aeebc5265b4.slice/crio-b262510cef487979d5c69d11c5b493fa2e4f1cc6becf7d4d82e912e89cf4476f WatchSource:0}: Error finding container b262510cef487979d5c69d11c5b493fa2e4f1cc6becf7d4d82e912e89cf4476f: Status 404 returned error can't find the container with id b262510cef487979d5c69d11c5b493fa2e4f1cc6becf7d4d82e912e89cf4476f Apr 17 21:39:34.941719 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.941632 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994969bd9-qc8g5" event={"ID":"3922af99-8921-431f-83b3-2aeebc5265b4","Type":"ContainerStarted","Data":"3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27"} Apr 17 21:39:34.941719 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.941670 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994969bd9-qc8g5" event={"ID":"3922af99-8921-431f-83b3-2aeebc5265b4","Type":"ContainerStarted","Data":"b262510cef487979d5c69d11c5b493fa2e4f1cc6becf7d4d82e912e89cf4476f"} Apr 17 21:39:34.958727 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:34.958679 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5994969bd9-qc8g5" podStartSLOduration=0.958665036 podStartE2EDuration="958.665036ms" podCreationTimestamp="2026-04-17 21:39:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 21:39:34.956882635 +0000 UTC m=+139.298045910" watchObservedRunningTime="2026-04-17 21:39:34.958665036 +0000 UTC m=+139.299828274" Apr 17 21:39:44.597904 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:44.597854 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:44.597904 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:44.597913 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:44.602455 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:44.602433 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:44.972798 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:44.972718 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:39:45.017189 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:39:45.017153 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f664d7d65-bhdqr"] Apr 17 21:40:10.036609 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.036477 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6f664d7d65-bhdqr" podUID="7b55338f-b890-4b21-b119-e564bf62f35e" containerName="console" containerID="cri-o://736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c" gracePeriod=15 Apr 17 21:40:10.278225 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.278202 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f664d7d65-bhdqr_7b55338f-b890-4b21-b119-e564bf62f35e/console/0.log" Apr 17 21:40:10.278350 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.278275 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:40:10.368257 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368169 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-trusted-ca-bundle\") pod \"7b55338f-b890-4b21-b119-e564bf62f35e\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " Apr 17 21:40:10.368257 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368232 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-service-ca\") pod \"7b55338f-b890-4b21-b119-e564bf62f35e\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " Apr 17 21:40:10.368257 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368258 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-oauth-config\") pod \"7b55338f-b890-4b21-b119-e564bf62f35e\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " Apr 17 21:40:10.368522 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368287 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-serving-cert\") pod \"7b55338f-b890-4b21-b119-e564bf62f35e\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " Apr 17 21:40:10.368522 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368308 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-oauth-serving-cert\") pod \"7b55338f-b890-4b21-b119-e564bf62f35e\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " Apr 17 21:40:10.368522 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368330 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-console-config\") pod \"7b55338f-b890-4b21-b119-e564bf62f35e\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " Apr 17 21:40:10.368522 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368356 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5nfvj\" (UniqueName: \"kubernetes.io/projected/7b55338f-b890-4b21-b119-e564bf62f35e-kube-api-access-5nfvj\") pod \"7b55338f-b890-4b21-b119-e564bf62f35e\" (UID: \"7b55338f-b890-4b21-b119-e564bf62f35e\") " Apr 17 21:40:10.368753 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368678 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7b55338f-b890-4b21-b119-e564bf62f35e" (UID: "7b55338f-b890-4b21-b119-e564bf62f35e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:40:10.368856 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368825 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7b55338f-b890-4b21-b119-e564bf62f35e" (UID: "7b55338f-b890-4b21-b119-e564bf62f35e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:40:10.368912 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368836 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-service-ca" (OuterVolumeSpecName: "service-ca") pod "7b55338f-b890-4b21-b119-e564bf62f35e" (UID: "7b55338f-b890-4b21-b119-e564bf62f35e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:40:10.368912 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.368869 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-console-config" (OuterVolumeSpecName: "console-config") pod "7b55338f-b890-4b21-b119-e564bf62f35e" (UID: "7b55338f-b890-4b21-b119-e564bf62f35e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:40:10.370513 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.370483 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7b55338f-b890-4b21-b119-e564bf62f35e" (UID: "7b55338f-b890-4b21-b119-e564bf62f35e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:40:10.370513 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.370500 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b55338f-b890-4b21-b119-e564bf62f35e-kube-api-access-5nfvj" (OuterVolumeSpecName: "kube-api-access-5nfvj") pod "7b55338f-b890-4b21-b119-e564bf62f35e" (UID: "7b55338f-b890-4b21-b119-e564bf62f35e"). InnerVolumeSpecName "kube-api-access-5nfvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 21:40:10.370678 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.370561 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7b55338f-b890-4b21-b119-e564bf62f35e" (UID: "7b55338f-b890-4b21-b119-e564bf62f35e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:40:10.469225 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.469184 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-trusted-ca-bundle\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:40:10.469225 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.469219 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-service-ca\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:40:10.469225 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.469229 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-oauth-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:40:10.469436 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.469238 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b55338f-b890-4b21-b119-e564bf62f35e-console-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:40:10.469436 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.469250 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-oauth-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:40:10.469436 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.469259 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b55338f-b890-4b21-b119-e564bf62f35e-console-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:40:10.469436 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:10.469267 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5nfvj\" (UniqueName: \"kubernetes.io/projected/7b55338f-b890-4b21-b119-e564bf62f35e-kube-api-access-5nfvj\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:40:11.047709 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.047682 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f664d7d65-bhdqr_7b55338f-b890-4b21-b119-e564bf62f35e/console/0.log" Apr 17 21:40:11.048196 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.047728 2575 generic.go:358] "Generic (PLEG): container finished" podID="7b55338f-b890-4b21-b119-e564bf62f35e" containerID="736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c" exitCode=2 Apr 17 21:40:11.048196 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.047790 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f664d7d65-bhdqr" Apr 17 21:40:11.048196 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.047804 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f664d7d65-bhdqr" event={"ID":"7b55338f-b890-4b21-b119-e564bf62f35e","Type":"ContainerDied","Data":"736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c"} Apr 17 21:40:11.048196 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.047843 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f664d7d65-bhdqr" event={"ID":"7b55338f-b890-4b21-b119-e564bf62f35e","Type":"ContainerDied","Data":"f481281024ad567f73f1aa551482a62feb5d2299077355f0a5c678ab2d7d155a"} Apr 17 21:40:11.048196 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.047866 2575 scope.go:117] "RemoveContainer" containerID="736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c" Apr 17 21:40:11.055766 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.055750 2575 scope.go:117] "RemoveContainer" containerID="736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c" Apr 17 21:40:11.056012 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:40:11.055990 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c\": container with ID starting with 736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c not found: ID does not exist" containerID="736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c" Apr 17 21:40:11.056061 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.056020 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c"} err="failed to get container status \"736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c\": rpc error: code = NotFound desc = could not find container \"736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c\": container with ID starting with 736f33e34fbf2e640eec83774e3616af58029da224aae77dcd104ad77001343c not found: ID does not exist" Apr 17 21:40:11.068722 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.068674 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f664d7d65-bhdqr"] Apr 17 21:40:11.070405 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:11.070384 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f664d7d65-bhdqr"] Apr 17 21:40:12.261844 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:12.261813 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b55338f-b890-4b21-b119-e564bf62f35e" path="/var/lib/kubelet/pods/7b55338f-b890-4b21-b119-e564bf62f35e/volumes" Apr 17 21:40:14.836341 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.836301 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-k8zmv"] Apr 17 21:40:14.836825 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.836801 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b55338f-b890-4b21-b119-e564bf62f35e" containerName="console" Apr 17 21:40:14.836892 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.836829 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b55338f-b890-4b21-b119-e564bf62f35e" containerName="console" Apr 17 21:40:14.836961 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.836947 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7b55338f-b890-4b21-b119-e564bf62f35e" containerName="console" Apr 17 21:40:14.843886 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.843858 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:14.845472 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.845448 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k8zmv"] Apr 17 21:40:14.846594 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.846573 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Apr 17 21:40:14.904922 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.904887 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-original-pull-secret\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:14.905069 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.904944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-dbus\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:14.905069 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:14.905029 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-kubelet-config\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:15.005632 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:15.005593 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-dbus\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:15.005792 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:15.005654 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-kubelet-config\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:15.005792 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:15.005686 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-original-pull-secret\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:15.005869 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:15.005810 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-kubelet-config\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:15.005869 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:15.005826 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-dbus\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:15.007889 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:15.007867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1-original-pull-secret\") pod \"global-pull-secret-syncer-k8zmv\" (UID: \"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1\") " pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:15.153944 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:15.153850 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k8zmv" Apr 17 21:40:15.267427 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:15.267405 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k8zmv"] Apr 17 21:40:15.269998 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:40:15.269971 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b3e6b9_2b5c_4c09_8aca_ae18c06b8ed1.slice/crio-67a7e4fa9844f1baf5477e36a1fdb088b2d1fe4cc1b181de9133a800c66b04d8 WatchSource:0}: Error finding container 67a7e4fa9844f1baf5477e36a1fdb088b2d1fe4cc1b181de9133a800c66b04d8: Status 404 returned error can't find the container with id 67a7e4fa9844f1baf5477e36a1fdb088b2d1fe4cc1b181de9133a800c66b04d8 Apr 17 21:40:16.064066 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:16.064020 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k8zmv" event={"ID":"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1","Type":"ContainerStarted","Data":"67a7e4fa9844f1baf5477e36a1fdb088b2d1fe4cc1b181de9133a800c66b04d8"} Apr 17 21:40:20.081450 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:20.081407 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k8zmv" event={"ID":"71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1","Type":"ContainerStarted","Data":"8e315b4131971c4b5dac8317839ed69eab8733f3719228667d0c44f69de85117"} Apr 17 21:40:20.097150 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:40:20.097103 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k8zmv" podStartSLOduration=2.211493085 podStartE2EDuration="6.097088442s" podCreationTimestamp="2026-04-17 21:40:14 +0000 UTC" firstStartedPulling="2026-04-17 21:40:15.271863601 +0000 UTC m=+179.613026817" lastFinishedPulling="2026-04-17 21:40:19.157458957 +0000 UTC m=+183.498622174" observedRunningTime="2026-04-17 21:40:20.095255544 +0000 UTC m=+184.436418784" watchObservedRunningTime="2026-04-17 21:40:20.097088442 +0000 UTC m=+184.438251679" Apr 17 21:41:15.163947 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.163909 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-dlwpm"] Apr 17 21:41:15.167359 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.167338 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" Apr 17 21:41:15.169802 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.169733 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Apr 17 21:41:15.170027 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.170010 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Apr 17 21:41:15.170118 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.170017 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2cn6k\"" Apr 17 21:41:15.174670 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.174646 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-dlwpm"] Apr 17 21:41:15.326265 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.326224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2pbq\" (UniqueName: \"kubernetes.io/projected/24cfdd51-8a5e-4005-9962-f39682615652-kube-api-access-f2pbq\") pod \"cert-manager-cainjector-8966b78d4-dlwpm\" (UID: \"24cfdd51-8a5e-4005-9962-f39682615652\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" Apr 17 21:41:15.326428 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.326279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24cfdd51-8a5e-4005-9962-f39682615652-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-dlwpm\" (UID: \"24cfdd51-8a5e-4005-9962-f39682615652\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" Apr 17 21:41:15.427014 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.426916 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2pbq\" (UniqueName: \"kubernetes.io/projected/24cfdd51-8a5e-4005-9962-f39682615652-kube-api-access-f2pbq\") pod \"cert-manager-cainjector-8966b78d4-dlwpm\" (UID: \"24cfdd51-8a5e-4005-9962-f39682615652\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" Apr 17 21:41:15.427014 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.426984 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24cfdd51-8a5e-4005-9962-f39682615652-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-dlwpm\" (UID: \"24cfdd51-8a5e-4005-9962-f39682615652\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" Apr 17 21:41:15.435424 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.435398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24cfdd51-8a5e-4005-9962-f39682615652-bound-sa-token\") pod \"cert-manager-cainjector-8966b78d4-dlwpm\" (UID: \"24cfdd51-8a5e-4005-9962-f39682615652\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" Apr 17 21:41:15.435573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.435532 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2pbq\" (UniqueName: \"kubernetes.io/projected/24cfdd51-8a5e-4005-9962-f39682615652-kube-api-access-f2pbq\") pod \"cert-manager-cainjector-8966b78d4-dlwpm\" (UID: \"24cfdd51-8a5e-4005-9962-f39682615652\") " pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" Apr 17 21:41:15.487061 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.487028 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" Apr 17 21:41:15.603785 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:15.603753 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-8966b78d4-dlwpm"] Apr 17 21:41:15.607641 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:41:15.607605 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24cfdd51_8a5e_4005_9962_f39682615652.slice/crio-9fa124fd18ed481f906e8c88a7363d93575591dbe00c92b78f282fd47041b19d WatchSource:0}: Error finding container 9fa124fd18ed481f906e8c88a7363d93575591dbe00c92b78f282fd47041b19d: Status 404 returned error can't find the container with id 9fa124fd18ed481f906e8c88a7363d93575591dbe00c92b78f282fd47041b19d Apr 17 21:41:16.247473 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:16.247427 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" event={"ID":"24cfdd51-8a5e-4005-9962-f39682615652","Type":"ContainerStarted","Data":"9fa124fd18ed481f906e8c88a7363d93575591dbe00c92b78f282fd47041b19d"} Apr 17 21:41:20.264205 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:20.264168 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" event={"ID":"24cfdd51-8a5e-4005-9962-f39682615652","Type":"ContainerStarted","Data":"858735ca3e6100facdde6f9501f76dd08f4e9ec692baa8bac55ceb15ccb7390d"} Apr 17 21:41:20.278045 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:20.277994 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-8966b78d4-dlwpm" podStartSLOduration=1.042105716 podStartE2EDuration="5.277980883s" podCreationTimestamp="2026-04-17 21:41:15 +0000 UTC" firstStartedPulling="2026-04-17 21:41:15.609392017 +0000 UTC m=+239.950555233" lastFinishedPulling="2026-04-17 21:41:19.845267179 +0000 UTC m=+244.186430400" observedRunningTime="2026-04-17 21:41:20.275678764 +0000 UTC m=+244.616841999" watchObservedRunningTime="2026-04-17 21:41:20.277980883 +0000 UTC m=+244.619144124" Apr 17 21:41:46.669690 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.669607 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm"] Apr 17 21:41:46.677405 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.677372 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.680268 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.680239 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lx4wk\"" Apr 17 21:41:46.680430 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.680362 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Apr 17 21:41:46.680430 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.680367 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Apr 17 21:41:46.680430 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.680399 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Apr 17 21:41:46.681865 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.681845 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Apr 17 21:41:46.688004 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.687983 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm"] Apr 17 21:41:46.814967 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.814925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1198586-dcbd-4bcd-a903-99b106886735-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.815131 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.814981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq9km\" (UniqueName: \"kubernetes.io/projected/f1198586-dcbd-4bcd-a903-99b106886735-kube-api-access-jq9km\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.815131 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.815070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1198586-dcbd-4bcd-a903-99b106886735-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.915899 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.915869 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1198586-dcbd-4bcd-a903-99b106886735-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.916055 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.915914 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9km\" (UniqueName: \"kubernetes.io/projected/f1198586-dcbd-4bcd-a903-99b106886735-kube-api-access-jq9km\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.916055 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.915946 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1198586-dcbd-4bcd-a903-99b106886735-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.918129 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.918105 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1198586-dcbd-4bcd-a903-99b106886735-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.918244 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.918155 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1198586-dcbd-4bcd-a903-99b106886735-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.937697 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.937637 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9km\" (UniqueName: \"kubernetes.io/projected/f1198586-dcbd-4bcd-a903-99b106886735-kube-api-access-jq9km\") pod \"opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm\" (UID: \"f1198586-dcbd-4bcd-a903-99b106886735\") " pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:46.989660 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:46.989632 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:47.120856 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:47.120823 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm"] Apr 17 21:41:47.124771 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:41:47.124738 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1198586_dcbd_4bcd_a903_99b106886735.slice/crio-5d9006f3824acdff75bb49d2deda6252b920a89946306e93b64de8e6428f9c87 WatchSource:0}: Error finding container 5d9006f3824acdff75bb49d2deda6252b920a89946306e93b64de8e6428f9c87: Status 404 returned error can't find the container with id 5d9006f3824acdff75bb49d2deda6252b920a89946306e93b64de8e6428f9c87 Apr 17 21:41:47.341301 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:47.341261 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" event={"ID":"f1198586-dcbd-4bcd-a903-99b106886735","Type":"ContainerStarted","Data":"5d9006f3824acdff75bb49d2deda6252b920a89946306e93b64de8e6428f9c87"} Apr 17 21:41:50.351629 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:50.351594 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" event={"ID":"f1198586-dcbd-4bcd-a903-99b106886735","Type":"ContainerStarted","Data":"8e9100bff048385efa76a98b169df016000c13ecf6a909adc03b39d956fff717"} Apr 17 21:41:50.352060 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:50.351675 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:41:56.425657 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.425606 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" podStartSLOduration=7.987879439 podStartE2EDuration="10.425590216s" podCreationTimestamp="2026-04-17 21:41:46 +0000 UTC" firstStartedPulling="2026-04-17 21:41:47.126437952 +0000 UTC m=+271.467601168" lastFinishedPulling="2026-04-17 21:41:49.564148729 +0000 UTC m=+273.905311945" observedRunningTime="2026-04-17 21:41:50.373352553 +0000 UTC m=+274.714515792" watchObservedRunningTime="2026-04-17 21:41:56.425590216 +0000 UTC m=+280.766753456" Apr 17 21:41:56.426643 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.426622 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8"] Apr 17 21:41:56.432109 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.432089 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.436439 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.436417 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Apr 17 21:41:56.437782 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.437756 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Apr 17 21:41:56.437956 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.437790 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4bhq5\"" Apr 17 21:41:56.437956 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.437864 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Apr 17 21:41:56.437956 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.437917 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Apr 17 21:41:56.438188 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.438172 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Apr 17 21:41:56.458695 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.458669 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8"] Apr 17 21:41:56.500167 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.500140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-metrics-cert\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.500322 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.500192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-manager-config\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.500322 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.500218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-cert\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.500322 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.500269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv68w\" (UniqueName: \"kubernetes.io/projected/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-kube-api-access-bv68w\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.601516 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.601468 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-metrics-cert\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.601724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.601597 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-manager-config\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.601724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.601626 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-cert\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.601724 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.601650 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bv68w\" (UniqueName: \"kubernetes.io/projected/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-kube-api-access-bv68w\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.602465 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.602434 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-manager-config\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.604261 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.604238 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-metrics-cert\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.604367 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.604304 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-cert\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.610071 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.610043 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv68w\" (UniqueName: \"kubernetes.io/projected/332f15d2-b99c-458b-8ba4-6a8bd4e3b609-kube-api-access-bv68w\") pod \"lws-controller-manager-64dbd89fbc-c6np8\" (UID: \"332f15d2-b99c-458b-8ba4-6a8bd4e3b609\") " pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.741561 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.741407 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:41:56.876826 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:56.876761 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8"] Apr 17 21:41:56.878976 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:41:56.878951 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332f15d2_b99c_458b_8ba4_6a8bd4e3b609.slice/crio-1558cc0c424d5a5e597d9f3f735e46b62cb90bbead892567b11026d3e3a3002e WatchSource:0}: Error finding container 1558cc0c424d5a5e597d9f3f735e46b62cb90bbead892567b11026d3e3a3002e: Status 404 returned error can't find the container with id 1558cc0c424d5a5e597d9f3f735e46b62cb90bbead892567b11026d3e3a3002e Apr 17 21:41:57.373504 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:41:57.373467 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" event={"ID":"332f15d2-b99c-458b-8ba4-6a8bd4e3b609","Type":"ContainerStarted","Data":"1558cc0c424d5a5e597d9f3f735e46b62cb90bbead892567b11026d3e3a3002e"} Apr 17 21:42:00.385308 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:00.385271 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" event={"ID":"332f15d2-b99c-458b-8ba4-6a8bd4e3b609","Type":"ContainerStarted","Data":"6660ff1a27405e0c59f818768bb0647928ed131a56be50a1502cfd6a8f7e3c63"} Apr 17 21:42:00.385765 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:00.385386 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:42:00.405852 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:00.405800 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" podStartSLOduration=1.741880374 podStartE2EDuration="4.405786404s" podCreationTimestamp="2026-04-17 21:41:56 +0000 UTC" firstStartedPulling="2026-04-17 21:41:56.880779316 +0000 UTC m=+281.221942543" lastFinishedPulling="2026-04-17 21:41:59.54468534 +0000 UTC m=+283.885848573" observedRunningTime="2026-04-17 21:42:00.404520538 +0000 UTC m=+284.745683777" watchObservedRunningTime="2026-04-17 21:42:00.405786404 +0000 UTC m=+284.746949643" Apr 17 21:42:01.357494 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:01.357455 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm" Apr 17 21:42:04.568334 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.568297 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls"] Apr 17 21:42:04.571797 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.571771 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.575811 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.575784 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Apr 17 21:42:04.575948 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.575814 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Apr 17 21:42:04.575948 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.575785 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Apr 17 21:42:04.575948 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.575836 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Apr 17 21:42:04.575948 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.575892 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-clct9\"" Apr 17 21:42:04.580635 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.580599 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls"] Apr 17 21:42:04.672859 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.672824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58zvg\" (UniqueName: \"kubernetes.io/projected/151b3328-3556-44ba-83b3-d035c4800d16-kube-api-access-58zvg\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.673045 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.672872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/151b3328-3556-44ba-83b3-d035c4800d16-tls-certs\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.673118 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.673046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151b3328-3556-44ba-83b3-d035c4800d16-tmp\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.774191 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.774147 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151b3328-3556-44ba-83b3-d035c4800d16-tmp\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.774378 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.774204 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58zvg\" (UniqueName: \"kubernetes.io/projected/151b3328-3556-44ba-83b3-d035c4800d16-kube-api-access-58zvg\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.774378 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.774238 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/151b3328-3556-44ba-83b3-d035c4800d16-tls-certs\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.776487 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.776463 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/151b3328-3556-44ba-83b3-d035c4800d16-tmp\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.776723 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.776703 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/151b3328-3556-44ba-83b3-d035c4800d16-tls-certs\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.781523 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.781493 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58zvg\" (UniqueName: \"kubernetes.io/projected/151b3328-3556-44ba-83b3-d035c4800d16-kube-api-access-58zvg\") pod \"kube-auth-proxy-79c9d94f8f-42xls\" (UID: \"151b3328-3556-44ba-83b3-d035c4800d16\") " pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:04.882715 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:04.882624 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" Apr 17 21:42:05.002197 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:05.002169 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls"] Apr 17 21:42:05.004716 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:42:05.004684 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151b3328_3556_44ba_83b3_d035c4800d16.slice/crio-61e34aa2e26ea28599a1d2cad0796dfecc023c22c815b8260982136bcaec4f31 WatchSource:0}: Error finding container 61e34aa2e26ea28599a1d2cad0796dfecc023c22c815b8260982136bcaec4f31: Status 404 returned error can't find the container with id 61e34aa2e26ea28599a1d2cad0796dfecc023c22c815b8260982136bcaec4f31 Apr 17 21:42:05.403849 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:05.403806 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" event={"ID":"151b3328-3556-44ba-83b3-d035c4800d16","Type":"ContainerStarted","Data":"61e34aa2e26ea28599a1d2cad0796dfecc023c22c815b8260982136bcaec4f31"} Apr 17 21:42:08.415474 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:08.415439 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" event={"ID":"151b3328-3556-44ba-83b3-d035c4800d16","Type":"ContainerStarted","Data":"42a4b307ebbcfdf10beec2ec7fa0f8ed9929577c14109d70f861a6055115f668"} Apr 17 21:42:08.432299 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:08.432247 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79c9d94f8f-42xls" podStartSLOduration=1.440818126 podStartE2EDuration="4.432233531s" podCreationTimestamp="2026-04-17 21:42:04 +0000 UTC" firstStartedPulling="2026-04-17 21:42:05.006752267 +0000 UTC m=+289.347915483" lastFinishedPulling="2026-04-17 21:42:07.998167671 +0000 UTC m=+292.339330888" observedRunningTime="2026-04-17 21:42:08.430675788 +0000 UTC m=+292.771839038" watchObservedRunningTime="2026-04-17 21:42:08.432233531 +0000 UTC m=+292.773396768" Apr 17 21:42:11.391468 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:11.391436 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64dbd89fbc-c6np8" Apr 17 21:42:16.140519 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:42:16.137245 2575 kubelet.go:1628] "Image garbage collection succeeded" Apr 17 21:43:34.965499 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:34.965413 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-644f5d7bbd-szdtp"] Apr 17 21:43:34.968631 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:34.968613 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:34.978054 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:34.978029 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644f5d7bbd-szdtp"] Apr 17 21:43:35.049066 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.049022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r5wp\" (UniqueName: \"kubernetes.io/projected/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-kube-api-access-4r5wp\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.049066 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.049068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-config\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.049297 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.049099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-oauth-config\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.049297 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.049140 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-oauth-serving-cert\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.049297 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.049160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-trusted-ca-bundle\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.049297 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.049216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-service-ca\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.049297 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.049246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-serving-cert\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.150148 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.150108 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4r5wp\" (UniqueName: \"kubernetes.io/projected/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-kube-api-access-4r5wp\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.150148 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.150154 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-config\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.150396 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.150278 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-oauth-config\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.150396 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.150327 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-oauth-serving-cert\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.150396 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.150355 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-trusted-ca-bundle\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.150396 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.150396 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-service-ca\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.150616 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.150416 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-serving-cert\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.150961 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.150938 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-config\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.151114 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.151089 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-oauth-serving-cert\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.151174 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.151089 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-service-ca\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.151230 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.151185 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-trusted-ca-bundle\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.152860 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.152838 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-oauth-config\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.152948 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.152895 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-console-serving-cert\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.157736 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.157715 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r5wp\" (UniqueName: \"kubernetes.io/projected/89e7aec8-0567-4c42-a1bf-b02e41c7aa55-kube-api-access-4r5wp\") pod \"console-644f5d7bbd-szdtp\" (UID: \"89e7aec8-0567-4c42-a1bf-b02e41c7aa55\") " pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.279956 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.279909 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:35.402457 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.402432 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644f5d7bbd-szdtp"] Apr 17 21:43:35.405060 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:43:35.405031 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e7aec8_0567_4c42_a1bf_b02e41c7aa55.slice/crio-8561df914d23861b1380855f9052e64e63910e3d1b126e9187400d29a3fb987d WatchSource:0}: Error finding container 8561df914d23861b1380855f9052e64e63910e3d1b126e9187400d29a3fb987d: Status 404 returned error can't find the container with id 8561df914d23861b1380855f9052e64e63910e3d1b126e9187400d29a3fb987d Apr 17 21:43:35.406899 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.406878 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 21:43:35.704053 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.703951 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644f5d7bbd-szdtp" event={"ID":"89e7aec8-0567-4c42-a1bf-b02e41c7aa55","Type":"ContainerStarted","Data":"c8cdf300368e9dd38c55bd46c5989e2a14775a26462b1017fc6c313bfe955b58"} Apr 17 21:43:35.704053 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.704003 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644f5d7bbd-szdtp" event={"ID":"89e7aec8-0567-4c42-a1bf-b02e41c7aa55","Type":"ContainerStarted","Data":"8561df914d23861b1380855f9052e64e63910e3d1b126e9187400d29a3fb987d"} Apr 17 21:43:35.722262 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:35.722208 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-644f5d7bbd-szdtp" podStartSLOduration=1.7221876539999998 podStartE2EDuration="1.722187654s" podCreationTimestamp="2026-04-17 21:43:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 21:43:35.720977268 +0000 UTC m=+380.062140544" watchObservedRunningTime="2026-04-17 21:43:35.722187654 +0000 UTC m=+380.063350894" Apr 17 21:43:45.280659 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:45.280616 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:45.280659 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:45.280663 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:45.285386 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:45.285362 2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:45.740735 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:45.740655 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-644f5d7bbd-szdtp" Apr 17 21:43:45.792356 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:45.792325 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5994969bd9-qc8g5"] Apr 17 21:43:49.980603 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:49.980570 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw"] Apr 17 21:43:49.984044 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:49.984026 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:49.986651 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:49.986625 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Apr 17 21:43:49.986755 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:49.986647 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Apr 17 21:43:49.986914 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:49.986898 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Apr 17 21:43:49.986952 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:49.986917 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Apr 17 21:43:49.987954 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:49.987939 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qh6pg\"" Apr 17 21:43:49.993291 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:49.993271 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw"] Apr 17 21:43:50.083619 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.083586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7xkj\" (UniqueName: \"kubernetes.io/projected/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-kube-api-access-g7xkj\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.083777 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.083627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.083777 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.083692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.184841 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.184801 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g7xkj\" (UniqueName: \"kubernetes.io/projected/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-kube-api-access-g7xkj\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.184841 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.184842 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.185044 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.184865 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.185491 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.185466 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.187253 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.187235 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.192269 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.192247 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7xkj\" (UniqueName: \"kubernetes.io/projected/2aaf13d1-7042-4fff-8d6b-44ef13f243d2-kube-api-access-g7xkj\") pod \"kuadrant-console-plugin-6cb54b5c86-fv4fw\" (UID: \"2aaf13d1-7042-4fff-8d6b-44ef13f243d2\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.294286 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.294249 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" Apr 17 21:43:50.418442 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.418393 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw"] Apr 17 21:43:50.423239 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:43:50.423206 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2aaf13d1_7042_4fff_8d6b_44ef13f243d2.slice/crio-a77a26713bfc7618283d86c5e91db615e58eeef0b7ea70799381a3859eb316e9 WatchSource:0}: Error finding container a77a26713bfc7618283d86c5e91db615e58eeef0b7ea70799381a3859eb316e9: Status 404 returned error can't find the container with id a77a26713bfc7618283d86c5e91db615e58eeef0b7ea70799381a3859eb316e9 Apr 17 21:43:50.753058 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:43:50.752976 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" event={"ID":"2aaf13d1-7042-4fff-8d6b-44ef13f243d2","Type":"ContainerStarted","Data":"a77a26713bfc7618283d86c5e91db615e58eeef0b7ea70799381a3859eb316e9"} Apr 17 21:44:00.757472 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.757432 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66"] Apr 17 21:44:00.777590 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.777535 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66"] Apr 17 21:44:00.777751 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.777693 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66" Apr 17 21:44:00.780558 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.780342 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v5tkv\"" Apr 17 21:44:00.839583 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.839522 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66"] Apr 17 21:44:00.839872 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:44:00.839848 2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-nsnw8], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-nsnw8]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66" podUID="7ce12790-ae13-41cc-b796-735f5a701e0b" Apr 17 21:44:00.846125 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.846098 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66"] Apr 17 21:44:00.858347 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.858318 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq"] Apr 17 21:44:00.862435 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.862411 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:00.871857 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.871730 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq"] Apr 17 21:44:00.880622 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.880590 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm8nd\" (UniqueName: \"kubernetes.io/projected/2b36d239-45f8-4786-a22b-aa7b1d3efada-kube-api-access-gm8nd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jdtsq\" (UID: \"2b36d239-45f8-4786-a22b-aa7b1d3efada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:00.880758 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.880715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b36d239-45f8-4786-a22b-aa7b1d3efada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jdtsq\" (UID: \"2b36d239-45f8-4786-a22b-aa7b1d3efada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:00.981838 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.981797 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b36d239-45f8-4786-a22b-aa7b1d3efada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jdtsq\" (UID: \"2b36d239-45f8-4786-a22b-aa7b1d3efada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:00.982019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.981901 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gm8nd\" (UniqueName: \"kubernetes.io/projected/2b36d239-45f8-4786-a22b-aa7b1d3efada-kube-api-access-gm8nd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jdtsq\" (UID: \"2b36d239-45f8-4786-a22b-aa7b1d3efada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:00.982246 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.982218 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b36d239-45f8-4786-a22b-aa7b1d3efada-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jdtsq\" (UID: \"2b36d239-45f8-4786-a22b-aa7b1d3efada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:00.990785 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:00.990752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm8nd\" (UniqueName: \"kubernetes.io/projected/2b36d239-45f8-4786-a22b-aa7b1d3efada-kube-api-access-gm8nd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jdtsq\" (UID: \"2b36d239-45f8-4786-a22b-aa7b1d3efada\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:01.176840 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:01.176751 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:01.801248 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:01.801197 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66" Apr 17 21:44:01.803948 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:01.803913 2575 status_manager.go:895] "Failed to get status for pod" podUID="7ce12790-ae13-41cc-b796-735f5a701e0b" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-z7n66\" is forbidden: User \"system:node:ip-10-0-132-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-175.ec2.internal' and this object" Apr 17 21:44:01.807315 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:01.807289 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66" Apr 17 21:44:01.809894 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:01.809836 2575 status_manager.go:895] "Failed to get status for pod" podUID="7ce12790-ae13-41cc-b796-735f5a701e0b" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-z7n66\" is forbidden: User \"system:node:ip-10-0-132-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-175.ec2.internal' and this object" Apr 17 21:44:02.264106 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:02.264066 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ce12790-ae13-41cc-b796-735f5a701e0b" path="/var/lib/kubelet/pods/7ce12790-ae13-41cc-b796-735f5a701e0b/volumes" Apr 17 21:44:02.805442 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:02.805411 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66" Apr 17 21:44:02.810215 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:02.810180 2575 status_manager.go:895] "Failed to get status for pod" podUID="7ce12790-ae13-41cc-b796-735f5a701e0b" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-z7n66" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-z7n66\" is forbidden: User \"system:node:ip-10-0-132-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-175.ec2.internal' and this object" Apr 17 21:44:10.812008 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:10.811929 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5994969bd9-qc8g5" podUID="3922af99-8921-431f-83b3-2aeebc5265b4" containerName="console" containerID="cri-o://3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27" gracePeriod=15 Apr 17 21:44:14.384525 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.384500 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq"] Apr 17 21:44:14.387742 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:44:14.387709 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b36d239_45f8_4786_a22b_aa7b1d3efada.slice/crio-8b385095468be37037831cfe1daf6e1014346b7927f9f866ab804bdf869ddb9a WatchSource:0}: Error finding container 8b385095468be37037831cfe1daf6e1014346b7927f9f866ab804bdf869ddb9a: Status 404 returned error can't find the container with id 8b385095468be37037831cfe1daf6e1014346b7927f9f866ab804bdf869ddb9a Apr 17 21:44:14.404637 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.404616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5994969bd9-qc8g5_3922af99-8921-431f-83b3-2aeebc5265b4/console/0.log" Apr 17 21:44:14.404740 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.404676 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:44:14.512014 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.511987 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-serving-cert\") pod \"3922af99-8921-431f-83b3-2aeebc5265b4\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " Apr 17 21:44:14.512150 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.512042 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-oauth-config\") pod \"3922af99-8921-431f-83b3-2aeebc5265b4\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " Apr 17 21:44:14.512150 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.512074 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb6s4\" (UniqueName: \"kubernetes.io/projected/3922af99-8921-431f-83b3-2aeebc5265b4-kube-api-access-mb6s4\") pod \"3922af99-8921-431f-83b3-2aeebc5265b4\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " Apr 17 21:44:14.512150 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.512118 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-oauth-serving-cert\") pod \"3922af99-8921-431f-83b3-2aeebc5265b4\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " Apr 17 21:44:14.512305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.512195 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-console-config\") pod \"3922af99-8921-431f-83b3-2aeebc5265b4\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " Apr 17 21:44:14.512305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.512253 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-service-ca\") pod \"3922af99-8921-431f-83b3-2aeebc5265b4\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " Apr 17 21:44:14.512305 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.512302 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-trusted-ca-bundle\") pod \"3922af99-8921-431f-83b3-2aeebc5265b4\" (UID: \"3922af99-8921-431f-83b3-2aeebc5265b4\") " Apr 17 21:44:14.513425 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.512930 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3922af99-8921-431f-83b3-2aeebc5265b4" (UID: "3922af99-8921-431f-83b3-2aeebc5265b4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:44:14.513425 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.513160 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3922af99-8921-431f-83b3-2aeebc5265b4" (UID: "3922af99-8921-431f-83b3-2aeebc5265b4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:44:14.513425 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.513218 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-console-config" (OuterVolumeSpecName: "console-config") pod "3922af99-8921-431f-83b3-2aeebc5265b4" (UID: "3922af99-8921-431f-83b3-2aeebc5265b4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:44:14.513425 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.512997 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-service-ca" (OuterVolumeSpecName: "service-ca") pod "3922af99-8921-431f-83b3-2aeebc5265b4" (UID: "3922af99-8921-431f-83b3-2aeebc5265b4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Apr 17 21:44:14.514739 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.514711 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3922af99-8921-431f-83b3-2aeebc5265b4" (UID: "3922af99-8921-431f-83b3-2aeebc5265b4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:44:14.515088 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.515064 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3922af99-8921-431f-83b3-2aeebc5265b4" (UID: "3922af99-8921-431f-83b3-2aeebc5265b4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Apr 17 21:44:14.515088 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.515069 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3922af99-8921-431f-83b3-2aeebc5265b4-kube-api-access-mb6s4" (OuterVolumeSpecName: "kube-api-access-mb6s4") pod "3922af99-8921-431f-83b3-2aeebc5265b4" (UID: "3922af99-8921-431f-83b3-2aeebc5265b4"). InnerVolumeSpecName "kube-api-access-mb6s4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 21:44:14.613876 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.613846 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-console-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:44:14.613876 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.613871 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-service-ca\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:44:14.613876 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.613880 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-trusted-ca-bundle\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:44:14.614091 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.613889 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:44:14.614091 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.613897 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3922af99-8921-431f-83b3-2aeebc5265b4-console-oauth-config\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:44:14.614091 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.613907 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb6s4\" (UniqueName: \"kubernetes.io/projected/3922af99-8921-431f-83b3-2aeebc5265b4-kube-api-access-mb6s4\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:44:14.614091 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.613917 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3922af99-8921-431f-83b3-2aeebc5265b4-oauth-serving-cert\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:44:14.852118 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.852083 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" event={"ID":"2aaf13d1-7042-4fff-8d6b-44ef13f243d2","Type":"ContainerStarted","Data":"2a6e1b07527049b19b7f9d0c82cdaa5a343c25278c3ad645c56a267431cfffe0"} Apr 17 21:44:14.853273 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.853242 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" event={"ID":"2b36d239-45f8-4786-a22b-aa7b1d3efada","Type":"ContainerStarted","Data":"8b385095468be37037831cfe1daf6e1014346b7927f9f866ab804bdf869ddb9a"} Apr 17 21:44:14.854259 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.854245 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5994969bd9-qc8g5_3922af99-8921-431f-83b3-2aeebc5265b4/console/0.log" Apr 17 21:44:14.854353 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.854275 2575 generic.go:358] "Generic (PLEG): container finished" podID="3922af99-8921-431f-83b3-2aeebc5265b4" containerID="3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27" exitCode=2 Apr 17 21:44:14.854353 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.854300 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994969bd9-qc8g5" event={"ID":"3922af99-8921-431f-83b3-2aeebc5265b4","Type":"ContainerDied","Data":"3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27"} Apr 17 21:44:14.854353 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.854330 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5994969bd9-qc8g5" Apr 17 21:44:14.854353 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.854342 2575 scope.go:117] "RemoveContainer" containerID="3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27" Apr 17 21:44:14.854501 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.854331 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5994969bd9-qc8g5" event={"ID":"3922af99-8921-431f-83b3-2aeebc5265b4","Type":"ContainerDied","Data":"b262510cef487979d5c69d11c5b493fa2e4f1cc6becf7d4d82e912e89cf4476f"} Apr 17 21:44:14.863400 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.863383 2575 scope.go:117] "RemoveContainer" containerID="3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27" Apr 17 21:44:14.863708 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:44:14.863683 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27\": container with ID starting with 3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27 not found: ID does not exist" containerID="3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27" Apr 17 21:44:14.863801 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.863716 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27"} err="failed to get container status \"3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27\": rpc error: code = NotFound desc = could not find container \"3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27\": container with ID starting with 3c7529626a3a475baf9f23e05291b8bc415eddfe42dbccd0d26d3f42cf368d27 not found: ID does not exist" Apr 17 21:44:14.869995 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.869957 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fv4fw" podStartSLOduration=1.848420299 podStartE2EDuration="25.869947081s" podCreationTimestamp="2026-04-17 21:43:49 +0000 UTC" firstStartedPulling="2026-04-17 21:43:50.424437539 +0000 UTC m=+394.765600755" lastFinishedPulling="2026-04-17 21:44:14.4459643 +0000 UTC m=+418.787127537" observedRunningTime="2026-04-17 21:44:14.867937162 +0000 UTC m=+419.209100426" watchObservedRunningTime="2026-04-17 21:44:14.869947081 +0000 UTC m=+419.211110319" Apr 17 21:44:14.884028 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.883997 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5994969bd9-qc8g5"] Apr 17 21:44:14.888865 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:14.888840 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5994969bd9-qc8g5"] Apr 17 21:44:16.262701 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:16.262664 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3922af99-8921-431f-83b3-2aeebc5265b4" path="/var/lib/kubelet/pods/3922af99-8921-431f-83b3-2aeebc5265b4/volumes" Apr 17 21:44:20.877709 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:20.877673 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" event={"ID":"2b36d239-45f8-4786-a22b-aa7b1d3efada","Type":"ContainerStarted","Data":"c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48"} Apr 17 21:44:20.878167 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:20.877835 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:20.897135 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:20.897029 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" podStartSLOduration=15.369893298 podStartE2EDuration="20.897012243s" podCreationTimestamp="2026-04-17 21:44:00 +0000 UTC" firstStartedPulling="2026-04-17 21:44:14.411897824 +0000 UTC m=+418.753061040" lastFinishedPulling="2026-04-17 21:44:19.939016769 +0000 UTC m=+424.280179985" observedRunningTime="2026-04-17 21:44:20.89648153 +0000 UTC m=+425.237644770" watchObservedRunningTime="2026-04-17 21:44:20.897012243 +0000 UTC m=+425.238175482" Apr 17 21:44:31.883684 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:31.883643 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 21:44:53.057737 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.057696 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xkqbm"] Apr 17 21:44:53.058301 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.058280 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3922af99-8921-431f-83b3-2aeebc5265b4" containerName="console" Apr 17 21:44:53.058382 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.058304 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3922af99-8921-431f-83b3-2aeebc5265b4" containerName="console" Apr 17 21:44:53.058433 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.058401 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="3922af99-8921-431f-83b3-2aeebc5265b4" containerName="console" Apr 17 21:44:53.110453 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.110415 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xkqbm"] Apr 17 21:44:53.110649 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.110568 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" Apr 17 21:44:53.113148 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.113124 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c5c6h\"" Apr 17 21:44:53.166209 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.166171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm6rl\" (UniqueName: \"kubernetes.io/projected/0b0199af-970c-4b11-893c-4364f30dec36-kube-api-access-fm6rl\") pod \"authorino-f99f4b5cd-xkqbm\" (UID: \"0b0199af-970c-4b11-893c-4364f30dec36\") " pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" Apr 17 21:44:53.267280 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.267241 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fm6rl\" (UniqueName: \"kubernetes.io/projected/0b0199af-970c-4b11-893c-4364f30dec36-kube-api-access-fm6rl\") pod \"authorino-f99f4b5cd-xkqbm\" (UID: \"0b0199af-970c-4b11-893c-4364f30dec36\") " pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" Apr 17 21:44:53.274499 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.274468 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm6rl\" (UniqueName: \"kubernetes.io/projected/0b0199af-970c-4b11-893c-4364f30dec36-kube-api-access-fm6rl\") pod \"authorino-f99f4b5cd-xkqbm\" (UID: \"0b0199af-970c-4b11-893c-4364f30dec36\") " pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" Apr 17 21:44:53.419482 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.419397 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" Apr 17 21:44:53.538721 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.538688 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xkqbm"] Apr 17 21:44:53.541776 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:44:53.541747 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b0199af_970c_4b11_893c_4364f30dec36.slice/crio-5275ed7e15d2ad802902b69094ea80ad2e9790ef01152ac158e3876a3f895ac0 WatchSource:0}: Error finding container 5275ed7e15d2ad802902b69094ea80ad2e9790ef01152ac158e3876a3f895ac0: Status 404 returned error can't find the container with id 5275ed7e15d2ad802902b69094ea80ad2e9790ef01152ac158e3876a3f895ac0 Apr 17 21:44:53.985106 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:53.985020 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" event={"ID":"0b0199af-970c-4b11-893c-4364f30dec36","Type":"ContainerStarted","Data":"5275ed7e15d2ad802902b69094ea80ad2e9790ef01152ac158e3876a3f895ac0"} Apr 17 21:44:56.999073 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:56.999034 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" event={"ID":"0b0199af-970c-4b11-893c-4364f30dec36","Type":"ContainerStarted","Data":"1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698"} Apr 17 21:44:57.012871 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:57.012824 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" podStartSLOduration=1.3720554919999999 podStartE2EDuration="4.012810361s" podCreationTimestamp="2026-04-17 21:44:53 +0000 UTC" firstStartedPulling="2026-04-17 21:44:53.542982613 +0000 UTC m=+457.884145829" lastFinishedPulling="2026-04-17 21:44:56.183737482 +0000 UTC m=+460.524900698" observedRunningTime="2026-04-17 21:44:57.011418188 +0000 UTC m=+461.352581427" watchObservedRunningTime="2026-04-17 21:44:57.012810361 +0000 UTC m=+461.353973628" Apr 17 21:44:57.486185 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:57.486152 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xkqbm"] Apr 17 21:44:59.005225 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:59.005184 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" podUID="0b0199af-970c-4b11-893c-4364f30dec36" containerName="authorino" containerID="cri-o://1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698" gracePeriod=30 Apr 17 21:44:59.254663 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:59.254637 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" Apr 17 21:44:59.330523 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:59.330434 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm6rl\" (UniqueName: \"kubernetes.io/projected/0b0199af-970c-4b11-893c-4364f30dec36-kube-api-access-fm6rl\") pod \"0b0199af-970c-4b11-893c-4364f30dec36\" (UID: \"0b0199af-970c-4b11-893c-4364f30dec36\") " Apr 17 21:44:59.332756 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:59.332724 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b0199af-970c-4b11-893c-4364f30dec36-kube-api-access-fm6rl" (OuterVolumeSpecName: "kube-api-access-fm6rl") pod "0b0199af-970c-4b11-893c-4364f30dec36" (UID: "0b0199af-970c-4b11-893c-4364f30dec36"). InnerVolumeSpecName "kube-api-access-fm6rl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 21:44:59.431616 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:44:59.431583 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm6rl\" (UniqueName: \"kubernetes.io/projected/0b0199af-970c-4b11-893c-4364f30dec36-kube-api-access-fm6rl\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:45:00.010286 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.010246 2575 generic.go:358] "Generic (PLEG): container finished" podID="0b0199af-970c-4b11-893c-4364f30dec36" containerID="1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698" exitCode=0 Apr 17 21:45:00.010738 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.010298 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" Apr 17 21:45:00.010738 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.010320 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" event={"ID":"0b0199af-970c-4b11-893c-4364f30dec36","Type":"ContainerDied","Data":"1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698"} Apr 17 21:45:00.010738 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.010352 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xkqbm" event={"ID":"0b0199af-970c-4b11-893c-4364f30dec36","Type":"ContainerDied","Data":"5275ed7e15d2ad802902b69094ea80ad2e9790ef01152ac158e3876a3f895ac0"} Apr 17 21:45:00.010738 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.010371 2575 scope.go:117] "RemoveContainer" containerID="1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698" Apr 17 21:45:00.018357 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.018334 2575 scope.go:117] "RemoveContainer" containerID="1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698" Apr 17 21:45:00.018665 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:45:00.018646 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698\": container with ID starting with 1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698 not found: ID does not exist" containerID="1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698" Apr 17 21:45:00.018725 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.018674 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698"} err="failed to get container status \"1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698\": rpc error: code = NotFound desc = could not find container \"1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698\": container with ID starting with 1a7a45f6285cee0528225199d74f15714f1e77fb07ddd4c330231f4148a64698 not found: ID does not exist" Apr 17 21:45:00.029038 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.029004 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xkqbm"] Apr 17 21:45:00.031149 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.031124 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xkqbm"] Apr 17 21:45:00.262651 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:00.262575 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b0199af-970c-4b11-893c-4364f30dec36" path="/var/lib/kubelet/pods/0b0199af-970c-4b11-893c-4364f30dec36/volumes" Apr 17 21:45:26.075708 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.075673 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks46q"] Apr 17 21:45:26.076169 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.076012 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b0199af-970c-4b11-893c-4364f30dec36" containerName="authorino" Apr 17 21:45:26.076169 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.076023 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b0199af-970c-4b11-893c-4364f30dec36" containerName="authorino" Apr 17 21:45:26.076169 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.076092 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="0b0199af-970c-4b11-893c-4364f30dec36" containerName="authorino" Apr 17 21:45:26.078690 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.078674 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ks46q" Apr 17 21:45:26.081067 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.081046 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c5c6h\"" Apr 17 21:45:26.087012 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.086226 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks46q"] Apr 17 21:45:26.165298 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.165259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgjr5\" (UniqueName: \"kubernetes.io/projected/2a29fd6c-5197-4401-b1b6-65f4d9676b5d-kube-api-access-wgjr5\") pod \"authorino-8b475cf9f-ks46q\" (UID: \"2a29fd6c-5197-4401-b1b6-65f4d9676b5d\") " pod="kuadrant-system/authorino-8b475cf9f-ks46q" Apr 17 21:45:26.266535 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.266494 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgjr5\" (UniqueName: \"kubernetes.io/projected/2a29fd6c-5197-4401-b1b6-65f4d9676b5d-kube-api-access-wgjr5\") pod \"authorino-8b475cf9f-ks46q\" (UID: \"2a29fd6c-5197-4401-b1b6-65f4d9676b5d\") " pod="kuadrant-system/authorino-8b475cf9f-ks46q" Apr 17 21:45:26.273864 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.273838 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgjr5\" (UniqueName: \"kubernetes.io/projected/2a29fd6c-5197-4401-b1b6-65f4d9676b5d-kube-api-access-wgjr5\") pod \"authorino-8b475cf9f-ks46q\" (UID: \"2a29fd6c-5197-4401-b1b6-65f4d9676b5d\") " pod="kuadrant-system/authorino-8b475cf9f-ks46q" Apr 17 21:45:26.304931 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.304900 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks46q"] Apr 17 21:45:26.305193 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.305176 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ks46q" Apr 17 21:45:26.424206 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:26.424182 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks46q"] Apr 17 21:45:26.426657 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:45:26.426626 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a29fd6c_5197_4401_b1b6_65f4d9676b5d.slice/crio-1e115cc381cd6cdf369b25f27d61ae34329393c8e1b49a6be096bdf133b7b145 WatchSource:0}: Error finding container 1e115cc381cd6cdf369b25f27d61ae34329393c8e1b49a6be096bdf133b7b145: Status 404 returned error can't find the container with id 1e115cc381cd6cdf369b25f27d61ae34329393c8e1b49a6be096bdf133b7b145 Apr 17 21:45:27.102397 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:27.102300 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ks46q" event={"ID":"2a29fd6c-5197-4401-b1b6-65f4d9676b5d","Type":"ContainerStarted","Data":"c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d"} Apr 17 21:45:27.102397 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:27.102337 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ks46q" event={"ID":"2a29fd6c-5197-4401-b1b6-65f4d9676b5d","Type":"ContainerStarted","Data":"1e115cc381cd6cdf369b25f27d61ae34329393c8e1b49a6be096bdf133b7b145"} Apr 17 21:45:27.102397 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:27.102380 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-ks46q" podUID="2a29fd6c-5197-4401-b1b6-65f4d9676b5d" containerName="authorino" containerID="cri-o://c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d" gracePeriod=30 Apr 17 21:45:27.119124 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:27.119075 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-ks46q" podStartSLOduration=0.760269057 podStartE2EDuration="1.119059488s" podCreationTimestamp="2026-04-17 21:45:26 +0000 UTC" firstStartedPulling="2026-04-17 21:45:26.427955421 +0000 UTC m=+490.769118638" lastFinishedPulling="2026-04-17 21:45:26.786745853 +0000 UTC m=+491.127909069" observedRunningTime="2026-04-17 21:45:27.117321413 +0000 UTC m=+491.458484644" watchObservedRunningTime="2026-04-17 21:45:27.119059488 +0000 UTC m=+491.460222726" Apr 17 21:45:27.345500 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:27.345478 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ks46q" Apr 17 21:45:27.375113 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:27.375047 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgjr5\" (UniqueName: \"kubernetes.io/projected/2a29fd6c-5197-4401-b1b6-65f4d9676b5d-kube-api-access-wgjr5\") pod \"2a29fd6c-5197-4401-b1b6-65f4d9676b5d\" (UID: \"2a29fd6c-5197-4401-b1b6-65f4d9676b5d\") " Apr 17 21:45:27.377116 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:27.377087 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a29fd6c-5197-4401-b1b6-65f4d9676b5d-kube-api-access-wgjr5" (OuterVolumeSpecName: "kube-api-access-wgjr5") pod "2a29fd6c-5197-4401-b1b6-65f4d9676b5d" (UID: "2a29fd6c-5197-4401-b1b6-65f4d9676b5d"). InnerVolumeSpecName "kube-api-access-wgjr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 21:45:27.476118 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:27.476072 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgjr5\" (UniqueName: \"kubernetes.io/projected/2a29fd6c-5197-4401-b1b6-65f4d9676b5d-kube-api-access-wgjr5\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:45:28.106601 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.106564 2575 generic.go:358] "Generic (PLEG): container finished" podID="2a29fd6c-5197-4401-b1b6-65f4d9676b5d" containerID="c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d" exitCode=0 Apr 17 21:45:28.107019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.106625 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ks46q" Apr 17 21:45:28.107019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.106646 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ks46q" event={"ID":"2a29fd6c-5197-4401-b1b6-65f4d9676b5d","Type":"ContainerDied","Data":"c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d"} Apr 17 21:45:28.107019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.106686 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ks46q" event={"ID":"2a29fd6c-5197-4401-b1b6-65f4d9676b5d","Type":"ContainerDied","Data":"1e115cc381cd6cdf369b25f27d61ae34329393c8e1b49a6be096bdf133b7b145"} Apr 17 21:45:28.107019 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.106706 2575 scope.go:117] "RemoveContainer" containerID="c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d" Apr 17 21:45:28.115065 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.115046 2575 scope.go:117] "RemoveContainer" containerID="c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d" Apr 17 21:45:28.115331 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:45:28.115302 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d\": container with ID starting with c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d not found: ID does not exist" containerID="c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d" Apr 17 21:45:28.115370 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.115341 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d"} err="failed to get container status \"c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d\": rpc error: code = NotFound desc = could not find container \"c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d\": container with ID starting with c29ad1ebf2897d0709b051de2686afd30d8daae833d809c98ac3a0e52606bd7d not found: ID does not exist" Apr 17 21:45:28.127067 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.127037 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks46q"] Apr 17 21:45:28.128452 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.128432 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks46q"] Apr 17 21:45:28.262843 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:28.262810 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a29fd6c-5197-4401-b1b6-65f4d9676b5d" path="/var/lib/kubelet/pods/2a29fd6c-5197-4401-b1b6-65f4d9676b5d/volumes" Apr 17 21:45:29.430353 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.430318 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d4c8f55f9-tmwps"] Apr 17 21:45:29.430750 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.430677 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a29fd6c-5197-4401-b1b6-65f4d9676b5d" containerName="authorino" Apr 17 21:45:29.430750 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.430689 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a29fd6c-5197-4401-b1b6-65f4d9676b5d" containerName="authorino" Apr 17 21:45:29.430846 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.430753 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="2a29fd6c-5197-4401-b1b6-65f4d9676b5d" containerName="authorino" Apr 17 21:45:29.435222 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.435202 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" Apr 17 21:45:29.437826 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.437804 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w5d4j\"" Apr 17 21:45:29.445439 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.445412 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d4c8f55f9-tmwps"] Apr 17 21:45:29.491116 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.491087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7c52\" (UniqueName: \"kubernetes.io/projected/a51397ca-5825-4a94-8f68-245f829d3223-kube-api-access-f7c52\") pod \"maas-controller-6d4c8f55f9-tmwps\" (UID: \"a51397ca-5825-4a94-8f68-245f829d3223\") " pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" Apr 17 21:45:29.592362 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.592318 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7c52\" (UniqueName: \"kubernetes.io/projected/a51397ca-5825-4a94-8f68-245f829d3223-kube-api-access-f7c52\") pod \"maas-controller-6d4c8f55f9-tmwps\" (UID: \"a51397ca-5825-4a94-8f68-245f829d3223\") " pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" Apr 17 21:45:29.604344 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.604312 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7c52\" (UniqueName: \"kubernetes.io/projected/a51397ca-5825-4a94-8f68-245f829d3223-kube-api-access-f7c52\") pod \"maas-controller-6d4c8f55f9-tmwps\" (UID: \"a51397ca-5825-4a94-8f68-245f829d3223\") " pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" Apr 17 21:45:29.747846 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.747757 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" Apr 17 21:45:29.754356 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.754326 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d4c8f55f9-tmwps"] Apr 17 21:45:29.889690 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:29.889654 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d4c8f55f9-tmwps"] Apr 17 21:45:29.893168 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:45:29.893116 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda51397ca_5825_4a94_8f68_245f829d3223.slice/crio-e37fb82955af6241ce32daa8bcd30ecfe2b306adb965d865e93b429635c44bbf WatchSource:0}: Error finding container e37fb82955af6241ce32daa8bcd30ecfe2b306adb965d865e93b429635c44bbf: Status 404 returned error can't find the container with id e37fb82955af6241ce32daa8bcd30ecfe2b306adb965d865e93b429635c44bbf Apr 17 21:45:30.116125 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:30.116088 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" event={"ID":"a51397ca-5825-4a94-8f68-245f829d3223","Type":"ContainerStarted","Data":"e37fb82955af6241ce32daa8bcd30ecfe2b306adb965d865e93b429635c44bbf"} Apr 17 21:45:33.129221 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:33.129185 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" event={"ID":"a51397ca-5825-4a94-8f68-245f829d3223","Type":"ContainerStarted","Data":"b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3"} Apr 17 21:45:33.129728 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:33.129328 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" podUID="a51397ca-5825-4a94-8f68-245f829d3223" containerName="manager" containerID="cri-o://b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3" gracePeriod=10 Apr 17 21:45:33.129728 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:33.129400 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" Apr 17 21:45:33.145472 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:33.145418 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" podStartSLOduration=1.945589428 podStartE2EDuration="4.145406467s" podCreationTimestamp="2026-04-17 21:45:29 +0000 UTC" firstStartedPulling="2026-04-17 21:45:29.894911108 +0000 UTC m=+494.236074325" lastFinishedPulling="2026-04-17 21:45:32.094728137 +0000 UTC m=+496.435891364" observedRunningTime="2026-04-17 21:45:33.143934954 +0000 UTC m=+497.485098192" watchObservedRunningTime="2026-04-17 21:45:33.145406467 +0000 UTC m=+497.486569704" Apr 17 21:45:33.365997 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:33.365972 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" Apr 17 21:45:33.427848 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:33.427778 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7c52\" (UniqueName: \"kubernetes.io/projected/a51397ca-5825-4a94-8f68-245f829d3223-kube-api-access-f7c52\") pod \"a51397ca-5825-4a94-8f68-245f829d3223\" (UID: \"a51397ca-5825-4a94-8f68-245f829d3223\") " Apr 17 21:45:33.429915 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:33.429887 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a51397ca-5825-4a94-8f68-245f829d3223-kube-api-access-f7c52" (OuterVolumeSpecName: "kube-api-access-f7c52") pod "a51397ca-5825-4a94-8f68-245f829d3223" (UID: "a51397ca-5825-4a94-8f68-245f829d3223"). InnerVolumeSpecName "kube-api-access-f7c52". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 21:45:33.529010 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:33.528978 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7c52\" (UniqueName: \"kubernetes.io/projected/a51397ca-5825-4a94-8f68-245f829d3223-kube-api-access-f7c52\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 21:45:34.133490 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.133454 2575 generic.go:358] "Generic (PLEG): container finished" podID="a51397ca-5825-4a94-8f68-245f829d3223" containerID="b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3" exitCode=0 Apr 17 21:45:34.133957 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.133511 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" Apr 17 21:45:34.133957 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.133567 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" event={"ID":"a51397ca-5825-4a94-8f68-245f829d3223","Type":"ContainerDied","Data":"b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3"} Apr 17 21:45:34.133957 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.133615 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d4c8f55f9-tmwps" event={"ID":"a51397ca-5825-4a94-8f68-245f829d3223","Type":"ContainerDied","Data":"e37fb82955af6241ce32daa8bcd30ecfe2b306adb965d865e93b429635c44bbf"} Apr 17 21:45:34.133957 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.133637 2575 scope.go:117] "RemoveContainer" containerID="b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3" Apr 17 21:45:34.141729 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.141713 2575 scope.go:117] "RemoveContainer" containerID="b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3" Apr 17 21:45:34.142039 ip-10-0-132-175 kubenswrapper[2575]: E0417 21:45:34.142020 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3\": container with ID starting with b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3 not found: ID does not exist" containerID="b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3" Apr 17 21:45:34.142090 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.142048 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3"} err="failed to get container status \"b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3\": rpc error: code = NotFound desc = could not find container \"b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3\": container with ID starting with b46b8f27fba36104287137c35d8e705ccd10fe6009a12dab72790ec4873dd0c3 not found: ID does not exist" Apr 17 21:45:34.153477 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.153452 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d4c8f55f9-tmwps"] Apr 17 21:45:34.156829 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.156803 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d4c8f55f9-tmwps"] Apr 17 21:45:34.262821 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:45:34.262781 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a51397ca-5825-4a94-8f68-245f829d3223" path="/var/lib/kubelet/pods/a51397ca-5825-4a94-8f68-245f829d3223/volumes" Apr 17 21:46:03.769992 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.769959 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v"] Apr 17 21:46:03.770479 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.770444 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a51397ca-5825-4a94-8f68-245f829d3223" containerName="manager" Apr 17 21:46:03.770479 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.770460 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a51397ca-5825-4a94-8f68-245f829d3223" containerName="manager" Apr 17 21:46:03.770573 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.770517 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="a51397ca-5825-4a94-8f68-245f829d3223" containerName="manager" Apr 17 21:46:03.772665 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.772650 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:03.775351 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.775323 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sc2cl\"" Apr 17 21:46:03.775351 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.775325 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Apr 17 21:46:03.776427 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.776412 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Apr 17 21:46:03.776569 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.776537 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Apr 17 21:46:03.781843 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.781818 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v"] Apr 17 21:46:03.899625 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.899596 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:03.899793 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.899703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:03.899793 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.899744 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:03.899793 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.899768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:03.899793 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.899786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgkk4\" (UniqueName: \"kubernetes.io/projected/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-kube-api-access-cgkk4\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:03.899950 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:03.899867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.000918 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.000881 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.001081 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.000928 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.001081 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.000948 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.001081 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.001067 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgkk4\" (UniqueName: \"kubernetes.io/projected/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-kube-api-access-cgkk4\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.001258 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.001141 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.001258 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.001182 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.001361 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.001323 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.001422 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.001400 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.001466 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.001443 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.003482 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.003450 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.003693 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.003677 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.009367 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.009343 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgkk4\" (UniqueName: \"kubernetes.io/projected/bbc5c57c-6a3a-4f1e-b61f-f50a392090de-kube-api-access-cgkk4\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v\" (UID: \"bbc5c57c-6a3a-4f1e-b61f-f50a392090de\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.083362 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.083276 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:04.209515 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.209490 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v"] Apr 17 21:46:04.211770 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:46:04.211727 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc5c57c_6a3a_4f1e_b61f_f50a392090de.slice/crio-942d05329460576ce8de5e866ab722f2353bd93f32cca9a7a924c61a0f5a45de WatchSource:0}: Error finding container 942d05329460576ce8de5e866ab722f2353bd93f32cca9a7a924c61a0f5a45de: Status 404 returned error can't find the container with id 942d05329460576ce8de5e866ab722f2353bd93f32cca9a7a924c61a0f5a45de Apr 17 21:46:04.241141 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:04.241107 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" event={"ID":"bbc5c57c-6a3a-4f1e-b61f-f50a392090de","Type":"ContainerStarted","Data":"942d05329460576ce8de5e866ab722f2353bd93f32cca9a7a924c61a0f5a45de"} Apr 17 21:46:10.263411 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:10.263325 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" event={"ID":"bbc5c57c-6a3a-4f1e-b61f-f50a392090de","Type":"ContainerStarted","Data":"d58e769fd9695da2faeaccf80b7562e56789689e755ffe4bf027a4b7c78e42d2"} Apr 17 21:46:16.285169 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:16.285137 2575 generic.go:358] "Generic (PLEG): container finished" podID="bbc5c57c-6a3a-4f1e-b61f-f50a392090de" containerID="d58e769fd9695da2faeaccf80b7562e56789689e755ffe4bf027a4b7c78e42d2" exitCode=0 Apr 17 21:46:16.285511 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:16.285215 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" event={"ID":"bbc5c57c-6a3a-4f1e-b61f-f50a392090de","Type":"ContainerDied","Data":"d58e769fd9695da2faeaccf80b7562e56789689e755ffe4bf027a4b7c78e42d2"} Apr 17 21:46:18.295877 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:18.295835 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" event={"ID":"bbc5c57c-6a3a-4f1e-b61f-f50a392090de","Type":"ContainerStarted","Data":"5f801bdcb13332cde53cc84f5082c8e5478d4b7b2d6a8db575fdf664f37d6342"} Apr 17 21:46:18.296263 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:18.296153 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:18.313397 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:18.313335 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" podStartSLOduration=2.096089849 podStartE2EDuration="15.313320627s" podCreationTimestamp="2026-04-17 21:46:03 +0000 UTC" firstStartedPulling="2026-04-17 21:46:04.213402004 +0000 UTC m=+528.554565232" lastFinishedPulling="2026-04-17 21:46:17.430632793 +0000 UTC m=+541.771796010" observedRunningTime="2026-04-17 21:46:18.311961186 +0000 UTC m=+542.653124423" watchObservedRunningTime="2026-04-17 21:46:18.313320627 +0000 UTC m=+542.654483865" Apr 17 21:46:26.357663 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.357622 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g"] Apr 17 21:46:26.362022 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.362002 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.364318 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.364291 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Apr 17 21:46:26.371945 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.371919 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g"] Apr 17 21:46:26.386805 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.386774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.386941 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.386842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.386941 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.386883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c549752-912c-4337-94b1-14490f60242f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.387023 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.386966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.387023 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.386999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.387096 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.387022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvxc6\" (UniqueName: \"kubernetes.io/projected/8c549752-912c-4337-94b1-14490f60242f-kube-api-access-fvxc6\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488115 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488084 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488115 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488124 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488315 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488146 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvxc6\" (UniqueName: \"kubernetes.io/projected/8c549752-912c-4337-94b1-14490f60242f-kube-api-access-fvxc6\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488315 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488180 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488315 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488218 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488315 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488253 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c549752-912c-4337-94b1-14490f60242f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488574 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488524 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488636 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488606 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.488723 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.488705 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.490539 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.490516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c549752-912c-4337-94b1-14490f60242f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.490677 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.490661 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c549752-912c-4337-94b1-14490f60242f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.495557 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.495520 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvxc6\" (UniqueName: \"kubernetes.io/projected/8c549752-912c-4337-94b1-14490f60242f-kube-api-access-fvxc6\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5gd4g\" (UID: \"8c549752-912c-4337-94b1-14490f60242f\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.673132 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.673039 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:26.796575 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:26.796524 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g"] Apr 17 21:46:26.799241 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:46:26.799208 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c549752_912c_4337_94b1_14490f60242f.slice/crio-6b45512a8e1490580f08ad1e92f4abcbe2a5251b1d0daa915e558a9861b34f79 WatchSource:0}: Error finding container 6b45512a8e1490580f08ad1e92f4abcbe2a5251b1d0daa915e558a9861b34f79: Status 404 returned error can't find the container with id 6b45512a8e1490580f08ad1e92f4abcbe2a5251b1d0daa915e558a9861b34f79 Apr 17 21:46:27.326073 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:27.326035 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" event={"ID":"8c549752-912c-4337-94b1-14490f60242f","Type":"ContainerStarted","Data":"a020679c003b9514362e6667177499593b2028b7df1afef53a749d0d5cb26f2e"} Apr 17 21:46:27.326073 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:27.326074 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" event={"ID":"8c549752-912c-4337-94b1-14490f60242f","Type":"ContainerStarted","Data":"6b45512a8e1490580f08ad1e92f4abcbe2a5251b1d0daa915e558a9861b34f79"} Apr 17 21:46:29.317959 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:29.317916 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v" Apr 17 21:46:32.344164 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:32.344127 2575 generic.go:358] "Generic (PLEG): container finished" podID="8c549752-912c-4337-94b1-14490f60242f" containerID="a020679c003b9514362e6667177499593b2028b7df1afef53a749d0d5cb26f2e" exitCode=0 Apr 17 21:46:32.344532 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:32.344199 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" event={"ID":"8c549752-912c-4337-94b1-14490f60242f","Type":"ContainerDied","Data":"a020679c003b9514362e6667177499593b2028b7df1afef53a749d0d5cb26f2e"} Apr 17 21:46:33.349017 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:33.348983 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" event={"ID":"8c549752-912c-4337-94b1-14490f60242f","Type":"ContainerStarted","Data":"049ef8958fa47ea419a3d8a9abeb4b5442ce7a3f7616cc9c7c5c985e2a1262dd"} Apr 17 21:46:33.349400 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:33.349192 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:33.366718 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:33.366671 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" podStartSLOduration=7.193981293 podStartE2EDuration="7.366656665s" podCreationTimestamp="2026-04-17 21:46:26 +0000 UTC" firstStartedPulling="2026-04-17 21:46:32.344855796 +0000 UTC m=+556.686019016" lastFinishedPulling="2026-04-17 21:46:32.517531169 +0000 UTC m=+556.858694388" observedRunningTime="2026-04-17 21:46:33.364604203 +0000 UTC m=+557.705767441" watchObservedRunningTime="2026-04-17 21:46:33.366656665 +0000 UTC m=+557.707819904" Apr 17 21:46:38.248445 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.248409 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w"] Apr 17 21:46:38.253249 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.253230 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.256247 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.256224 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Apr 17 21:46:38.276025 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.275999 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w"] Apr 17 21:46:38.303621 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.303585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx4cq\" (UniqueName: \"kubernetes.io/projected/9664ced8-f414-4699-b848-88e8219f651e-kube-api-access-qx4cq\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.303791 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.303729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.303791 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.303765 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.303909 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.303797 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.303909 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.303874 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9664ced8-f414-4699-b848-88e8219f651e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.304008 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.303914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.405355 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405313 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.405541 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405372 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.405541 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405413 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.405541 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405456 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9664ced8-f414-4699-b848-88e8219f651e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.405541 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405486 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.405541 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405528 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx4cq\" (UniqueName: \"kubernetes.io/projected/9664ced8-f414-4699-b848-88e8219f651e-kube-api-access-qx4cq\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.405830 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405796 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.405954 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405934 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.406042 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.405976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.407853 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.407833 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9664ced8-f414-4699-b848-88e8219f651e-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.408003 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.407985 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9664ced8-f414-4699-b848-88e8219f651e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.414320 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.414296 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx4cq\" (UniqueName: \"kubernetes.io/projected/9664ced8-f414-4699-b848-88e8219f651e-kube-api-access-qx4cq\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w\" (UID: \"9664ced8-f414-4699-b848-88e8219f651e\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.564405 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.564370 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:38.695119 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:38.695034 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w"] Apr 17 21:46:38.697428 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:46:38.697396 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9664ced8_f414_4699_b848_88e8219f651e.slice/crio-2b2b49a5b41d679745c26313c740a4344ff8e290e151d4011501c02676d54090 WatchSource:0}: Error finding container 2b2b49a5b41d679745c26313c740a4344ff8e290e151d4011501c02676d54090: Status 404 returned error can't find the container with id 2b2b49a5b41d679745c26313c740a4344ff8e290e151d4011501c02676d54090 Apr 17 21:46:39.373825 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:39.373791 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" event={"ID":"9664ced8-f414-4699-b848-88e8219f651e","Type":"ContainerStarted","Data":"89c365f4d4edf1692178368b465a7c79f4fadb9c820e3035f61aa30138970082"} Apr 17 21:46:39.373825 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:39.373826 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" event={"ID":"9664ced8-f414-4699-b848-88e8219f651e","Type":"ContainerStarted","Data":"2b2b49a5b41d679745c26313c740a4344ff8e290e151d4011501c02676d54090"} Apr 17 21:46:44.368978 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:44.368897 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5gd4g" Apr 17 21:46:44.392194 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:44.392156 2575 generic.go:358] "Generic (PLEG): container finished" podID="9664ced8-f414-4699-b848-88e8219f651e" containerID="89c365f4d4edf1692178368b465a7c79f4fadb9c820e3035f61aa30138970082" exitCode=0 Apr 17 21:46:44.392366 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:44.392237 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" event={"ID":"9664ced8-f414-4699-b848-88e8219f651e","Type":"ContainerDied","Data":"89c365f4d4edf1692178368b465a7c79f4fadb9c820e3035f61aa30138970082"} Apr 17 21:46:45.397572 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:45.397522 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" event={"ID":"9664ced8-f414-4699-b848-88e8219f651e","Type":"ContainerStarted","Data":"b6db9f1cb456dec24ee47239166399f9f00d32313f8a279c3cf8dfae7f4ba2df"} Apr 17 21:46:45.397948 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:45.397756 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:45.415484 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:45.415430 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" podStartSLOduration=7.229218316 podStartE2EDuration="7.415411857s" podCreationTimestamp="2026-04-17 21:46:38 +0000 UTC" firstStartedPulling="2026-04-17 21:46:44.393014746 +0000 UTC m=+568.734177966" lastFinishedPulling="2026-04-17 21:46:44.579208287 +0000 UTC m=+568.920371507" observedRunningTime="2026-04-17 21:46:45.41438081 +0000 UTC m=+569.755544048" watchObservedRunningTime="2026-04-17 21:46:45.415411857 +0000 UTC m=+569.756575099" Apr 17 21:46:49.263258 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.263220 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p"] Apr 17 21:46:49.269533 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.269512 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.273016 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.272980 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Apr 17 21:46:49.274613 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.274589 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p"] Apr 17 21:46:49.410499 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.410455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.410698 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.410507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.410698 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.410558 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.410820 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.410792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg6fg\" (UniqueName: \"kubernetes.io/projected/e6838ee8-42be-4de5-a524-b83bb1b31c33-kube-api-access-wg6fg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.410915 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.410890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6838ee8-42be-4de5-a524-b83bb1b31c33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.411061 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.410957 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.511597 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.511536 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.511597 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.511600 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.511849 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.511622 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.511849 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.511644 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.511849 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.511708 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wg6fg\" (UniqueName: \"kubernetes.io/projected/e6838ee8-42be-4de5-a524-b83bb1b31c33-kube-api-access-wg6fg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.511849 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.511744 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6838ee8-42be-4de5-a524-b83bb1b31c33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.512064 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.511997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.512117 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.512068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.512151 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.512118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.513990 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.513930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6838ee8-42be-4de5-a524-b83bb1b31c33-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.514260 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.514244 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6838ee8-42be-4de5-a524-b83bb1b31c33-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.519059 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.519029 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg6fg\" (UniqueName: \"kubernetes.io/projected/e6838ee8-42be-4de5-a524-b83bb1b31c33-kube-api-access-wg6fg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p\" (UID: \"e6838ee8-42be-4de5-a524-b83bb1b31c33\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.581963 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.581910 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:49.704983 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:49.704955 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p"] Apr 17 21:46:49.707210 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:46:49.707178 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6838ee8_42be_4de5_a524_b83bb1b31c33.slice/crio-496b6664fcbb8508688b4a5cd6498cd97845f6bf237354ece8050176572f3914 WatchSource:0}: Error finding container 496b6664fcbb8508688b4a5cd6498cd97845f6bf237354ece8050176572f3914: Status 404 returned error can't find the container with id 496b6664fcbb8508688b4a5cd6498cd97845f6bf237354ece8050176572f3914 Apr 17 21:46:50.417957 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:50.417915 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" event={"ID":"e6838ee8-42be-4de5-a524-b83bb1b31c33","Type":"ContainerStarted","Data":"19c6fdf50c432f45d13c9d090adb75fda4718aa3f4146f338a78d95fa16f4205"} Apr 17 21:46:50.418361 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:50.417969 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" event={"ID":"e6838ee8-42be-4de5-a524-b83bb1b31c33","Type":"ContainerStarted","Data":"496b6664fcbb8508688b4a5cd6498cd97845f6bf237354ece8050176572f3914"} Apr 17 21:46:55.438634 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:55.438599 2575 generic.go:358] "Generic (PLEG): container finished" podID="e6838ee8-42be-4de5-a524-b83bb1b31c33" containerID="19c6fdf50c432f45d13c9d090adb75fda4718aa3f4146f338a78d95fa16f4205" exitCode=0 Apr 17 21:46:55.438634 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:55.438640 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" event={"ID":"e6838ee8-42be-4de5-a524-b83bb1b31c33","Type":"ContainerDied","Data":"19c6fdf50c432f45d13c9d090adb75fda4718aa3f4146f338a78d95fa16f4205"} Apr 17 21:46:56.414092 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:56.414062 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w" Apr 17 21:46:56.444529 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:56.444495 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" event={"ID":"e6838ee8-42be-4de5-a524-b83bb1b31c33","Type":"ContainerStarted","Data":"7c4e39b574cbfdd6276dadc89b2bfd26c4bdf23ed772facd670bf1bf9b8d12a3"} Apr 17 21:46:56.444900 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:56.444739 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:46:56.462763 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:46:56.462714 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" podStartSLOduration=7.3010523 podStartE2EDuration="7.462699138s" podCreationTimestamp="2026-04-17 21:46:49 +0000 UTC" firstStartedPulling="2026-04-17 21:46:55.439297226 +0000 UTC m=+579.780460443" lastFinishedPulling="2026-04-17 21:46:55.600944065 +0000 UTC m=+579.942107281" observedRunningTime="2026-04-17 21:46:56.461324796 +0000 UTC m=+580.802488035" watchObservedRunningTime="2026-04-17 21:46:56.462699138 +0000 UTC m=+580.803862376" Apr 17 21:47:07.461889 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:07.461855 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p" Apr 17 21:47:11.251223 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.251184 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt"] Apr 17 21:47:11.254980 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.254959 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.257334 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.257308 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Apr 17 21:47:11.264123 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.264100 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt"] Apr 17 21:47:11.304945 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.304908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wb7h\" (UniqueName: \"kubernetes.io/projected/728bf567-9dde-4ecd-9041-10f9cd29c3c6-kube-api-access-7wb7h\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.305093 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.305026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.305093 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.305048 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.305093 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.305065 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.305093 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.305088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.305283 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.305171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728bf567-9dde-4ecd-9041-10f9cd29c3c6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.405608 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.405569 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728bf567-9dde-4ecd-9041-10f9cd29c3c6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.405793 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.405632 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wb7h\" (UniqueName: \"kubernetes.io/projected/728bf567-9dde-4ecd-9041-10f9cd29c3c6-kube-api-access-7wb7h\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.405793 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.405759 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.405793 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.405790 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.405964 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.405814 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.405964 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.405841 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.406260 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.406231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.406260 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.406250 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.406447 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.406307 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.407956 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.407931 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/728bf567-9dde-4ecd-9041-10f9cd29c3c6-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.408073 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.408057 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/728bf567-9dde-4ecd-9041-10f9cd29c3c6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.414799 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.414779 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wb7h\" (UniqueName: \"kubernetes.io/projected/728bf567-9dde-4ecd-9041-10f9cd29c3c6-kube-api-access-7wb7h\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-stvtt\" (UID: \"728bf567-9dde-4ecd-9041-10f9cd29c3c6\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.565242 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.565207 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:11.686709 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:11.686684 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt"] Apr 17 21:47:11.688936 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:47:11.688909 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod728bf567_9dde_4ecd_9041_10f9cd29c3c6.slice/crio-d080a83e417407191d3f20e08dac51881192d6107914f26bbd0f8fa77f736662 WatchSource:0}: Error finding container d080a83e417407191d3f20e08dac51881192d6107914f26bbd0f8fa77f736662: Status 404 returned error can't find the container with id d080a83e417407191d3f20e08dac51881192d6107914f26bbd0f8fa77f736662 Apr 17 21:47:12.506481 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:12.506441 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" event={"ID":"728bf567-9dde-4ecd-9041-10f9cd29c3c6","Type":"ContainerStarted","Data":"7497d43057f1f92485e96e9c8fd603d039d41b18bd25dcff91becbc891d7e814"} Apr 17 21:47:12.506481 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:12.506487 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" event={"ID":"728bf567-9dde-4ecd-9041-10f9cd29c3c6","Type":"ContainerStarted","Data":"d080a83e417407191d3f20e08dac51881192d6107914f26bbd0f8fa77f736662"} Apr 17 21:47:14.451708 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.451669 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt"] Apr 17 21:47:14.455833 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.455812 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.458473 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.458445 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Apr 17 21:47:14.465080 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.464093 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt"] Apr 17 21:47:14.541893 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.541856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.542070 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.541915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.542070 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.541948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qtp5\" (UniqueName: \"kubernetes.io/projected/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-kube-api-access-5qtp5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.542070 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.541990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.542070 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.542055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.542208 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.542161 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.643440 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.643394 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.643643 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.643477 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.643643 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.643513 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qtp5\" (UniqueName: \"kubernetes.io/projected/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-kube-api-access-5qtp5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.643643 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.643592 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.643643 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.643632 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.643863 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.643735 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.644026 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.643997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.644114 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.644042 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.644237 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.644215 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.646343 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.646318 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.646478 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.646459 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.651169 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.651142 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qtp5\" (UniqueName: \"kubernetes.io/projected/28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e-kube-api-access-5qtp5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt\" (UID: \"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.768557 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.768520 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:14.896161 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:14.896135 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt"] Apr 17 21:47:14.898156 ip-10-0-132-175 kubenswrapper[2575]: W0417 21:47:14.898123 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ca58aa_07ff_4ae7_85c3_6b25d9b20e9e.slice/crio-550f79570c87dcb9e4f30210280a8b21d1ea74de59d6598f43c0fa1ad8e80dbe WatchSource:0}: Error finding container 550f79570c87dcb9e4f30210280a8b21d1ea74de59d6598f43c0fa1ad8e80dbe: Status 404 returned error can't find the container with id 550f79570c87dcb9e4f30210280a8b21d1ea74de59d6598f43c0fa1ad8e80dbe Apr 17 21:47:15.518992 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:15.518958 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" event={"ID":"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e","Type":"ContainerStarted","Data":"0c009ee11f477019036a921093bec650ced4536f13850f9e4bb89984601091b2"} Apr 17 21:47:15.518992 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:15.518995 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" event={"ID":"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e","Type":"ContainerStarted","Data":"550f79570c87dcb9e4f30210280a8b21d1ea74de59d6598f43c0fa1ad8e80dbe"} Apr 17 21:47:20.542391 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:20.542353 2575 generic.go:358] "Generic (PLEG): container finished" podID="728bf567-9dde-4ecd-9041-10f9cd29c3c6" containerID="7497d43057f1f92485e96e9c8fd603d039d41b18bd25dcff91becbc891d7e814" exitCode=0 Apr 17 21:47:20.542910 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:20.542435 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" event={"ID":"728bf567-9dde-4ecd-9041-10f9cd29c3c6","Type":"ContainerDied","Data":"7497d43057f1f92485e96e9c8fd603d039d41b18bd25dcff91becbc891d7e814"} Apr 17 21:47:21.547726 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:21.547688 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" event={"ID":"728bf567-9dde-4ecd-9041-10f9cd29c3c6","Type":"ContainerStarted","Data":"5b4a54c6a7dc8e9e133820aaa9f50f2b953da676f43f606ac8f98efdc8fbdfd3"} Apr 17 21:47:21.548190 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:21.547906 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:21.549075 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:21.549051 2575 generic.go:358] "Generic (PLEG): container finished" podID="28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e" containerID="0c009ee11f477019036a921093bec650ced4536f13850f9e4bb89984601091b2" exitCode=0 Apr 17 21:47:21.549172 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:21.549121 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" event={"ID":"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e","Type":"ContainerDied","Data":"0c009ee11f477019036a921093bec650ced4536f13850f9e4bb89984601091b2"} Apr 17 21:47:21.566334 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:21.566295 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" podStartSLOduration=10.394656024 podStartE2EDuration="10.566270623s" podCreationTimestamp="2026-04-17 21:47:11 +0000 UTC" firstStartedPulling="2026-04-17 21:47:20.543256275 +0000 UTC m=+604.884419490" lastFinishedPulling="2026-04-17 21:47:20.714870856 +0000 UTC m=+605.056034089" observedRunningTime="2026-04-17 21:47:21.564253798 +0000 UTC m=+605.905417039" watchObservedRunningTime="2026-04-17 21:47:21.566270623 +0000 UTC m=+605.907433858" Apr 17 21:47:22.560007 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:22.559966 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" event={"ID":"28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e","Type":"ContainerStarted","Data":"2d6abb1b3b6191f9a4143fa294c9c49da693523f93db224d7f8363f8104119c7"} Apr 17 21:47:22.560404 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:22.560270 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 21:47:22.578072 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:22.578025 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" podStartSLOduration=8.398219251 podStartE2EDuration="8.578011679s" podCreationTimestamp="2026-04-17 21:47:14 +0000 UTC" firstStartedPulling="2026-04-17 21:47:21.549769979 +0000 UTC m=+605.890933195" lastFinishedPulling="2026-04-17 21:47:21.729562404 +0000 UTC m=+606.070725623" observedRunningTime="2026-04-17 21:47:22.576755136 +0000 UTC m=+606.917918367" watchObservedRunningTime="2026-04-17 21:47:22.578011679 +0000 UTC m=+606.919174916" Apr 17 21:47:32.573002 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:32.572961 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-stvtt" Apr 17 21:47:33.575881 ip-10-0-132-175 kubenswrapper[2575]: I0417 21:47:33.575851 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt" Apr 17 22:03:53.461273 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.461229 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq"] Apr 17 22:03:53.461918 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.461523 2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" podUID="2b36d239-45f8-4786-a22b-aa7b1d3efada" containerName="manager" containerID="cri-o://c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48" gracePeriod=10 Apr 17 22:03:53.812589 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.812565 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 22:03:53.889770 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.889735 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm8nd\" (UniqueName: \"kubernetes.io/projected/2b36d239-45f8-4786-a22b-aa7b1d3efada-kube-api-access-gm8nd\") pod \"2b36d239-45f8-4786-a22b-aa7b1d3efada\" (UID: \"2b36d239-45f8-4786-a22b-aa7b1d3efada\") " Apr 17 22:03:53.889927 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.889867 2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b36d239-45f8-4786-a22b-aa7b1d3efada-extensions-socket-volume\") pod \"2b36d239-45f8-4786-a22b-aa7b1d3efada\" (UID: \"2b36d239-45f8-4786-a22b-aa7b1d3efada\") " Apr 17 22:03:53.890247 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.890220 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b36d239-45f8-4786-a22b-aa7b1d3efada-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b36d239-45f8-4786-a22b-aa7b1d3efada" (UID: "2b36d239-45f8-4786-a22b-aa7b1d3efada"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Apr 17 22:03:53.891770 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.891744 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b36d239-45f8-4786-a22b-aa7b1d3efada-kube-api-access-gm8nd" (OuterVolumeSpecName: "kube-api-access-gm8nd") pod "2b36d239-45f8-4786-a22b-aa7b1d3efada" (UID: "2b36d239-45f8-4786-a22b-aa7b1d3efada"). InnerVolumeSpecName "kube-api-access-gm8nd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Apr 17 22:03:53.991244 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.991158 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm8nd\" (UniqueName: \"kubernetes.io/projected/2b36d239-45f8-4786-a22b-aa7b1d3efada-kube-api-access-gm8nd\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 22:03:53.991244 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:53.991190 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b36d239-45f8-4786-a22b-aa7b1d3efada-extensions-socket-volume\") on node \"ip-10-0-132-175.ec2.internal\" DevicePath \"\"" Apr 17 22:03:54.102797 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.102761 2575 generic.go:358] "Generic (PLEG): container finished" podID="2b36d239-45f8-4786-a22b-aa7b1d3efada" containerID="c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48" exitCode=0 Apr 17 22:03:54.102958 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.102816 2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" Apr 17 22:03:54.102958 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.102844 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" event={"ID":"2b36d239-45f8-4786-a22b-aa7b1d3efada","Type":"ContainerDied","Data":"c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48"} Apr 17 22:03:54.102958 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.102887 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq" event={"ID":"2b36d239-45f8-4786-a22b-aa7b1d3efada","Type":"ContainerDied","Data":"8b385095468be37037831cfe1daf6e1014346b7927f9f866ab804bdf869ddb9a"} Apr 17 22:03:54.102958 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.102906 2575 scope.go:117] "RemoveContainer" containerID="c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48" Apr 17 22:03:54.112438 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.112420 2575 scope.go:117] "RemoveContainer" containerID="c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48" Apr 17 22:03:54.112719 ip-10-0-132-175 kubenswrapper[2575]: E0417 22:03:54.112696 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48\": container with ID starting with c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48 not found: ID does not exist" containerID="c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48" Apr 17 22:03:54.112799 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.112733 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48"} err="failed to get container status \"c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48\": rpc error: code = NotFound desc = could not find container \"c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48\": container with ID starting with c3472b5a7716dea07ab9cd3eb8e472424306e40bd14fc97147d3331a27637e48 not found: ID does not exist" Apr 17 22:03:54.125038 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.125008 2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq"] Apr 17 22:03:54.130254 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.130228 2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jdtsq"] Apr 17 22:03:54.262709 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:03:54.262681 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b36d239-45f8-4786-a22b-aa7b1d3efada" path="/var/lib/kubelet/pods/2b36d239-45f8-4786-a22b-aa7b1d3efada/volumes" Apr 17 22:06:28.909454 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:28.909424 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm_f1198586-dcbd-4bcd-a903-99b106886735/manager/0.log" Apr 17 22:06:30.558038 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:30.558013 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-fv4fw_2aaf13d1-7042-4fff-8d6b-44ef13f243d2/kuadrant-console-plugin/0.log" Apr 17 22:06:31.553608 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:31.553578 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79c9d94f8f-42xls_151b3328-3556-44ba-83b3-d035c4800d16/kube-auth-proxy/0.log" Apr 17 22:06:32.225539 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.225510 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v_bbc5c57c-6a3a-4f1e-b61f-f50a392090de/storage-initializer/0.log" Apr 17 22:06:32.232289 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.232268 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-h6d4v_bbc5c57c-6a3a-4f1e-b61f-f50a392090de/main/0.log" Apr 17 22:06:32.350386 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.350359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt_28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e/storage-initializer/0.log" Apr 17 22:06:32.361557 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.361529 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-s9rgt_28ca58aa-07ff-4ae7-85c3-6b25d9b20e9e/main/0.log" Apr 17 22:06:32.470868 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.470839 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-5gd4g_8c549752-912c-4337-94b1-14490f60242f/main/0.log" Apr 17 22:06:32.476565 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.476496 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-5gd4g_8c549752-912c-4337-94b1-14490f60242f/storage-initializer/0.log" Apr 17 22:06:32.583559 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.583512 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p_e6838ee8-42be-4de5-a524-b83bb1b31c33/storage-initializer/0.log" Apr 17 22:06:32.590407 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.590386 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsrg6p_e6838ee8-42be-4de5-a524-b83bb1b31c33/main/0.log" Apr 17 22:06:32.696599 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.696568 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w_9664ced8-f414-4699-b848-88e8219f651e/storage-initializer/0.log" Apr 17 22:06:32.703171 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.703147 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-gnf5w_9664ced8-f414-4699-b848-88e8219f651e/main/0.log" Apr 17 22:06:32.809725 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.809691 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-stvtt_728bf567-9dde-4ecd-9041-10f9cd29c3c6/storage-initializer/0.log" Apr 17 22:06:32.816010 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:32.815991 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-stvtt_728bf567-9dde-4ecd-9041-10f9cd29c3c6/main/0.log" Apr 17 22:06:39.501712 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:39.501678 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k8zmv_71b3e6b9-2b5c-4c09-8aca-ae18c06b8ed1/global-pull-secret-syncer/0.log" Apr 17 22:06:39.573865 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:39.573835 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7jg4t_ce77b2c3-16e4-4b59-8329-1d34893d72ff/konnectivity-agent/0.log" Apr 17 22:06:39.641350 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:39.641320 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-175.ec2.internal_0ba8082f338ee1f27e5bc360da980737/haproxy/0.log" Apr 17 22:06:43.351102 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:43.351080 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-fv4fw_2aaf13d1-7042-4fff-8d6b-44ef13f243d2/kuadrant-console-plugin/0.log" Apr 17 22:06:44.834844 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:44.834819 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f8988736-278d-4d25-b0aa-85538c273612/alertmanager/0.log" Apr 17 22:06:44.870352 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:44.870325 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f8988736-278d-4d25-b0aa-85538c273612/config-reloader/0.log" Apr 17 22:06:44.890292 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:44.890262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f8988736-278d-4d25-b0aa-85538c273612/kube-rbac-proxy-web/0.log" Apr 17 22:06:44.909495 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:44.909467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f8988736-278d-4d25-b0aa-85538c273612/kube-rbac-proxy/0.log" Apr 17 22:06:44.933738 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:44.933711 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f8988736-278d-4d25-b0aa-85538c273612/kube-rbac-proxy-metric/0.log" Apr 17 22:06:44.954272 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:44.954251 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f8988736-278d-4d25-b0aa-85538c273612/prom-label-proxy/0.log" Apr 17 22:06:44.981535 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:44.981513 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f8988736-278d-4d25-b0aa-85538c273612/init-config-reloader/0.log" Apr 17 22:06:45.040414 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.040389 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-7mgc9_f55baa0d-b33f-4d79-8b23-4f80f5cbe536/kube-state-metrics/0.log" Apr 17 22:06:45.066281 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.066257 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-7mgc9_f55baa0d-b33f-4d79-8b23-4f80f5cbe536/kube-rbac-proxy-main/0.log" Apr 17 22:06:45.090538 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.090471 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-69db897b98-7mgc9_f55baa0d-b33f-4d79-8b23-4f80f5cbe536/kube-rbac-proxy-self/0.log" Apr 17 22:06:45.348473 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.348398 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6phw_05a733bd-f581-4306-a492-cc81ddf6c2f9/node-exporter/0.log" Apr 17 22:06:45.382896 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.382853 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6phw_05a733bd-f581-4306-a492-cc81ddf6c2f9/kube-rbac-proxy/0.log" Apr 17 22:06:45.411468 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.411428 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x6phw_05a733bd-f581-4306-a492-cc81ddf6c2f9/init-textfile/0.log" Apr 17 22:06:45.452931 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.452888 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-qxnxf_5b36f5f6-06a3-4f05-8ddc-042211be3e7b/kube-rbac-proxy-main/0.log" Apr 17 22:06:45.478296 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.478273 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-qxnxf_5b36f5f6-06a3-4f05-8ddc-042211be3e7b/kube-rbac-proxy-self/0.log" Apr 17 22:06:45.502175 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.502151 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9d44df66c-qxnxf_5b36f5f6-06a3-4f05-8ddc-042211be3e7b/openshift-state-metrics/0.log" Apr 17 22:06:45.542753 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.542724 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f284c77-ef5d-4fa5-bb48-57a03e95cf83/prometheus/0.log" Apr 17 22:06:45.567566 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.567518 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f284c77-ef5d-4fa5-bb48-57a03e95cf83/config-reloader/0.log" Apr 17 22:06:45.591081 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.591039 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f284c77-ef5d-4fa5-bb48-57a03e95cf83/thanos-sidecar/0.log" Apr 17 22:06:45.612626 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.612523 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f284c77-ef5d-4fa5-bb48-57a03e95cf83/kube-rbac-proxy-web/0.log" Apr 17 22:06:45.633384 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.633359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f284c77-ef5d-4fa5-bb48-57a03e95cf83/kube-rbac-proxy/0.log" Apr 17 22:06:45.669799 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.669777 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f284c77-ef5d-4fa5-bb48-57a03e95cf83/kube-rbac-proxy-thanos/0.log" Apr 17 22:06:45.689162 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.689141 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4f284c77-ef5d-4fa5-bb48-57a03e95cf83/init-config-reloader/0.log" Apr 17 22:06:45.762850 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.762825 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-57cf98b594-jwm29_53154e66-f3ee-4684-85c9-62e754c4f8f5/prometheus-operator-admission-webhook/0.log" Apr 17 22:06:45.793508 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.793453 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dfd584d58-pbx5c_1be66022-a026-418d-9603-35f0917b4aec/telemeter-client/0.log" Apr 17 22:06:45.818228 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.818197 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dfd584d58-pbx5c_1be66022-a026-418d-9603-35f0917b4aec/reload/0.log" Apr 17 22:06:45.836775 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.836751 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dfd584d58-pbx5c_1be66022-a026-418d-9603-35f0917b4aec/kube-rbac-proxy/0.log" Apr 17 22:06:45.881836 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.881766 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c79454d6-6qrg8_4ecbaf65-5737-4694-927b-05044e8606c1/thanos-query/0.log" Apr 17 22:06:45.903278 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.903254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c79454d6-6qrg8_4ecbaf65-5737-4694-927b-05044e8606c1/kube-rbac-proxy-web/0.log" Apr 17 22:06:45.922276 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.922254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c79454d6-6qrg8_4ecbaf65-5737-4694-927b-05044e8606c1/kube-rbac-proxy/0.log" Apr 17 22:06:45.945516 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.945496 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c79454d6-6qrg8_4ecbaf65-5737-4694-927b-05044e8606c1/prom-label-proxy/0.log" Apr 17 22:06:45.967053 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.967028 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c79454d6-6qrg8_4ecbaf65-5737-4694-927b-05044e8606c1/kube-rbac-proxy-rules/0.log" Apr 17 22:06:45.986958 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:45.986937 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c79454d6-6qrg8_4ecbaf65-5737-4694-927b-05044e8606c1/kube-rbac-proxy-metrics/0.log" Apr 17 22:06:48.317257 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.317214 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644f5d7bbd-szdtp_89e7aec8-0567-4c42-a1bf-b02e41c7aa55/console/0.log" Apr 17 22:06:48.615305 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.615113 2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh"] Apr 17 22:06:48.615644 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.615626 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b36d239-45f8-4786-a22b-aa7b1d3efada" containerName="manager" Apr 17 22:06:48.615712 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.615646 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b36d239-45f8-4786-a22b-aa7b1d3efada" containerName="manager" Apr 17 22:06:48.615749 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.615713 2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="2b36d239-45f8-4786-a22b-aa7b1d3efada" containerName="manager" Apr 17 22:06:48.618927 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.618911 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.621494 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.621469 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tfkqt\"/\"openshift-service-ca.crt\"" Apr 17 22:06:48.621639 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.621471 2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tfkqt\"/\"kube-root-ca.crt\"" Apr 17 22:06:48.622454 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.622438 2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tfkqt\"/\"default-dockercfg-km98p\"" Apr 17 22:06:48.626702 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.626677 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh"] Apr 17 22:06:48.729691 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.729658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4tnd\" (UniqueName: \"kubernetes.io/projected/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-kube-api-access-v4tnd\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.729865 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.729707 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-podres\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.729865 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.729763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-sys\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.729865 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.729793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-proc\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.729988 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.729873 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-lib-modules\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830535 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830499 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4tnd\" (UniqueName: \"kubernetes.io/projected/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-kube-api-access-v4tnd\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830722 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830562 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-podres\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830722 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830597 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-sys\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830722 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830638 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-proc\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830722 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830706 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-sys\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830867 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830739 2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-lib-modules\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830867 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830761 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-proc\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830867 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830739 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-podres\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.830867 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.830810 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-lib-modules\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.837993 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.837971 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4tnd\" (UniqueName: \"kubernetes.io/projected/d9a8ee52-56ef-48e4-ac18-3a519c17e6cb-kube-api-access-v4tnd\") pod \"perf-node-gather-daemonset-fx4dh\" (UID: \"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb\") " pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:48.929671 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:48.929593 2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:49.049625 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.049569 2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh"] Apr 17 22:06:49.052265 ip-10-0-132-175 kubenswrapper[2575]: W0417 22:06:49.052235 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd9a8ee52_56ef_48e4_ac18_3a519c17e6cb.slice/crio-bbd2b2c1ea478444e9e3b63ca66c8c19efae5b84a5d6ee2eae25a9dbaeeb3ea9 WatchSource:0}: Error finding container bbd2b2c1ea478444e9e3b63ca66c8c19efae5b84a5d6ee2eae25a9dbaeeb3ea9: Status 404 returned error can't find the container with id bbd2b2c1ea478444e9e3b63ca66c8c19efae5b84a5d6ee2eae25a9dbaeeb3ea9 Apr 17 22:06:49.054168 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.054151 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Apr 17 22:06:49.719615 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.719572 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" event={"ID":"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb","Type":"ContainerStarted","Data":"4c86438f516cf3e26ec0a6cdc829feef734aeb7a222efd0e3acd1e0f029f2624"} Apr 17 22:06:49.719615 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.719620 2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" event={"ID":"d9a8ee52-56ef-48e4-ac18-3a519c17e6cb","Type":"ContainerStarted","Data":"bbd2b2c1ea478444e9e3b63ca66c8c19efae5b84a5d6ee2eae25a9dbaeeb3ea9"} Apr 17 22:06:49.720015 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.719703 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:49.736265 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.736218 2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" podStartSLOduration=1.736204479 podStartE2EDuration="1.736204479s" podCreationTimestamp="2026-04-17 22:06:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-04-17 22:06:49.734746545 +0000 UTC m=+1774.075909784" watchObservedRunningTime="2026-04-17 22:06:49.736204479 +0000 UTC m=+1774.077367716" Apr 17 22:06:49.736777 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.736756 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kj82w_5e3a6237-2706-4d1d-ac8c-b075f011d7a0/dns/0.log" Apr 17 22:06:49.755938 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.755914 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kj82w_5e3a6237-2706-4d1d-ac8c-b075f011d7a0/kube-rbac-proxy/0.log" Apr 17 22:06:49.913512 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:49.913475 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xmr7n_baeb04dc-2d22-4ffb-8e04-34da91f1c68a/dns-node-resolver/0.log" Apr 17 22:06:50.453987 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:50.453957 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hlpdf_95668458-8555-48b3-ad99-7cd7312a3d17/node-ca/0.log" Apr 17 22:06:51.385312 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:51.385279 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79c9d94f8f-42xls_151b3328-3556-44ba-83b3-d035c4800d16/kube-auth-proxy/0.log" Apr 17 22:06:51.997318 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:51.997289 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-925tc_0762a6a9-50ab-41b1-b029-2a12a45708fd/serve-healthcheck-canary/0.log" Apr 17 22:06:52.475105 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:52.475076 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2kln_127e564e-bab1-48ad-a3cb-f4a23e099acf/kube-rbac-proxy/0.log" Apr 17 22:06:52.496464 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:52.496440 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2kln_127e564e-bab1-48ad-a3cb-f4a23e099acf/exporter/0.log" Apr 17 22:06:52.517891 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:52.517852 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2kln_127e564e-bab1-48ad-a3cb-f4a23e099acf/extractor/0.log" Apr 17 22:06:54.698943 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:54.698913 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bfddf7b9f-ddtnm_f1198586-dcbd-4bcd-a903-99b106886735/manager/0.log" Apr 17 22:06:55.733692 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:55.733666 2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tfkqt/perf-node-gather-daemonset-fx4dh" Apr 17 22:06:55.837151 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:06:55.837112 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64dbd89fbc-c6np8_332f15d2-b99c-458b-8ba4-6a8bd4e3b609/manager/0.log" Apr 17 22:07:01.986387 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:01.986359 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7sqxl_5ca56a41-5fef-481d-93e3-755405050744/kube-multus-additional-cni-plugins/0.log" Apr 17 22:07:02.006848 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.006798 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7sqxl_5ca56a41-5fef-481d-93e3-755405050744/egress-router-binary-copy/0.log" Apr 17 22:07:02.026511 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.026480 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7sqxl_5ca56a41-5fef-481d-93e3-755405050744/cni-plugins/0.log" Apr 17 22:07:02.050162 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.050132 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7sqxl_5ca56a41-5fef-481d-93e3-755405050744/bond-cni-plugin/0.log" Apr 17 22:07:02.068887 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.068850 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7sqxl_5ca56a41-5fef-481d-93e3-755405050744/routeoverride-cni/0.log" Apr 17 22:07:02.087246 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.087207 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7sqxl_5ca56a41-5fef-481d-93e3-755405050744/whereabouts-cni-bincopy/0.log" Apr 17 22:07:02.109304 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.109273 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7sqxl_5ca56a41-5fef-481d-93e3-755405050744/whereabouts-cni/0.log" Apr 17 22:07:02.305965 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.305929 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kgddm_5c64ce05-7e06-41fc-9313-2b7ba52ca0c4/kube-multus/0.log" Apr 17 22:07:02.434203 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.434171 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nj256_acf375eb-382e-4e70-8999-46983d601f3f/network-metrics-daemon/0.log" Apr 17 22:07:02.451159 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:02.451132 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nj256_acf375eb-382e-4e70-8999-46983d601f3f/kube-rbac-proxy/0.log" Apr 17 22:07:03.758705 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:03.758677 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvrm9_30b798b6-20ec-4671-ab7c-f63db01270b8/ovn-controller/0.log" Apr 17 22:07:03.783055 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:03.783024 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvrm9_30b798b6-20ec-4671-ab7c-f63db01270b8/ovn-acl-logging/0.log" Apr 17 22:07:03.798271 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:03.798234 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvrm9_30b798b6-20ec-4671-ab7c-f63db01270b8/kube-rbac-proxy-node/0.log" Apr 17 22:07:03.817627 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:03.817591 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvrm9_30b798b6-20ec-4671-ab7c-f63db01270b8/kube-rbac-proxy-ovn-metrics/0.log" Apr 17 22:07:03.835682 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:03.835643 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvrm9_30b798b6-20ec-4671-ab7c-f63db01270b8/northd/0.log" Apr 17 22:07:03.853304 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:03.853280 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvrm9_30b798b6-20ec-4671-ab7c-f63db01270b8/nbdb/0.log" Apr 17 22:07:03.871434 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:03.871400 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvrm9_30b798b6-20ec-4671-ab7c-f63db01270b8/sbdb/0.log" Apr 17 22:07:03.965574 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:03.965527 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvrm9_30b798b6-20ec-4671-ab7c-f63db01270b8/ovnkube-controller/0.log" Apr 17 22:07:05.150670 ip-10-0-132-175 kubenswrapper[2575]: I0417 22:07:05.150641 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tb94q_239dc9d6-2782-48f3-82ef-7b176001f318/network-check-target-container/0.log"