Jun 12 22:18:09.325290 ip-10-0-128-221 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 22:18:09.325305 ip-10-0-128-221 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 22:18:09.325315 ip-10-0-128-221 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 22:18:09.325591 ip-10-0-128-221 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 22:18:19.500070 ip-10-0-128-221 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 12 22:18:19.500088 ip-10-0-128-221 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b76e832fd3bd46deba5c533d6703d904 -- Jun 12 22:20:40.838432 ip-10-0-128-221 systemd[1]: Starting Kubernetes Kubelet... Jun 12 22:20:41.249796 ip-10-0-128-221 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:41.249796 ip-10-0-128-221 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 22:20:41.249796 ip-10-0-128-221 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:41.249796 ip-10-0-128-221 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 22:20:41.249796 ip-10-0-128-221 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 22:20:41.250775 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.250685 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 22:20:41.257161 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257138 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:41.257161 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257157 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:41.257161 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257161 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:41.257161 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257164 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:41.257161 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257168 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:41.257161 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257171 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257174 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257177 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257180 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257184 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257187 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257189 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257195 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257198 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257202 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257204 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257209 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257212 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257215 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257218 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257220 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257223 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257226 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257228 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:41.257381 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257234 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257237 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257240 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257242 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257245 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257248 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257251 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257254 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257256 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257259 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257261 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257265 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257270 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257273 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257275 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257279 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257284 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257288 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257291 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:41.257821 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257295 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257298 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257301 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257304 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257307 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257313 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257316 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257319 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257321 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257324 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257326 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257329 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257331 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257334 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257337 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257339 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257342 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257345 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257349 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:41.258311 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257352 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257354 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257357 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257360 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257362 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257365 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257368 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257371 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257374 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257377 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257380 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257383 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257388 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257393 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257397 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257401 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257403 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257406 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257410 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257413 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:41.258852 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257416 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257418 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257421 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257426 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257429 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257431 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257434 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257437 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257439 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257443 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257447 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257450 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257453 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257456 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257459 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257464 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:41.259369 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.257467 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259586 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259594 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259597 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259601 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259604 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259607 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259612 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259615 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259618 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259621 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259625 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259627 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259630 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259635 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259639 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259642 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259645 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259647 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:41.259751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259653 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259655 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259658 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259661 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259663 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259665 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259668 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259671 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259673 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259676 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259679 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259681 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259686 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259689 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259692 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259695 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259698 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259701 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259704 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259707 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:41.260256 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259710 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259713 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259716 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259718 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259723 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259726 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259728 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259731 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259733 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259736 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259739 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259742 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259744 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259747 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259749 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259752 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259754 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259759 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259762 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259765 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:41.260738 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259767 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259770 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259774 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259777 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259780 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259782 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259785 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259789 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259793 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259798 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259801 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259803 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259806 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259808 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259811 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259813 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259816 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259818 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259821 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259823 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:41.261286 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259826 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259828 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259834 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259836 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259839 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259842 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259844 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259847 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259852 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259855 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259859 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259861 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259864 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259869 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259872 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259874 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259876 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259879 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259882 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:41.261770 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259886 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.259889 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260585 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260592 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260598 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260601 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260604 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260607 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260610 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260613 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260616 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260618 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260621 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260624 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260626 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260630 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260632 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260638 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260640 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260643 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:41.262251 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260645 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260648 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260650 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260653 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260655 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260658 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260660 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260663 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260665 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260667 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260672 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260675 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260678 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260681 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260684 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260687 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260689 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260692 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260694 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:41.262740 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260697 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260699 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260702 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260707 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260710 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260712 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260715 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260719 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260722 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260725 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260728 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260731 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260733 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260736 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260739 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260753 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260757 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260761 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260763 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:41.263217 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260766 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260769 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260772 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260776 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260779 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260783 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260786 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260789 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260795 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260798 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260801 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260804 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260806 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260809 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260813 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260816 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260819 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260821 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260824 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260829 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:41.263677 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260832 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260834 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260837 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260840 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260843 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260845 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260848 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260851 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260853 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260856 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260858 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260861 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260866 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260868 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260872 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260875 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260878 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260881 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260884 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260887 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:41.264168 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260890 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260892 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.260895 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261119 2580 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261138 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261271 2580 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261285 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261290 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261293 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261297 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261302 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261305 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261309 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261312 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261316 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261319 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261322 2580 flags.go:64] FLAG: --cgroup-root="" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261325 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261329 2580 flags.go:64] FLAG: --client-ca-file="" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261331 2580 flags.go:64] FLAG: --cloud-provider="external" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261334 2580 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261339 2580 flags.go:64] FLAG: --cluster-domain="" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261341 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261344 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 22:20:41.264636 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261347 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261351 2580 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261354 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261357 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261360 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261363 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261366 2580 flags.go:64] FLAG: --contention-profiling="false" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261369 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261371 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261375 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261378 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261382 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261385 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261389 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261394 2580 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261399 2580 flags.go:64] FLAG: --enable-server="true" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261402 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261409 2580 flags.go:64] FLAG: --event-burst="100" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261414 2580 flags.go:64] FLAG: --event-qps="50" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261419 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261424 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261427 2580 flags.go:64] FLAG: --eviction-hard="" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261431 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261435 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261440 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 22:20:41.265203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261444 2580 flags.go:64] FLAG: --eviction-soft="" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261448 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261451 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261455 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261458 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261463 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261466 2580 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261469 2580 flags.go:64] FLAG: --feature-gates="" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261473 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261476 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261479 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261483 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261485 2580 flags.go:64] FLAG: --healthz-port="10248" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261488 2580 flags.go:64] FLAG: --help="false" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261491 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261494 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261497 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261500 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261504 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261514 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261517 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261520 2580 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261523 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 22:20:41.265792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261526 2580 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261529 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261532 2580 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261535 2580 flags.go:64] FLAG: --kube-reserved="" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261538 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261541 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261544 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261546 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261549 2580 flags.go:64] FLAG: --lock-file="" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261552 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261554 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261557 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261563 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261566 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261569 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261571 2580 flags.go:64] FLAG: --logging-format="text" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261574 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261577 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261580 2580 flags.go:64] FLAG: --manifest-url="" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261583 2580 flags.go:64] FLAG: --manifest-url-header="" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261588 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261591 2580 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261595 2580 flags.go:64] FLAG: --max-pods="110" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261597 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261600 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 22:20:41.266425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261603 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261606 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261609 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261614 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261617 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261626 2580 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261629 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261632 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261635 2580 flags.go:64] FLAG: --pod-cidr="" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261638 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261643 2580 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261646 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261649 2580 flags.go:64] FLAG: --pods-per-core="0" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261652 2580 flags.go:64] FLAG: --port="10250" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261655 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261657 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-024f260f77e3d1a0c" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261661 2580 flags.go:64] FLAG: --qos-reserved="" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261663 2580 flags.go:64] FLAG: --read-only-port="10255" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261666 2580 flags.go:64] FLAG: --register-node="true" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261669 2580 flags.go:64] FLAG: --register-with-taints="" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261672 2580 flags.go:64] FLAG: --registry-burst="10" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261676 2580 flags.go:64] FLAG: --registry-qps="5" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261679 2580 flags.go:64] FLAG: --reserved-cpus="" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261682 2580 flags.go:64] FLAG: --reserved-memory="" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261686 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 22:20:41.267023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261689 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261691 2580 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261694 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261697 2580 flags.go:64] FLAG: --runonce="false" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261699 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261702 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261705 2580 flags.go:64] FLAG: --seccomp-default="false" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261708 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261711 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261714 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261718 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261722 2580 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261725 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261728 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261730 2580 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261733 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261736 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261739 2580 flags.go:64] FLAG: --system-cgroups="" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261742 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261748 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261751 2580 flags.go:64] FLAG: --tls-cert-file="" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261753 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261757 2580 flags.go:64] FLAG: --tls-min-version="" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261760 2580 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261763 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 22:20:41.267649 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261766 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261769 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261772 2580 flags.go:64] FLAG: --v="2" Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261776 2580 flags.go:64] FLAG: --version="false" Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261780 2580 flags.go:64] FLAG: --vmodule="" Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261784 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.261787 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261915 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261920 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261925 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261930 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261935 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261939 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261943 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261948 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261952 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261955 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261959 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261963 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261965 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261968 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:41.268510 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261970 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261973 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261975 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261978 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261980 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261983 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261985 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261988 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261990 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261992 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261995 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.261997 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262000 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262002 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262004 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262007 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262010 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262013 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262015 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262018 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:41.269484 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262021 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262023 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262026 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262028 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262030 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262032 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262035 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262037 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262041 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262043 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262062 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262065 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262068 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262071 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262074 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262076 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262092 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262095 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262098 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262100 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:41.270327 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262103 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262106 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262108 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262111 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262114 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262116 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262119 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262121 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262125 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262130 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262133 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262135 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262138 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262140 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262142 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262145 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262147 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262149 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262152 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262155 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:41.271230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262160 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262163 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262166 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262169 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262172 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262174 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262176 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262179 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262181 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262184 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262186 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262189 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262192 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262196 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262199 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262202 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262205 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262208 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262210 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:41.272039 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262213 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262216 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262220 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262223 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262226 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.262229 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.262798 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.270322 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.270354 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.270381 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.270390 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270476 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270483 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270489 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:41.272711 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270493 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270498 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270503 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270510 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270516 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270521 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270525 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270530 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270534 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270539 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270544 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270550 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270554 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270559 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270563 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270568 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270572 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270577 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:41.273451 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270582 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270586 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270591 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270596 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270600 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270605 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270609 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270614 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270620 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270627 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270632 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270637 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270642 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270646 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270651 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270656 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270660 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270664 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270668 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270672 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:41.274017 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270676 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270681 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270686 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270690 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270694 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270698 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270702 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270708 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270714 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270719 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270724 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270728 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270733 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270737 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270742 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270746 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270751 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270755 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270759 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270763 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:41.274670 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270768 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270773 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270778 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270781 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270786 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270790 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270794 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270798 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270802 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270806 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270810 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270814 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270818 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270822 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270827 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270831 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270835 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270839 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270843 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270847 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:41.275208 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270851 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270855 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270859 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270863 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270867 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270871 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270875 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270880 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270884 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270888 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270892 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270896 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270901 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270905 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270910 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270914 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270918 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:41.275693 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.270922 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.270930 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271132 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271140 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271145 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271150 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271158 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271164 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271168 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271173 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271177 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271181 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271186 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271190 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 22:20:41.276211 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271194 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271199 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271204 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271208 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271211 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271215 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271220 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271224 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271227 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271231 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271235 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271239 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271243 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271247 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271251 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271255 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271260 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271264 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271269 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271273 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 22:20:41.276556 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271277 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271281 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271285 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271289 2580 feature_gate.go:328] unrecognized feature gate: Example Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271293 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271297 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271301 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271305 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271309 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271313 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271319 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271325 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271329 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271334 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271338 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271342 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271346 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271349 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271353 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271358 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 22:20:41.277188 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271362 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271366 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271371 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271376 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271380 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271384 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271388 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271392 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271397 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271402 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271407 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271413 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271418 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271423 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271427 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271432 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271436 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271441 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271445 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271449 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 22:20:41.277698 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271453 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271457 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271462 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271465 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271469 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271473 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271477 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271481 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271485 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271489 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271493 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271497 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271501 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271505 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271510 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271514 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271519 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271523 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271527 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271531 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 22:20:41.278383 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271535 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271539 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271544 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271548 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271552 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271556 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:41.271560 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.271567 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.271733 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.274405 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.275807 2580 server.go:1019] "Starting client certificate rotation" Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.275906 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.275935 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 22:20:41.279170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.278618 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 22:20:41.280287 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.280269 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 22:20:41.292141 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.292121 2580 log.go:25] "Validated CRI v1 runtime API" Jun 12 22:20:41.295531 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.295515 2580 log.go:25] "Validated CRI v1 image API" Jun 12 22:20:41.296326 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.296311 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 22:20:41.301109 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.301072 2580 fs.go:135] Filesystem UUIDs: map[11d287a6-18e6-4f3a-aead-ed33d97cda19:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cd8a0859-3b56-4f0b-b736-fccc67c20988:/dev/nvme0n1p3] Jun 12 22:20:41.301178 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.301110 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 22:20:41.308977 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.308859 2580 manager.go:216] Machine: {Timestamp:2026-06-12 22:20:41.307423814 +0000 UTC m=+0.345888127 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099798 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2421b3be6077b0a1b077be59d8a4d9 SystemUUID:ec2421b3-be60-77b0-a1b0-77be59d8a4d9 BootID:b76e832f-d3bd-46de-ba5c-533d6703d904 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:16:6e:b9:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:16:6e:b9:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:88:e4:25:dd:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 22:20:41.308977 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.308966 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 22:20:41.309159 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.309047 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 22:20:41.310687 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.310667 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 22:20:41.312197 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.312166 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 22:20:41.312332 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.312200 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-221.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 22:20:41.313462 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.313448 2580 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 22:20:41.313462 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.313464 2580 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 22:20:41.313550 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.313472 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 22:20:41.314224 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.314214 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 22:20:41.315631 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.315621 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 22:20:41.317809 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.317799 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 12 22:20:41.317918 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.317909 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 22:20:41.317951 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.317940 2580 kubelet.go:486] "Attempting to sync node with API server" Jun 12 22:20:41.317951 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.317949 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 22:20:41.318004 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.317961 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 22:20:41.318004 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.317970 2580 kubelet.go:398] "Adding apiserver pod source" Jun 12 22:20:41.318004 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.317978 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 22:20:41.318522 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.318510 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 22:20:41.318564 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.318529 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 22:20:41.326965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.326937 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 22:20:41.328591 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.328575 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 22:20:41.328644 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.328622 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 22:20:41.328839 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.328827 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 22:20:41.328868 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.328849 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 22:20:41.328868 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.328859 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 22:20:41.328922 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.328868 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 22:20:41.328922 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.328880 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 22:20:41.328922 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.328888 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 22:20:41.329385 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.329373 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 22:20:41.329417 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.329387 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 22:20:41.329417 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.329395 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 22:20:41.329417 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.329400 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 22:20:41.329417 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.329408 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 22:20:41.329417 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.329416 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 22:20:41.330192 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.330181 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 22:20:41.330223 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.330195 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 22:20:41.330539 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.330523 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dwcbn" Jun 12 22:20:41.331541 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.331526 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-221.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 22:20:41.331961 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.331933 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 22:20:41.332057 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.331935 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-221.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 22:20:41.333606 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.333595 2580 server.go:1268] "Started kubelet" Jun 12 22:20:41.333709 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.333658 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 22:20:41.333764 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.333726 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 22:20:41.333930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.333907 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 22:20:41.334176 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.334160 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 22:20:41.334507 ip-10-0-128-221 systemd[1]: Started Kubernetes Kubelet. Jun 12 22:20:41.336387 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.336373 2580 server.go:310] "Adding debug handlers to kubelet server" Jun 12 22:20:41.337978 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.337961 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dwcbn" Jun 12 22:20:41.339324 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.338389 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-221.ec2.internal.18b8757f1714cecf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-221.ec2.internal,UID:ip-10-0-128-221.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-221.ec2.internal,},FirstTimestamp:2026-06-12 22:20:41.333567183 +0000 UTC m=+0.372031496,LastTimestamp:2026-06-12 22:20:41.333567183 +0000 UTC m=+0.372031496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-221.ec2.internal,}" Jun 12 22:20:41.341077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.341061 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 22:20:41.341077 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.341095 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 22:20:41.341238 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.341108 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 22:20:41.341944 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.341917 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 22:20:41.342031 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.341951 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 22:20:41.342127 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.342110 2580 reconstruct.go:97] "Volume reconstruction finished" Jun 12 22:20:41.342127 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.342126 2580 reconciler.go:29] "Reconciler: start to sync state" Jun 12 22:20:41.342381 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.342355 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 22:20:41.342512 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.341179 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:41.343345 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.343324 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 22:20:41.343415 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.343347 2580 factory.go:55] Registering systemd factory Jun 12 22:20:41.343415 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.343357 2580 factory.go:223] Registration of the systemd container factory successfully Jun 12 22:20:41.343654 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.343635 2580 factory.go:153] Registering CRI-O factory Jun 12 22:20:41.343707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.343658 2580 factory.go:223] Registration of the crio container factory successfully Jun 12 22:20:41.343707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.343692 2580 factory.go:103] Registering Raw factory Jun 12 22:20:41.343796 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.343708 2580 manager.go:1196] Started watching for new ooms in manager Jun 12 22:20:41.344034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.344019 2580 manager.go:349] Starting recovery of all containers Jun 12 22:20:41.352016 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.351854 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:41.354758 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.354738 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-221.ec2.internal\" not found" node="ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.355716 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.355699 2580 manager.go:354] Recovery completed Jun 12 22:20:41.359762 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.359750 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:41.361668 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.361654 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:41.361747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.361685 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:41.361747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.361700 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:41.362302 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.362285 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 22:20:41.362302 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.362301 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:41.362434 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.362302 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 22:20:41.362434 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.362365 2580 state_mem.go:36] "Initialized new in-memory state store" Jun 12 22:20:41.363119 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.363103 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:41.363169 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.363130 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:41.363169 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.363144 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:41.363807 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.363797 2580 policy_none.go:49] "None policy: Start" Jun 12 22:20:41.363839 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.363812 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 22:20:41.363839 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.363822 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 22:20:41.365188 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.365178 2580 policy_none.go:47] "Start" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.408765 2580 manager.go:337] "Starting Device Plugin manager" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.408795 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.408806 2580 server.go:87] "Starting device plugin registration server" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.409068 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.409105 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.409203 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.409330 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.409360 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.410701 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.410767 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.410831 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.412162 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.412195 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.412213 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.412246 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 22:20:41.421394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.413890 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:41.509875 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.509804 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:41.511044 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.511027 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:41.511142 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.511058 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:41.511142 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.511070 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:41.511142 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.511117 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.513123 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.513104 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal"] Jun 12 22:20:41.513172 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.513166 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:41.513898 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.513870 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:41.513898 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.513900 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:41.514053 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.513913 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:41.515416 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.515401 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:41.515543 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.515516 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.515594 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.515563 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:41.516187 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.516165 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:41.516292 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.516197 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:41.516292 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.516216 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:41.516397 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.516365 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:41.516397 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.516388 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:41.516397 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.516396 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:41.516629 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.516610 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.516708 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.516635 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-221.ec2.internal\": node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:41.518343 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.518328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.518388 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.518354 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 22:20:41.519027 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.519011 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientMemory" Jun 12 22:20:41.519077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.519037 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 22:20:41.519077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.519051 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeHasSufficientPID" Jun 12 22:20:41.528100 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.528060 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:41.540704 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.540687 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-221.ec2.internal\" not found" node="ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.542871 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.542853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681d4000327555c93d28c16e1fd25031-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"681d4000327555c93d28c16e1fd25031\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.542957 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.542877 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5598ad4d5a1007a22c59d161c2879d66-config\") pod \"kube-apiserver-proxy-ip-10-0-128-221.ec2.internal\" (UID: \"5598ad4d5a1007a22c59d161c2879d66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.542957 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.542895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/681d4000327555c93d28c16e1fd25031-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"681d4000327555c93d28c16e1fd25031\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.545159 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.545145 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-221.ec2.internal\" not found" node="ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.628405 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.628376 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:41.643140 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.643114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/681d4000327555c93d28c16e1fd25031-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"681d4000327555c93d28c16e1fd25031\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.643206 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.643146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681d4000327555c93d28c16e1fd25031-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"681d4000327555c93d28c16e1fd25031\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.643206 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.643163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5598ad4d5a1007a22c59d161c2879d66-config\") pod \"kube-apiserver-proxy-ip-10-0-128-221.ec2.internal\" (UID: \"5598ad4d5a1007a22c59d161c2879d66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.643206 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.643198 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5598ad4d5a1007a22c59d161c2879d66-config\") pod \"kube-apiserver-proxy-ip-10-0-128-221.ec2.internal\" (UID: \"5598ad4d5a1007a22c59d161c2879d66\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.643291 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.643216 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/681d4000327555c93d28c16e1fd25031-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"681d4000327555c93d28c16e1fd25031\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.643291 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.643220 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681d4000327555c93d28c16e1fd25031-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal\" (UID: \"681d4000327555c93d28c16e1fd25031\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.729236 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.729204 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:41.829896 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.829840 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:41.843020 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.842997 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.849147 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:41.849122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" Jun 12 22:20:41.930217 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:41.930170 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:42.030684 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:42.030655 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:42.131214 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:42.131128 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:42.231688 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:42.231666 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:42.247693 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.247666 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:42.276129 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.276097 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 22:20:42.276784 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.276293 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 22:20:42.276784 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.276300 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 22:20:42.276784 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.276293 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 22:20:42.320687 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:42.320632 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5598ad4d5a1007a22c59d161c2879d66.slice/crio-b41590fde20598f17c544d9f6770c9e666e5c7be6f65da442bcd2e35e2528f6c WatchSource:0}: Error finding container b41590fde20598f17c544d9f6770c9e666e5c7be6f65da442bcd2e35e2528f6c: Status 404 returned error can't find the container with id b41590fde20598f17c544d9f6770c9e666e5c7be6f65da442bcd2e35e2528f6c Jun 12 22:20:42.320982 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:42.320949 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681d4000327555c93d28c16e1fd25031.slice/crio-f0a6f1debb0f1b97e7b1c77febed89ab1c4909ebd2d798f1d8973718366c94db WatchSource:0}: Error finding container f0a6f1debb0f1b97e7b1c77febed89ab1c4909ebd2d798f1d8973718366c94db: Status 404 returned error can't find the container with id f0a6f1debb0f1b97e7b1c77febed89ab1c4909ebd2d798f1d8973718366c94db Jun 12 22:20:42.325558 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.325538 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:20:42.332278 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:42.332254 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-221.ec2.internal\" not found" Jun 12 22:20:42.342218 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.342186 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 22:15:41 +0000 UTC" deadline="2027-12-29 21:08:54.626975006 +0000 UTC" Jun 12 22:20:42.342218 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.342217 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13558h48m12.284763078s" Jun 12 22:20:42.354068 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.354050 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:42.415814 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.415708 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" event={"ID":"681d4000327555c93d28c16e1fd25031","Type":"ContainerStarted","Data":"f0a6f1debb0f1b97e7b1c77febed89ab1c4909ebd2d798f1d8973718366c94db"} Jun 12 22:20:42.416758 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.416739 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" event={"ID":"5598ad4d5a1007a22c59d161c2879d66","Type":"ContainerStarted","Data":"b41590fde20598f17c544d9f6770c9e666e5c7be6f65da442bcd2e35e2528f6c"} Jun 12 22:20:42.442911 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.442882 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" Jun 12 22:20:42.454770 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.454747 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 22:20:42.455783 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.455768 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" Jun 12 22:20:42.462224 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:42.462207 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 22:20:43.319327 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.319289 2580 apiserver.go:52] "Watching apiserver" Jun 12 22:20:43.327283 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.327251 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 22:20:43.328640 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.328612 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-76jj7","kube-system/konnectivity-agent-g6xfl","openshift-cluster-node-tuning-operator/tuned-9lhxv","openshift-dns/node-resolver-7t2mm","openshift-image-registry/node-ca-wrk8m","openshift-multus/multus-2dpb9","openshift-multus/multus-additional-cni-plugins-bw7dc","openshift-multus/network-metrics-daemon-gh5x7","kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal","openshift-network-diagnostics/network-check-target-2dwq2","openshift-network-operator/iptables-alerter-gz69s","openshift-ovn-kubernetes/ovnkube-node-lz2xp"] Jun 12 22:20:43.330056 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.330034 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.331161 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.331143 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.332372 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.332353 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.333722 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.333236 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 22:20:43.333722 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.333257 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 22:20:43.333722 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.333282 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 22:20:43.333722 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.333351 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 22:20:43.333722 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.333260 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wfltn\"" Jun 12 22:20:43.333994 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.333841 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 22:20:43.335190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.334054 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 22:20:43.335190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.334063 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 22:20:43.335190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.334099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:20:43.335190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.334127 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ckl4k\"" Jun 12 22:20:43.335190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.334886 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:20:43.335190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.334986 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 22:20:43.335190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.335150 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zbr9t\"" Jun 12 22:20:43.336185 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.336169 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.338294 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.338242 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 22:20:43.338557 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.338540 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8vbzj\"" Jun 12 22:20:43.338642 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.338608 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 22:20:43.338693 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.338653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.339836 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.339818 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.340906 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.340877 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 22:20:43.341003 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.340994 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jk4dq\"" Jun 12 22:20:43.341066 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.341007 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 22:20:43.341066 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.341009 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 22:20:43.341204 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.341179 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.342313 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.341400 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 22:20:43.342313 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.341948 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 22:20:43.342313 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.342171 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p2wxv\"" Jun 12 22:20:43.342625 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.342610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.342708 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.342691 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:20:43.343470 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.343421 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 22:20:43.343558 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.343549 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v4wrp\"" Jun 12 22:20:43.343625 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.343558 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 22:20:43.343796 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.343776 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 22:20:43.344045 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.343944 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 22:20:43.344045 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.343999 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 22:20:43.344249 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.344155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:20:43.344875 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.344859 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 22:20:43.345536 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.345513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.346803 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.346430 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7g8pn\"" Jun 12 22:20:43.346803 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.346443 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 22:20:43.346803 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.346679 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 22:20:43.346971 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.346874 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:43.346971 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.346939 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:43.348307 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.348286 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 22:20:43.348385 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.348354 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 22:20:43.348482 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.348466 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:43.348547 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.348529 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:43.348640 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.348625 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 22:20:43.348704 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.348692 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5zvl2\"" Jun 12 22:20:43.350172 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-systemd-units\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.350297 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.350376 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350310 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4848a91d-a18e-4a5f-b442-9b83cc312149-host-slash\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.350376 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350333 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-sys\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.350376 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/664473fe-50b2-4925-8b62-0ff1dcd99c0e-cni-binary-copy\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.350540 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-cni-bin\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.350593 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350542 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-cni-multus\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.350664 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350627 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysctl-conf\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.350714 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-cni-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.350714 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.350802 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-dbus\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.350802 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350747 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.350802 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350769 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-tmp-dir\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.350935 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-etc-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.350935 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-log-socket\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.350935 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x9kp\" (UniqueName: \"kubernetes.io/projected/57f9117b-34be-450d-844f-25131262e963-kube-api-access-6x9kp\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.350935 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-run\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.350935 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-hosts-file\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.350935 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-hostroot\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.351203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wqmv\" (UniqueName: \"kubernetes.io/projected/664473fe-50b2-4925-8b62-0ff1dcd99c0e-kube-api-access-2wqmv\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.351203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350967 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-systemd\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.351203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.350994 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57f9117b-34be-450d-844f-25131262e963-ovn-node-metrics-cert\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.351203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4ng\" (UniqueName: \"kubernetes.io/projected/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-kube-api-access-dh4ng\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.351203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-kubelet-config\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.351203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-lib-modules\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.351203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351175 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-os-release\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.351444 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-netns\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.351444 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351237 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-kubelet\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.351444 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-modprobe-d\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.351444 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351291 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysconfig\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.351731 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-conf-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.351779 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-run-netns\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.351779 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.351869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.351869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351793 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-systemd\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.351869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-node-log\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.351869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-cni-netd\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.351869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-ovnkube-config\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.351869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-os-release\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.351869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd4cg\" (UniqueName: \"kubernetes.io/projected/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-kube-api-access-qd4cg\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-slash\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-system-cni-dir\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4848a91d-a18e-4a5f-b442-9b83cc312149-iptables-alerter-script\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f546eac-f83b-4fbe-972b-f4244b271180-serviceca\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.351967 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-var-lib-kubelet\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjf2\" (UniqueName: \"kubernetes.io/projected/8f546eac-f83b-4fbe-972b-f4244b271180-kube-api-access-2xjf2\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352031 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-cni-bin\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352048 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysctl-d\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-k8s-cni-cncf-io\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352155 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-kubelet\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.352203 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-etc-kubernetes\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-ovnkube-script-lib\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352348 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dk4s\" (UniqueName: \"kubernetes.io/projected/19652aea-165b-4ace-9658-15cb0c5a27ba-kube-api-access-8dk4s\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-system-cni-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cnibin\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352429 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-cnibin\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-multus-certs\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njjzz\" (UniqueName: \"kubernetes.io/projected/4848a91d-a18e-4a5f-b442-9b83cc312149-kube-api-access-njjzz\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f546eac-f83b-4fbe-972b-f4244b271180-host\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-host\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-var-lib-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-env-overrides\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-daemon-config\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-ovn\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.352748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352660 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-run-ovn-kubernetes\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.353426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-kubernetes\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.353426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-tuned\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.353426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19652aea-165b-4ace-9658-15cb0c5a27ba-tmp\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.353426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.352792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-socket-dir-parent\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.358839 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.358819 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:43.372154 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.372054 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wk4qc" Jun 12 22:20:43.377733 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.377708 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wk4qc" Jun 12 22:20:43.443266 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.443240 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 22:20:43.453941 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.453905 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-kubelet-config\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.453941 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.453941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-lib-modules\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.453958 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-os-release\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.453980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-netns\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454005 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-kubelet\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfvw9\" (UniqueName: \"kubernetes.io/projected/24770af3-9076-4063-a1db-8d3a51ca2821-kube-api-access-wfvw9\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454031 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-kubelet-config\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-modprobe-d\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454103 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysconfig\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454108 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-lib-modules\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-conf-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-modprobe-d\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-run-netns\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454163 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-netns\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.454186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454212 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-os-release\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454217 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-kubelet\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-device-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-systemd\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-node-log\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-cni-netd\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-ovnkube-config\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.454823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454376 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-os-release\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454847 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cni-binary-copy\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454856 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-ovnkube-config\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454923 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-conf-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.454969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysconfig\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455061 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-os-release\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-etc-selinux\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455143 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-node-log\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455157 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-cni-netd\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455169 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-run-netns\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd4cg\" (UniqueName: \"kubernetes.io/projected/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-kube-api-access-qd4cg\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455197 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-systemd\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455244 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.455301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-slash\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-system-cni-dir\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455379 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-slash\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4848a91d-a18e-4a5f-b442-9b83cc312149-iptables-alerter-script\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455386 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-system-cni-dir\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f546eac-f83b-4fbe-972b-f4244b271180-serviceca\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-var-lib-kubelet\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455501 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjf2\" (UniqueName: \"kubernetes.io/projected/8f546eac-f83b-4fbe-972b-f4244b271180-kube-api-access-2xjf2\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-socket-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455554 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-registration-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455565 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-var-lib-kubelet\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455578 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-cni-bin\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysctl-d\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-k8s-cni-cncf-io\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-kubelet\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-etc-kubernetes\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455723 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysctl-d\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.455961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455627 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-cni-bin\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455764 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-k8s-cni-cncf-io\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-ovnkube-script-lib\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455796 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-etc-kubernetes\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg77q\" (UniqueName: \"kubernetes.io/projected/d274c226-9653-45b2-b20c-0eae6c5650da-kube-api-access-kg77q\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455845 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-kubelet\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dk4s\" (UniqueName: \"kubernetes.io/projected/19652aea-165b-4ace-9658-15cb0c5a27ba-kube-api-access-8dk4s\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455842 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455851 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f546eac-f83b-4fbe-972b-f4244b271180-serviceca\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-system-cni-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.455937 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4848a91d-a18e-4a5f-b442-9b83cc312149-iptables-alerter-script\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cnibin\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456022 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-system-cni-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-cnibin\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456075 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cnibin\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-multus-certs\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456194 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-cnibin\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.456661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456250 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-run-multus-certs\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njjzz\" (UniqueName: \"kubernetes.io/projected/4848a91d-a18e-4a5f-b442-9b83cc312149-kube-api-access-njjzz\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456304 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f546eac-f83b-4fbe-972b-f4244b271180-host\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456342 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-ovnkube-script-lib\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456383 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f546eac-f83b-4fbe-972b-f4244b271180-host\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44992e20-2fba-4d83-9580-9cb92530c93e-agent-certs\") pod \"konnectivity-agent-g6xfl\" (UID: \"44992e20-2fba-4d83-9580-9cb92530c93e\") " pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44992e20-2fba-4d83-9580-9cb92530c93e-konnectivity-ca\") pod \"konnectivity-agent-g6xfl\" (UID: \"44992e20-2fba-4d83-9580-9cb92530c93e\") " pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-host\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456558 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-var-lib-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-env-overrides\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-daemon-config\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456612 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-host\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-ovn\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456630 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-var-lib-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.457555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456656 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-run-ovn-kubernetes\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456665 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-ovn\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-kubernetes\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456702 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-tuned\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19652aea-165b-4ace-9658-15cb0c5a27ba-tmp\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456704 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-host-run-ovn-kubernetes\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456764 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-kubernetes\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-socket-dir-parent\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456795 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-socket-dir-parent\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-systemd-units\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4848a91d-a18e-4a5f-b442-9b83cc312149-host-slash\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-sys-fs\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456923 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-sys\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/664473fe-50b2-4925-8b62-0ff1dcd99c0e-cni-binary-copy\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456965 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/57f9117b-34be-450d-844f-25131262e963-env-overrides\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456970 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-cni-bin\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456986 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-systemd-units\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.458392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.456996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-cni-multus\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysctl-conf\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457025 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4848a91d-a18e-4a5f-b442-9b83cc312149-host-slash\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457041 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457049 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457058 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-sys\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-cni-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457126 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-daemon-config\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457125 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-multus-cni-dir\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457127 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457167 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-cni-multus\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457124 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-host-var-lib-cni-bin\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457183 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457195 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-sysctl-conf\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-dbus\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457239 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-tmp-dir\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-etc-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.459441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457282 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-log-socket\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457304 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x9kp\" (UniqueName: \"kubernetes.io/projected/57f9117b-34be-450d-844f-25131262e963-kube-api-access-6x9kp\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.457318 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-run\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457350 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-log-socket\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-hosts-file\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457396 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-etc-openvswitch\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.457410 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret podName:3d1d3c0a-52a9-41fc-9da6-709a48ff47af nodeName:}" failed. No retries permitted until 2026-06-12 22:20:43.957372122 +0000 UTC m=+2.995836427 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret") pod "global-pull-secret-syncer-76jj7" (UID: "3d1d3c0a-52a9-41fc-9da6-709a48ff47af") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-hostroot\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457439 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-hosts-file\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457449 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wqmv\" (UniqueName: \"kubernetes.io/projected/664473fe-50b2-4925-8b62-0ff1dcd99c0e-kube-api-access-2wqmv\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457315 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-dbus\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457450 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/664473fe-50b2-4925-8b62-0ff1dcd99c0e-cni-binary-copy\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457508 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/664473fe-50b2-4925-8b62-0ff1dcd99c0e-hostroot\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457556 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19652aea-165b-4ace-9658-15cb0c5a27ba-run\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457566 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457579 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-tmp-dir\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457618 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-systemd\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.460295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/57f9117b-34be-450d-844f-25131262e963-run-systemd\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.460792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57f9117b-34be-450d-844f-25131262e963-ovn-node-metrics-cert\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.460792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.457690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4ng\" (UniqueName: \"kubernetes.io/projected/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-kube-api-access-dh4ng\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.460792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.460407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19652aea-165b-4ace-9658-15cb0c5a27ba-etc-tuned\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.460792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.460434 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/57f9117b-34be-450d-844f-25131262e963-ovn-node-metrics-cert\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.460792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.460458 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19652aea-165b-4ace-9658-15cb0c5a27ba-tmp\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.463886 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.463861 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dk4s\" (UniqueName: \"kubernetes.io/projected/19652aea-165b-4ace-9658-15cb0c5a27ba-kube-api-access-8dk4s\") pod \"tuned-9lhxv\" (UID: \"19652aea-165b-4ace-9658-15cb0c5a27ba\") " pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.465297 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.465270 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjf2\" (UniqueName: \"kubernetes.io/projected/8f546eac-f83b-4fbe-972b-f4244b271180-kube-api-access-2xjf2\") pod \"node-ca-wrk8m\" (UID: \"8f546eac-f83b-4fbe-972b-f4244b271180\") " pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.465297 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.465282 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd4cg\" (UniqueName: \"kubernetes.io/projected/24ae138a-81a1-4c68-ad2b-2f0af46a67fa-kube-api-access-qd4cg\") pod \"node-resolver-7t2mm\" (UID: \"24ae138a-81a1-4c68-ad2b-2f0af46a67fa\") " pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.465430 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.465294 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njjzz\" (UniqueName: \"kubernetes.io/projected/4848a91d-a18e-4a5f-b442-9b83cc312149-kube-api-access-njjzz\") pod \"iptables-alerter-gz69s\" (UID: \"4848a91d-a18e-4a5f-b442-9b83cc312149\") " pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.466725 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.466702 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4ng\" (UniqueName: \"kubernetes.io/projected/c0b96b2f-9632-46cd-9267-ea256d6f9f2c-kube-api-access-dh4ng\") pod \"multus-additional-cni-plugins-bw7dc\" (UID: \"c0b96b2f-9632-46cd-9267-ea256d6f9f2c\") " pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.466886 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.466866 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x9kp\" (UniqueName: \"kubernetes.io/projected/57f9117b-34be-450d-844f-25131262e963-kube-api-access-6x9kp\") pod \"ovnkube-node-lz2xp\" (UID: \"57f9117b-34be-450d-844f-25131262e963\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.467243 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.467221 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wqmv\" (UniqueName: \"kubernetes.io/projected/664473fe-50b2-4925-8b62-0ff1dcd99c0e-kube-api-access-2wqmv\") pod \"multus-2dpb9\" (UID: \"664473fe-50b2-4925-8b62-0ff1dcd99c0e\") " pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.558284 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44992e20-2fba-4d83-9580-9cb92530c93e-agent-certs\") pod \"konnectivity-agent-g6xfl\" (UID: \"44992e20-2fba-4d83-9580-9cb92530c93e\") " pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:20:43.558458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558293 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44992e20-2fba-4d83-9580-9cb92530c93e-konnectivity-ca\") pod \"konnectivity-agent-g6xfl\" (UID: \"44992e20-2fba-4d83-9580-9cb92530c93e\") " pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:20:43.558458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.558458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-sys-fs\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.558458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:43.558458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558417 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-kubelet-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.558697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfvw9\" (UniqueName: \"kubernetes.io/projected/24770af3-9076-4063-a1db-8d3a51ca2821-kube-api-access-wfvw9\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.558697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-device-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.558697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558557 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-etc-selinux\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.558697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:43.558697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558609 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-socket-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.558697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-registration-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.558697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg77q\" (UniqueName: \"kubernetes.io/projected/d274c226-9653-45b2-b20c-0eae6c5650da-kube-api-access-kg77q\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:43.559077 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.558735 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:43.559077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558780 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-etc-selinux\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.559077 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.558789 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs podName:d274c226-9653-45b2-b20c-0eae6c5650da nodeName:}" failed. No retries permitted until 2026-06-12 22:20:44.058770613 +0000 UTC m=+3.097234915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs") pod "network-metrics-daemon-gh5x7" (UID: "d274c226-9653-45b2-b20c-0eae6c5650da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:43.559077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558838 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-sys-fs\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.559077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558841 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-socket-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.559077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558918 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-registration-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.559077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558942 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44992e20-2fba-4d83-9580-9cb92530c93e-konnectivity-ca\") pod \"konnectivity-agent-g6xfl\" (UID: \"44992e20-2fba-4d83-9580-9cb92530c93e\") " pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:20:43.559077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.558983 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24770af3-9076-4063-a1db-8d3a51ca2821-device-dir\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.560982 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.560957 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44992e20-2fba-4d83-9580-9cb92530c93e-agent-certs\") pod \"konnectivity-agent-g6xfl\" (UID: \"44992e20-2fba-4d83-9580-9cb92530c93e\") " pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:20:43.564746 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.564726 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:43.564746 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.564749 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:43.564945 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.564763 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j488k for pod openshift-network-diagnostics/network-check-target-2dwq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:43.564945 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.564833 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k podName:aa5a7593-0ab7-4dcb-9f2b-dee55c287409 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:44.064815955 +0000 UTC m=+3.103280254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j488k" (UniqueName: "kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k") pod "network-check-target-2dwq2" (UID: "aa5a7593-0ab7-4dcb-9f2b-dee55c287409") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:43.567439 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.567412 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfvw9\" (UniqueName: \"kubernetes.io/projected/24770af3-9076-4063-a1db-8d3a51ca2821-kube-api-access-wfvw9\") pod \"aws-ebs-csi-driver-node-swj75\" (UID: \"24770af3-9076-4063-a1db-8d3a51ca2821\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.570618 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.570560 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg77q\" (UniqueName: \"kubernetes.io/projected/d274c226-9653-45b2-b20c-0eae6c5650da-kube-api-access-kg77q\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:43.575299 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.575277 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:43.644497 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.644460 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" Jun 12 22:20:43.651599 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.651577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gz69s" Jun 12 22:20:43.658666 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.658639 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" Jun 12 22:20:43.664692 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.664673 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7t2mm" Jun 12 22:20:43.671773 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.671753 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrk8m" Jun 12 22:20:43.681769 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.681748 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2dpb9" Jun 12 22:20:43.689903 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.689882 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:20:43.696985 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.696962 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:20:43.703150 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.703130 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" Jun 12 22:20:43.961945 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:43.961873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:43.962101 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.962020 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:43.962155 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:43.962106 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret podName:3d1d3c0a-52a9-41fc-9da6-709a48ff47af nodeName:}" failed. No retries permitted until 2026-06-12 22:20:44.962072172 +0000 UTC m=+4.000536470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret") pod "global-pull-secret-syncer-76jj7" (UID: "3d1d3c0a-52a9-41fc-9da6-709a48ff47af") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:44.062300 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.062269 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:44.062434 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.062414 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:44.062488 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.062479 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs podName:d274c226-9653-45b2-b20c-0eae6c5650da nodeName:}" failed. No retries permitted until 2026-06-12 22:20:45.062461167 +0000 UTC m=+4.100925466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs") pod "network-metrics-daemon-gh5x7" (UID: "d274c226-9653-45b2-b20c-0eae6c5650da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:44.101584 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.101559 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ae138a_81a1_4c68_ad2b_2f0af46a67fa.slice/crio-17482361b6b7bcbd5f9f583ed9f5648e0cb9a4b09bfd06314b6817e29f3ce1ef WatchSource:0}: Error finding container 17482361b6b7bcbd5f9f583ed9f5648e0cb9a4b09bfd06314b6817e29f3ce1ef: Status 404 returned error can't find the container with id 17482361b6b7bcbd5f9f583ed9f5648e0cb9a4b09bfd06314b6817e29f3ce1ef Jun 12 22:20:44.102258 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.102234 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b96b2f_9632_46cd_9267_ea256d6f9f2c.slice/crio-fdaabc3958f6e823df607421cf9b41deecaa926b3456dfd30d6c2ba1739682b2 WatchSource:0}: Error finding container fdaabc3958f6e823df607421cf9b41deecaa926b3456dfd30d6c2ba1739682b2: Status 404 returned error can't find the container with id fdaabc3958f6e823df607421cf9b41deecaa926b3456dfd30d6c2ba1739682b2 Jun 12 22:20:44.103151 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.103134 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19652aea_165b_4ace_9658_15cb0c5a27ba.slice/crio-c71c1271ad84335f700e6f7e2419a8058c65027171f970a2f3507e096ce519c2 WatchSource:0}: Error finding container c71c1271ad84335f700e6f7e2419a8058c65027171f970a2f3507e096ce519c2: Status 404 returned error can't find the container with id c71c1271ad84335f700e6f7e2419a8058c65027171f970a2f3507e096ce519c2 Jun 12 22:20:44.123695 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.123668 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f546eac_f83b_4fbe_972b_f4244b271180.slice/crio-7cfbf24face285e5d978428319330fec5375c40f9bf5783aa425c28aebfd7fcc WatchSource:0}: Error finding container 7cfbf24face285e5d978428319330fec5375c40f9bf5783aa425c28aebfd7fcc: Status 404 returned error can't find the container with id 7cfbf24face285e5d978428319330fec5375c40f9bf5783aa425c28aebfd7fcc Jun 12 22:20:44.125099 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.125050 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f9117b_34be_450d_844f_25131262e963.slice/crio-a1835e61240af55cde2c96e9ebb84e5a81123216888e91fa245fed3583e5a652 WatchSource:0}: Error finding container a1835e61240af55cde2c96e9ebb84e5a81123216888e91fa245fed3583e5a652: Status 404 returned error can't find the container with id a1835e61240af55cde2c96e9ebb84e5a81123216888e91fa245fed3583e5a652 Jun 12 22:20:44.125986 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.125946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod664473fe_50b2_4925_8b62_0ff1dcd99c0e.slice/crio-01d53ca777b3f187b0cb8b3ff26cd6b0dfb78a73f5441619bf76fb69a21529c7 WatchSource:0}: Error finding container 01d53ca777b3f187b0cb8b3ff26cd6b0dfb78a73f5441619bf76fb69a21529c7: Status 404 returned error can't find the container with id 01d53ca777b3f187b0cb8b3ff26cd6b0dfb78a73f5441619bf76fb69a21529c7 Jun 12 22:20:44.127198 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.127104 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4848a91d_a18e_4a5f_b442_9b83cc312149.slice/crio-71bba75a1209e66a234a43f8116e431868a2e398aa180115c901a982e6ce0aab WatchSource:0}: Error finding container 71bba75a1209e66a234a43f8116e431868a2e398aa180115c901a982e6ce0aab: Status 404 returned error can't find the container with id 71bba75a1209e66a234a43f8116e431868a2e398aa180115c901a982e6ce0aab Jun 12 22:20:44.129068 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.128939 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44992e20_2fba_4d83_9580_9cb92530c93e.slice/crio-e1bc476fa89561c66906d1c5051c0b3cbec408bc488b15e350a6d652f9013b6d WatchSource:0}: Error finding container e1bc476fa89561c66906d1c5051c0b3cbec408bc488b15e350a6d652f9013b6d: Status 404 returned error can't find the container with id e1bc476fa89561c66906d1c5051c0b3cbec408bc488b15e350a6d652f9013b6d Jun 12 22:20:44.131535 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:20:44.131513 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24770af3_9076_4063_a1db_8d3a51ca2821.slice/crio-c881081e0f5772e17f78b2c442fb882e75399b314c32c8a82cb0401262274866 WatchSource:0}: Error finding container c881081e0f5772e17f78b2c442fb882e75399b314c32c8a82cb0401262274866: Status 404 returned error can't find the container with id c881081e0f5772e17f78b2c442fb882e75399b314c32c8a82cb0401262274866 Jun 12 22:20:44.162776 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.162604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:44.162864 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.162734 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:44.162864 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.162836 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:44.162864 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.162847 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j488k for pod openshift-network-diagnostics/network-check-target-2dwq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:44.162966 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.162887 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k podName:aa5a7593-0ab7-4dcb-9f2b-dee55c287409 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:45.162874909 +0000 UTC m=+4.201339207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j488k" (UniqueName: "kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k") pod "network-check-target-2dwq2" (UID: "aa5a7593-0ab7-4dcb-9f2b-dee55c287409") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:44.379514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.379462 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 22:15:43 +0000 UTC" deadline="2028-03-30 21:53:07.38053088 +0000 UTC" Jun 12 22:20:44.379514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.379512 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15767h32m23.001022322s" Jun 12 22:20:44.412671 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.412640 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:44.412790 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.412755 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:44.421004 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.420979 2580 generic.go:356] "Generic (PLEG): container finished" podID="681d4000327555c93d28c16e1fd25031" containerID="65980e9c390be0b14bb4afded962e76b2db831f4499827bfcbcb50a861442e27" exitCode=0 Jun 12 22:20:44.421137 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.421045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" event={"ID":"681d4000327555c93d28c16e1fd25031","Type":"ContainerDied","Data":"65980e9c390be0b14bb4afded962e76b2db831f4499827bfcbcb50a861442e27"} Jun 12 22:20:44.422508 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.422481 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" event={"ID":"5598ad4d5a1007a22c59d161c2879d66","Type":"ContainerStarted","Data":"68eb935b6ae8d2091aacdb00ded7fb2c2b7098887c4d767af853e2a27326ca15"} Jun 12 22:20:44.423633 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.423613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"a1835e61240af55cde2c96e9ebb84e5a81123216888e91fa245fed3583e5a652"} Jun 12 22:20:44.424737 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.424710 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" event={"ID":"19652aea-165b-4ace-9658-15cb0c5a27ba","Type":"ContainerStarted","Data":"c71c1271ad84335f700e6f7e2419a8058c65027171f970a2f3507e096ce519c2"} Jun 12 22:20:44.425799 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.425773 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7t2mm" event={"ID":"24ae138a-81a1-4c68-ad2b-2f0af46a67fa","Type":"ContainerStarted","Data":"17482361b6b7bcbd5f9f583ed9f5648e0cb9a4b09bfd06314b6817e29f3ce1ef"} Jun 12 22:20:44.426769 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.426747 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" event={"ID":"24770af3-9076-4063-a1db-8d3a51ca2821","Type":"ContainerStarted","Data":"c881081e0f5772e17f78b2c442fb882e75399b314c32c8a82cb0401262274866"} Jun 12 22:20:44.427727 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.427709 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g6xfl" event={"ID":"44992e20-2fba-4d83-9580-9cb92530c93e","Type":"ContainerStarted","Data":"e1bc476fa89561c66906d1c5051c0b3cbec408bc488b15e350a6d652f9013b6d"} Jun 12 22:20:44.428645 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.428626 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gz69s" event={"ID":"4848a91d-a18e-4a5f-b442-9b83cc312149","Type":"ContainerStarted","Data":"71bba75a1209e66a234a43f8116e431868a2e398aa180115c901a982e6ce0aab"} Jun 12 22:20:44.429663 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.429645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2dpb9" event={"ID":"664473fe-50b2-4925-8b62-0ff1dcd99c0e","Type":"ContainerStarted","Data":"01d53ca777b3f187b0cb8b3ff26cd6b0dfb78a73f5441619bf76fb69a21529c7"} Jun 12 22:20:44.430650 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.430625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrk8m" event={"ID":"8f546eac-f83b-4fbe-972b-f4244b271180","Type":"ContainerStarted","Data":"7cfbf24face285e5d978428319330fec5375c40f9bf5783aa425c28aebfd7fcc"} Jun 12 22:20:44.431643 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.431620 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" event={"ID":"c0b96b2f-9632-46cd-9267-ea256d6f9f2c","Type":"ContainerStarted","Data":"fdaabc3958f6e823df607421cf9b41deecaa926b3456dfd30d6c2ba1739682b2"} Jun 12 22:20:44.449826 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.449772 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-221.ec2.internal" podStartSLOduration=2.449756593 podStartE2EDuration="2.449756593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:44.449291871 +0000 UTC m=+3.487756205" watchObservedRunningTime="2026-06-12 22:20:44.449756593 +0000 UTC m=+3.488220914" Jun 12 22:20:44.865144 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.865038 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 22:20:44.969684 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:44.969124 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:44.969684 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.969294 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:44.969684 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:44.969362 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret podName:3d1d3c0a-52a9-41fc-9da6-709a48ff47af nodeName:}" failed. No retries permitted until 2026-06-12 22:20:46.969344443 +0000 UTC m=+6.007808745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret") pod "global-pull-secret-syncer-76jj7" (UID: "3d1d3c0a-52a9-41fc-9da6-709a48ff47af") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:45.070974 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:45.070430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:45.070974 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:45.070589 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:45.070974 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:45.070653 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs podName:d274c226-9653-45b2-b20c-0eae6c5650da nodeName:}" failed. No retries permitted until 2026-06-12 22:20:47.070634361 +0000 UTC m=+6.109098663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs") pod "network-metrics-daemon-gh5x7" (UID: "d274c226-9653-45b2-b20c-0eae6c5650da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:45.171044 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:45.170953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:45.171244 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:45.171131 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:45.171244 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:45.171150 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:45.171244 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:45.171163 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j488k for pod openshift-network-diagnostics/network-check-target-2dwq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:45.171244 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:45.171223 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k podName:aa5a7593-0ab7-4dcb-9f2b-dee55c287409 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:47.17120322 +0000 UTC m=+6.209667522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j488k" (UniqueName: "kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k") pod "network-check-target-2dwq2" (UID: "aa5a7593-0ab7-4dcb-9f2b-dee55c287409") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:45.379920 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:45.379848 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 22:15:43 +0000 UTC" deadline="2027-11-08 14:37:49.827412894 +0000 UTC" Jun 12 22:20:45.379920 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:45.379889 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12328h17m4.447529286s" Jun 12 22:20:45.414776 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:45.414207 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:45.414776 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:45.414333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:45.415365 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:45.415127 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:45.415365 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:45.415235 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:20:45.442033 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:45.441873 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" event={"ID":"681d4000327555c93d28c16e1fd25031","Type":"ContainerStarted","Data":"ca5de1b16d7fc3cbe47df1fff3da291ff6ae06a6859f344c9b6d53d9099f953b"} Jun 12 22:20:46.412524 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:46.412488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:46.412985 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:46.412630 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:46.997529 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:46.997487 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:46.997729 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:46.997647 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:46.997729 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:46.997715 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret podName:3d1d3c0a-52a9-41fc-9da6-709a48ff47af nodeName:}" failed. No retries permitted until 2026-06-12 22:20:50.997693876 +0000 UTC m=+10.036158178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret") pod "global-pull-secret-syncer-76jj7" (UID: "3d1d3c0a-52a9-41fc-9da6-709a48ff47af") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:47.098236 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:47.098203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:47.098401 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:47.098343 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:47.098401 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:47.098395 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs podName:d274c226-9653-45b2-b20c-0eae6c5650da nodeName:}" failed. No retries permitted until 2026-06-12 22:20:51.098381367 +0000 UTC m=+10.136845666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs") pod "network-metrics-daemon-gh5x7" (UID: "d274c226-9653-45b2-b20c-0eae6c5650da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:47.199120 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:47.199054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:47.199278 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:47.199241 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:47.199278 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:47.199271 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:47.199398 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:47.199286 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j488k for pod openshift-network-diagnostics/network-check-target-2dwq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:47.199398 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:47.199351 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k podName:aa5a7593-0ab7-4dcb-9f2b-dee55c287409 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:51.199330797 +0000 UTC m=+10.237795101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j488k" (UniqueName: "kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k") pod "network-check-target-2dwq2" (UID: "aa5a7593-0ab7-4dcb-9f2b-dee55c287409") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:47.412744 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:47.412654 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:47.413192 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:47.412800 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:47.413192 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:47.412841 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:47.413192 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:47.412919 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:20:48.413037 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:48.412543 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:48.413037 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:48.412684 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:49.414217 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:49.413501 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:49.414217 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:49.413650 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:20:49.414217 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:49.414048 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:49.414217 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:49.414169 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:50.413479 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:50.413444 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:50.413632 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:50.413602 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:51.033753 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:51.033708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:51.034225 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.033855 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:51.034225 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.033933 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret podName:3d1d3c0a-52a9-41fc-9da6-709a48ff47af nodeName:}" failed. No retries permitted until 2026-06-12 22:20:59.033914865 +0000 UTC m=+18.072379169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret") pod "global-pull-secret-syncer-76jj7" (UID: "3d1d3c0a-52a9-41fc-9da6-709a48ff47af") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:51.135161 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:51.135127 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:51.135311 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.135299 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:51.135364 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.135354 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs podName:d274c226-9653-45b2-b20c-0eae6c5650da nodeName:}" failed. No retries permitted until 2026-06-12 22:20:59.135340191 +0000 UTC m=+18.173804490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs") pod "network-metrics-daemon-gh5x7" (UID: "d274c226-9653-45b2-b20c-0eae6c5650da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:51.236103 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:51.236052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:51.236272 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.236228 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:51.236272 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.236254 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:51.236272 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.236265 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j488k for pod openshift-network-diagnostics/network-check-target-2dwq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:51.236398 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.236326 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k podName:aa5a7593-0ab7-4dcb-9f2b-dee55c287409 nodeName:}" failed. No retries permitted until 2026-06-12 22:20:59.236309148 +0000 UTC m=+18.274773468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j488k" (UniqueName: "kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k") pod "network-check-target-2dwq2" (UID: "aa5a7593-0ab7-4dcb-9f2b-dee55c287409") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:51.414807 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:51.414713 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:51.414985 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.414827 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:51.415698 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:51.415503 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:51.415698 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:51.415603 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:20:52.412846 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:52.412758 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:52.413318 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:52.412905 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:53.412992 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:53.412570 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:53.412992 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:53.412570 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:53.412992 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:53.412689 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:20:53.412992 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:53.412740 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:54.412482 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:54.412444 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:54.412645 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:54.412582 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:55.413128 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:55.413025 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:55.413594 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:55.413196 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:55.413594 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:55.413244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:55.413594 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:55.413357 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:20:56.413033 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:56.413001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:56.413245 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:56.413134 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:57.412646 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:57.412606 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:57.412808 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:57.412606 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:57.412808 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:57.412739 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:20:57.412909 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:57.412808 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:58.413212 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:58.413175 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:58.413719 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:58.413333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:20:59.092168 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:59.092131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:59.092331 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.092246 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:59.092331 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.092300 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret podName:3d1d3c0a-52a9-41fc-9da6-709a48ff47af nodeName:}" failed. No retries permitted until 2026-06-12 22:21:15.092287509 +0000 UTC m=+34.130751808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret") pod "global-pull-secret-syncer-76jj7" (UID: "3d1d3c0a-52a9-41fc-9da6-709a48ff47af") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:20:59.192542 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:59.192508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:20:59.192688 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.192667 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:59.192746 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.192737 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs podName:d274c226-9653-45b2-b20c-0eae6c5650da nodeName:}" failed. No retries permitted until 2026-06-12 22:21:15.192719344 +0000 UTC m=+34.231183642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs") pod "network-metrics-daemon-gh5x7" (UID: "d274c226-9653-45b2-b20c-0eae6c5650da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:20:59.293349 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:59.293312 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:59.293538 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.293508 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:20:59.293538 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.293539 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:20:59.293706 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.293552 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j488k for pod openshift-network-diagnostics/network-check-target-2dwq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:59.293706 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.293619 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k podName:aa5a7593-0ab7-4dcb-9f2b-dee55c287409 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:15.293599531 +0000 UTC m=+34.332063842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j488k" (UniqueName: "kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k") pod "network-check-target-2dwq2" (UID: "aa5a7593-0ab7-4dcb-9f2b-dee55c287409") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:20:59.413054 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:59.413018 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:20:59.413252 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:20:59.413072 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:20:59.413252 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.413170 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:20:59.413646 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:20:59.413616 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:00.413047 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:00.413011 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:00.413301 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:00.413144 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:01.413176 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:01.413141 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:01.413339 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:01.413243 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:01.413665 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:01.413356 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:01.413665 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:01.413474 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:02.413306 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:02.413273 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:02.413485 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:02.413413 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:03.413209 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.413183 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:03.413330 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.413183 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:03.413397 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:03.413320 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:03.413397 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:03.413373 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:03.482805 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.482775 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7t2mm" event={"ID":"24ae138a-81a1-4c68-ad2b-2f0af46a67fa","Type":"ContainerStarted","Data":"155f6d7fa0de5c5036b1bdb98a70cf1d1ebe4306faebcac45da3aded41ceaeee"} Jun 12 22:21:03.485583 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.485553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" event={"ID":"24770af3-9076-4063-a1db-8d3a51ca2821","Type":"ContainerStarted","Data":"e17f26317db3d1835fa640096902d3a18275cd62d88742131d5565113ba7359f"} Jun 12 22:21:03.487238 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.487210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g6xfl" event={"ID":"44992e20-2fba-4d83-9580-9cb92530c93e","Type":"ContainerStarted","Data":"1d7e04601a18a6f470f0aae1e38dfeb26c43c529d75a6f250f69d9f4e6be2a9d"} Jun 12 22:21:03.489488 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.489466 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2dpb9" event={"ID":"664473fe-50b2-4925-8b62-0ff1dcd99c0e","Type":"ContainerStarted","Data":"6eb397ceb52a11c60ddef87e01f2e2c3c0c0eaf10d9912d920048f68dbf7b7de"} Jun 12 22:21:03.491566 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.491433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrk8m" event={"ID":"8f546eac-f83b-4fbe-972b-f4244b271180","Type":"ContainerStarted","Data":"cf5004a8b448c117d81733c9ba6b084f84146ec928f5f0e9b76b11ff38b9228f"} Jun 12 22:21:03.492964 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.492936 2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b96b2f-9632-46cd-9267-ea256d6f9f2c" containerID="43f5c40fc3d12f95913619673ba44a03f6db08495ca535590230af0a15b7df35" exitCode=0 Jun 12 22:21:03.493054 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.493029 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" event={"ID":"c0b96b2f-9632-46cd-9267-ea256d6f9f2c","Type":"ContainerDied","Data":"43f5c40fc3d12f95913619673ba44a03f6db08495ca535590230af0a15b7df35"} Jun 12 22:21:03.495682 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.495663 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:21:03.496219 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.496199 2580 generic.go:356] "Generic (PLEG): container finished" podID="57f9117b-34be-450d-844f-25131262e963" containerID="2984ee41e4d43c3d42579e366dc1e1f5cf7aebe9fc0fc67966bce83d690bf7d6" exitCode=1 Jun 12 22:21:03.496324 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.496304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"2cbf7272bdaad3a31be18904e313be3e3883e7c4baed39839db225620c6f2c5a"} Jun 12 22:21:03.496423 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.496380 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerDied","Data":"2984ee41e4d43c3d42579e366dc1e1f5cf7aebe9fc0fc67966bce83d690bf7d6"} Jun 12 22:21:03.496493 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.496435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"db42654d5f8ed364b4974e1eb734c356145aea7503916da8e7eeee86c9991574"} Jun 12 22:21:03.497923 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.497902 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" event={"ID":"19652aea-165b-4ace-9658-15cb0c5a27ba","Type":"ContainerStarted","Data":"dc0c1ae055459f7dbe3afb2db1417dcb0310ca8ef34d78e55f11ca693f310639"} Jun 12 22:21:03.500323 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.500288 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7t2mm" podStartSLOduration=3.663915176 podStartE2EDuration="22.500277634s" totalImagesPullingTime="18.836362458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:03.500073333 +0000 UTC m=+22.538537655" watchObservedRunningTime="2026-06-12 22:21:03.500277634 +0000 UTC m=+22.538741955" Jun 12 22:21:03.500661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.500635 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-221.ec2.internal" podStartSLOduration=21.500628413 podStartE2EDuration="21.500628413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:20:45.461654905 +0000 UTC m=+4.500119228" watchObservedRunningTime="2026-06-12 22:21:03.500628413 +0000 UTC m=+22.539092734" Jun 12 22:21:03.515455 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.515413 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g6xfl" podStartSLOduration=3.736162545 podStartE2EDuration="22.515398172s" totalImagesPullingTime="18.779235627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:03.515058861 +0000 UTC m=+22.553523181" watchObservedRunningTime="2026-06-12 22:21:03.515398172 +0000 UTC m=+22.553862493" Jun 12 22:21:03.557269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.557215 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9lhxv" podStartSLOduration=3.719056784 podStartE2EDuration="22.55719428s" totalImagesPullingTime="18.838137496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:03.55682191 +0000 UTC m=+22.595286232" watchObservedRunningTime="2026-06-12 22:21:03.55719428 +0000 UTC m=+22.595658603" Jun 12 22:21:03.571189 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.571136 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wrk8m" podStartSLOduration=3.738098908 podStartE2EDuration="22.571117325s" totalImagesPullingTime="18.833018417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:03.570899085 +0000 UTC m=+22.609363406" watchObservedRunningTime="2026-06-12 22:21:03.571117325 +0000 UTC m=+22.609581639" Jun 12 22:21:03.590440 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.590368 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2dpb9" podStartSLOduration=3.530603724 podStartE2EDuration="22.590352209s" totalImagesPullingTime="19.059748485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:03.590029693 +0000 UTC m=+22.628494016" watchObservedRunningTime="2026-06-12 22:21:03.590352209 +0000 UTC m=+22.628816539" Jun 12 22:21:03.635428 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.634809 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:03.711367 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.711331 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:03.811773 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:03.811739 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:04.207001 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.206974 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 22:21:04.301929 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.301832 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:04.402157 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.402115 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:04.413129 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.413105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:04.413290 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:04.413249 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:04.421213 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.421114 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T22:21:04.206995268Z","UUID":"a9692e91-5785-4309-937d-6210ef7679a6","Handler":null,"Name":"","Endpoint":""} Jun 12 22:21:04.422823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.422791 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 22:21:04.422949 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.422861 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 22:21:04.502904 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.502864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" event={"ID":"24770af3-9076-4063-a1db-8d3a51ca2821","Type":"ContainerStarted","Data":"cc59218a835fa8e36004b57b777e59029449b2db8fa56f388d9f1ace19cd5c17"} Jun 12 22:21:04.506788 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.506758 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:21:04.507271 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.507228 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"449d861b9e00c42756dcfcb56cac1a8d0ee96ce1a203530015ce4325b4eea014"} Jun 12 22:21:04.507400 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.507313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"d2c7e683373948530ddc56fd16841f1692115e2891f757d03dfe274e65724849"} Jun 12 22:21:04.507400 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:04.507358 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"a3dc631fb6edb3d9b73c7deded8dfa3f884ba117f02eb9589c4a918732ff2caa"} Jun 12 22:21:05.339623 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.339595 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:05.415058 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.415022 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:05.415248 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:05.415158 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:05.415349 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.415314 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:05.415458 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:05.415433 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:05.449986 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.449953 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:05.511836 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.511793 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" event={"ID":"24770af3-9076-4063-a1db-8d3a51ca2821","Type":"ContainerStarted","Data":"873aa22932b1d2bbd6570b2450a935fc924022fbd94ab3de4e596d68aaa398ae"} Jun 12 22:21:05.513514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.513483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gz69s" event={"ID":"4848a91d-a18e-4a5f-b442-9b83cc312149","Type":"ContainerStarted","Data":"f007da32835b0fe41039c80f78943a60a5249ebb8c741fc20ae62470a55c1f99"} Jun 12 22:21:05.529739 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.529672 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-swj75" podStartSLOduration=3.646605794 podStartE2EDuration="24.529653737s" totalImagesPullingTime="20.883047943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:05.529311913 +0000 UTC m=+24.567776234" watchObservedRunningTime="2026-06-12 22:21:05.529653737 +0000 UTC m=+24.568118057" Jun 12 22:21:05.533647 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.533614 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:05.543647 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.543600 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gz69s" podStartSLOduration=5.713521957 podStartE2EDuration="24.543586932s" totalImagesPullingTime="18.830064975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:05.543551917 +0000 UTC m=+24.582016240" watchObservedRunningTime="2026-06-12 22:21:05.543586932 +0000 UTC m=+24.582051252" Jun 12 22:21:05.665661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.665576 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:05.741850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.741680 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:05.919016 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.918922 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:05.981435 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:05.981393 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:06.392710 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:06.392471 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:21:06.393226 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:06.393203 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:21:06.413290 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:06.413261 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:06.413461 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:06.413371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:06.519060 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:06.519028 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:21:06.519515 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:06.519489 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"e752176615b90d46c9fe3dc3c4ea35666a56c85359bbd997b9bb82ee6b6f7caf"} Jun 12 22:21:06.520121 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:06.520100 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:21:06.520521 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:06.520503 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g6xfl" Jun 12 22:21:06.580529 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:06.580500 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:07.413437 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:07.413404 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:07.413632 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:07.413523 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:07.413632 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:07.413577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:07.413759 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:07.413684 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:08.413280 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:08.413110 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:08.414001 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:08.413386 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:08.527808 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:08.527781 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:21:08.528197 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:08.528176 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"64163df45d5365a3eb38541122732993497a4c75ac73b3715e07555d0be2920c"} Jun 12 22:21:08.528389 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:08.528373 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:21:08.528695 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:08.528678 2580 scope.go:117] "RemoveContainer" containerID="2984ee41e4d43c3d42579e366dc1e1f5cf7aebe9fc0fc67966bce83d690bf7d6" Jun 12 22:21:08.530041 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:08.530018 2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b96b2f-9632-46cd-9267-ea256d6f9f2c" containerID="3b8d63dc168f303d03d15121e03fadd86513cd581ebc8c221db1688434cc8309" exitCode=0 Jun 12 22:21:08.530155 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:08.530112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" event={"ID":"c0b96b2f-9632-46cd-9267-ea256d6f9f2c","Type":"ContainerDied","Data":"3b8d63dc168f303d03d15121e03fadd86513cd581ebc8c221db1688434cc8309"} Jun 12 22:21:08.546777 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:08.546757 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:21:09.412803 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.412719 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:09.412947 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:09.412861 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:09.412947 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.412907 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:09.413020 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:09.413003 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:09.535279 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.535240 2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b96b2f-9632-46cd-9267-ea256d6f9f2c" containerID="02c1ef52abb6dc07aba73fd4e58ad584eca65654365b0267954785c8dfffd718" exitCode=0 Jun 12 22:21:09.535677 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.535321 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" event={"ID":"c0b96b2f-9632-46cd-9267-ea256d6f9f2c","Type":"ContainerDied","Data":"02c1ef52abb6dc07aba73fd4e58ad584eca65654365b0267954785c8dfffd718"} Jun 12 22:21:09.539611 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.539592 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:21:09.539958 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.539938 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" event={"ID":"57f9117b-34be-450d-844f-25131262e963","Type":"ContainerStarted","Data":"1b1c092c8576862a30fac5ef7aa37dfcace8ac2f372e09f6736c7a475e7b27b6"} Jun 12 22:21:09.540114 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.540078 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 22:21:09.540363 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.540347 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:21:09.556057 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.556023 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:21:09.580599 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.580552 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" podStartSLOduration=9.714852951 podStartE2EDuration="28.580536866s" totalImagesPullingTime="18.865683915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:09.580135751 +0000 UTC m=+28.618600073" watchObservedRunningTime="2026-06-12 22:21:09.580536866 +0000 UTC m=+28.619001188" Jun 12 22:21:09.804971 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.804918 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:09.871684 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.871649 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:09.931770 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:09.931731 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:10.034521 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.034485 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:10.136295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.135575 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:10.332156 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.332124 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-76jj7"] Jun 12 22:21:10.332302 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.332270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:10.332362 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:10.332346 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:10.334989 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.334951 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh5x7"] Jun 12 22:21:10.335133 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.335118 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:10.335226 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:10.335207 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:10.335939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.335913 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2dwq2"] Jun 12 22:21:10.336028 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.336016 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:10.336151 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:10.336128 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:10.470630 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.470596 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:10.524634 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.524589 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:10.544508 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.544472 2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b96b2f-9632-46cd-9267-ea256d6f9f2c" containerID="47f11ab69e3f919bcd9e212e3b5e4d451548dc37d62b2312f4f40ea5d767a7a1" exitCode=0 Jun 12 22:21:10.544942 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.544561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" event={"ID":"c0b96b2f-9632-46cd-9267-ea256d6f9f2c","Type":"ContainerDied","Data":"47f11ab69e3f919bcd9e212e3b5e4d451548dc37d62b2312f4f40ea5d767a7a1"} Jun 12 22:21:10.544942 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.544661 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 22:21:10.748963 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.748876 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:10.850050 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:10.850012 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:11.413722 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:11.413550 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:11.413905 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:11.413788 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:11.547529 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:11.547497 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 22:21:12.336162 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.334820 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:12.412624 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.412593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:12.412795 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.412636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:12.412795 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:12.412732 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:12.412921 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:12.412871 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:12.413789 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.413758 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:12.505278 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.505224 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:12.711247 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.710346 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:21:12.711247 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.710626 2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 12 22:21:12.731067 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.731026 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" podUID="57f9117b-34be-450d-844f-25131262e963" containerName="ovnkube-controller" probeResult="failure" output="" Jun 12 22:21:12.742628 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:12.742594 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" podUID="57f9117b-34be-450d-844f-25131262e963" containerName="ovnkube-controller" probeResult="failure" output="" Jun 12 22:21:13.412692 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:13.412657 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:13.412844 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:13.412790 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:13.418022 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:13.417996 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:14.146002 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:14.145960 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:14.412567 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:14.412497 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:14.412567 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:14.412538 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:14.412768 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:14.412631 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:14.412818 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:14.412771 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:14.670684 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:14.670605 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:14.777217 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:14.777177 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:14.870283 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:14.870250 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:15.066547 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:15.066516 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:15.130095 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:15.130060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:15.130295 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.130235 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:15.130371 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.130309 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret podName:3d1d3c0a-52a9-41fc-9da6-709a48ff47af nodeName:}" failed. No retries permitted until 2026-06-12 22:21:47.130288471 +0000 UTC m=+66.168752779 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret") pod "global-pull-secret-syncer-76jj7" (UID: "3d1d3c0a-52a9-41fc-9da6-709a48ff47af") : object "kube-system"/"original-pull-secret" not registered Jun 12 22:21:15.231056 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:15.231033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:15.231547 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.231180 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:15.231547 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.231272 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs podName:d274c226-9653-45b2-b20c-0eae6c5650da nodeName:}" failed. No retries permitted until 2026-06-12 22:21:47.231255239 +0000 UTC m=+66.269719538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs") pod "network-metrics-daemon-gh5x7" (UID: "d274c226-9653-45b2-b20c-0eae6c5650da") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 22:21:15.331613 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:15.331585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:15.331780 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.331704 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 22:21:15.331780 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.331718 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 22:21:15.331780 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.331727 2580 projected.go:196] Error preparing data for projected volume kube-api-access-j488k for pod openshift-network-diagnostics/network-check-target-2dwq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:15.331780 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.331772 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k podName:aa5a7593-0ab7-4dcb-9f2b-dee55c287409 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:47.331760343 +0000 UTC m=+66.370224641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j488k" (UniqueName: "kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k") pod "network-check-target-2dwq2" (UID: "aa5a7593-0ab7-4dcb-9f2b-dee55c287409") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 22:21:15.413162 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:15.413131 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:15.413307 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:15.413266 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:15.559999 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:15.559921 2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b96b2f-9632-46cd-9267-ea256d6f9f2c" containerID="56eabf92272a6bae2a47a8bb8660fc51f6850a4bc00d0db8502dad019d0ae12d" exitCode=0 Jun 12 22:21:15.559999 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:15.559967 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" event={"ID":"c0b96b2f-9632-46cd-9267-ea256d6f9f2c","Type":"ContainerDied","Data":"56eabf92272a6bae2a47a8bb8660fc51f6850a4bc00d0db8502dad019d0ae12d"} Jun 12 22:21:16.045294 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.045257 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:16.255151 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.255114 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:16.354068 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.353980 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:16.412919 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.412885 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:16.413075 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:16.413000 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:16.413075 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.413054 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:16.413179 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:16.413161 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:16.454607 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.454569 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:16.565077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.565044 2580 generic.go:356] "Generic (PLEG): container finished" podID="c0b96b2f-9632-46cd-9267-ea256d6f9f2c" containerID="b115bb5a8c84ccf6372090f00065efebec58caba8b6f6d97d15e22ce4dda6142" exitCode=0 Jun 12 22:21:16.565247 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.565135 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" event={"ID":"c0b96b2f-9632-46cd-9267-ea256d6f9f2c","Type":"ContainerDied","Data":"b115bb5a8c84ccf6372090f00065efebec58caba8b6f6d97d15e22ce4dda6142"} Jun 12 22:21:16.860607 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:16.860576 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:17.412641 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:17.412609 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:17.413002 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:17.412722 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:17.441652 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:17.441474 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:17.570677 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:17.570637 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" event={"ID":"c0b96b2f-9632-46cd-9267-ea256d6f9f2c","Type":"ContainerStarted","Data":"e53dfc966ddb9cb14fc47b27afddc4654434e8cf2606516f0829cb631f9eb18e"} Jun 12 22:21:17.847780 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:17.847740 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:17.910249 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:17.910201 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:18.043547 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:18.043508 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:18.412868 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:18.412837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:18.413261 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:18.412837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:18.413261 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:18.412936 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:18.413261 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:18.413010 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:18.438878 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:18.438845 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:18.540541 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:18.540502 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:19.039547 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:19.039352 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:19.140582 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:19.140546 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:19.413496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:19.413420 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:19.413826 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:19.413528 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:19.435569 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:19.435532 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:19.648653 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:19.648617 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:20.262100 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:20.262052 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" limit=1024 Jun 12 22:21:20.413300 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:20.413260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:20.413300 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:20.413286 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:20.413551 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:20.413392 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:20.413551 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:20.413504 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:21.413332 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:21.413295 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:21.413527 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:21.413371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:22.412671 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:22.412636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:22.413117 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:22.412648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:22.413117 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:22.412736 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:22.413117 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:22.412814 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:23.412539 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:23.412504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:23.412688 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:23.412630 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:24.412755 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:24.412711 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:24.413132 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:24.412716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:24.413132 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:24.412842 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:24.413132 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:24.412898 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:25.413373 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:25.413342 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:25.413753 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:25.413439 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:26.412595 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:26.412561 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:26.412780 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:26.412610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:26.412780 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:26.412702 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:26.412903 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:26.412799 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:27.413006 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:27.412967 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:27.413404 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:27.413079 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:28.413101 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:28.413040 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:28.413101 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:28.413104 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:28.413516 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:28.413179 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:28.413516 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:28.413292 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:29.412656 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:29.412623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:29.412863 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:29.412731 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:30.412589 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:30.412552 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:30.412973 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:30.412665 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:30.412973 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:30.412695 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:30.412973 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:30.412741 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:31.413854 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:31.413817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:31.414294 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:31.413904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:32.412414 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:32.412372 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:32.412414 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:32.412389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:32.412663 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:32.412500 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:32.412663 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:32.412614 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:33.413423 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:33.413386 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:33.413878 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:33.413522 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2dwq2" podUID="aa5a7593-0ab7-4dcb-9f2b-dee55c287409" Jun 12 22:21:34.413290 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.413257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:34.413441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.413256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:34.413441 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:34.413375 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-76jj7" podUID="3d1d3c0a-52a9-41fc-9da6-709a48ff47af" Jun 12 22:21:34.413751 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:34.413441 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gh5x7" podUID="d274c226-9653-45b2-b20c-0eae6c5650da" Jun 12 22:21:34.746452 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.746422 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-221.ec2.internal" event="NodeReady" Jun 12 22:21:34.746608 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.746540 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 22:21:34.786145 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.785953 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bw7dc" podStartSLOduration=25.365806682 podStartE2EDuration="53.785933731s" totalImagesPullingTime="28.420127049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:17.599603225 +0000 UTC m=+36.638067547" watchObservedRunningTime="2026-06-12 22:21:34.785933731 +0000 UTC m=+53.824398053" Jun 12 22:21:34.786539 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.786515 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69dd584db6-jtlnk"] Jun 12 22:21:34.789011 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.788994 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.791494 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.791469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 22:21:34.791613 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.791512 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 22:21:34.791613 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.791527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kf9ql\"" Jun 12 22:21:34.791828 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.791813 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 22:21:34.797077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.797057 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 22:21:34.802724 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.802704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69dd584db6-jtlnk"] Jun 12 22:21:34.807267 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.807247 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9s2kj"] Jun 12 22:21:34.809359 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.809344 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-njmqj"] Jun 12 22:21:34.809477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.809462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.811191 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.811170 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njmqj" Jun 12 22:21:34.812063 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.812045 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 22:21:34.812279 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.812267 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6j5nq\"" Jun 12 22:21:34.812336 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.812281 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 22:21:34.813621 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.813604 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 22:21:34.813855 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.813840 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j7ssk\"" Jun 12 22:21:34.813911 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.813842 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 22:21:34.813949 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.813844 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 22:21:34.823555 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.823533 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njmqj"] Jun 12 22:21:34.824157 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.824140 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9s2kj"] Jun 12 22:21:34.866507 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfpcn\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-kube-api-access-sfpcn\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.866507 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/426010f2-435c-4186-ae22-7e4db75fa599-config-volume\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.866713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3da5abd4-9d9b-4288-92bb-4eb5b926d4bd-cert\") pod \"ingress-canary-njmqj\" (UID: \"3da5abd4-9d9b-4288-92bb-4eb5b926d4bd\") " pod="openshift-ingress-canary/ingress-canary-njmqj" Jun 12 22:21:34.866713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-ca-trust-extracted\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.866713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-trusted-ca\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.866713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-registry-tls\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.866713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/426010f2-435c-4186-ae22-7e4db75fa599-metrics-tls\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.866713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rddfn\" (UniqueName: \"kubernetes.io/projected/426010f2-435c-4186-ae22-7e4db75fa599-kube-api-access-rddfn\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.866885 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-image-registry-private-configuration\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.866885 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/426010f2-435c-4186-ae22-7e4db75fa599-tmp-dir\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.866885 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866805 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p459v\" (UniqueName: \"kubernetes.io/projected/3da5abd4-9d9b-4288-92bb-4eb5b926d4bd-kube-api-access-p459v\") pod \"ingress-canary-njmqj\" (UID: \"3da5abd4-9d9b-4288-92bb-4eb5b926d4bd\") " pod="openshift-ingress-canary/ingress-canary-njmqj" Jun 12 22:21:34.866885 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-registry-certificates\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.866885 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866848 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-installation-pull-secrets\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.866885 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.866863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-bound-sa-token\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.967816 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.967782 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p459v\" (UniqueName: \"kubernetes.io/projected/3da5abd4-9d9b-4288-92bb-4eb5b926d4bd-kube-api-access-p459v\") pod \"ingress-canary-njmqj\" (UID: \"3da5abd4-9d9b-4288-92bb-4eb5b926d4bd\") " pod="openshift-ingress-canary/ingress-canary-njmqj" Jun 12 22:21:34.967816 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.967816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-registry-certificates\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.967993 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.967834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-installation-pull-secrets\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.967993 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.967851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-bound-sa-token\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.967993 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.967892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfpcn\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-kube-api-access-sfpcn\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.968158 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/426010f2-435c-4186-ae22-7e4db75fa599-config-volume\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.968158 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3da5abd4-9d9b-4288-92bb-4eb5b926d4bd-cert\") pod \"ingress-canary-njmqj\" (UID: \"3da5abd4-9d9b-4288-92bb-4eb5b926d4bd\") " pod="openshift-ingress-canary/ingress-canary-njmqj" Jun 12 22:21:34.968158 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-ca-trust-extracted\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.968415 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-trusted-ca\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.968477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968413 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-ca-trust-extracted\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.968477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-registry-tls\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.968477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/426010f2-435c-4186-ae22-7e4db75fa599-metrics-tls\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.968621 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rddfn\" (UniqueName: \"kubernetes.io/projected/426010f2-435c-4186-ae22-7e4db75fa599-kube-api-access-rddfn\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.968621 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-image-registry-private-configuration\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.968621 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/426010f2-435c-4186-ae22-7e4db75fa599-tmp-dir\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.968766 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968691 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/426010f2-435c-4186-ae22-7e4db75fa599-config-volume\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.968813 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968799 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-registry-certificates\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.968896 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.968875 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/426010f2-435c-4186-ae22-7e4db75fa599-tmp-dir\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.969736 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.969646 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-trusted-ca\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.972368 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.972347 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-installation-pull-secrets\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.972467 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.972368 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-registry-tls\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.972467 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.972375 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-image-registry-private-configuration\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.972467 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.972384 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3da5abd4-9d9b-4288-92bb-4eb5b926d4bd-cert\") pod \"ingress-canary-njmqj\" (UID: \"3da5abd4-9d9b-4288-92bb-4eb5b926d4bd\") " pod="openshift-ingress-canary/ingress-canary-njmqj" Jun 12 22:21:34.972467 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.972452 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/426010f2-435c-4186-ae22-7e4db75fa599-metrics-tls\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.976621 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.976590 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-bound-sa-token\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:34.977148 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.977120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rddfn\" (UniqueName: \"kubernetes.io/projected/426010f2-435c-4186-ae22-7e4db75fa599-kube-api-access-rddfn\") pod \"dns-default-9s2kj\" (UID: \"426010f2-435c-4186-ae22-7e4db75fa599\") " pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:34.977336 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.977319 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p459v\" (UniqueName: \"kubernetes.io/projected/3da5abd4-9d9b-4288-92bb-4eb5b926d4bd-kube-api-access-p459v\") pod \"ingress-canary-njmqj\" (UID: \"3da5abd4-9d9b-4288-92bb-4eb5b926d4bd\") " pod="openshift-ingress-canary/ingress-canary-njmqj" Jun 12 22:21:34.977680 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:34.977661 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfpcn\" (UniqueName: \"kubernetes.io/projected/b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b-kube-api-access-sfpcn\") pod \"image-registry-69dd584db6-jtlnk\" (UID: \"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b\") " pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:35.098884 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.098779 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:35.118609 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.118577 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:35.123829 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.123796 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njmqj" Jun 12 22:21:35.282262 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.282226 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69dd584db6-jtlnk"] Jun 12 22:21:35.285786 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:35.285750 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71ed0b8_3c40_46dd_9684_eb9ee86c1d6b.slice/crio-99ccc892d17542983a81040bb769bff91aba27c4f9e4d70f28024e7f68117ef8 WatchSource:0}: Error finding container 99ccc892d17542983a81040bb769bff91aba27c4f9e4d70f28024e7f68117ef8: Status 404 returned error can't find the container with id 99ccc892d17542983a81040bb769bff91aba27c4f9e4d70f28024e7f68117ef8 Jun 12 22:21:35.290554 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.290527 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njmqj"] Jun 12 22:21:35.291368 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.291344 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9s2kj"] Jun 12 22:21:35.295949 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:35.295926 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426010f2_435c_4186_ae22_7e4db75fa599.slice/crio-607766d84128c08a50c95e6d9b357ff03a0b60d93e7b3a4390d99a7411c843ce WatchSource:0}: Error finding container 607766d84128c08a50c95e6d9b357ff03a0b60d93e7b3a4390d99a7411c843ce: Status 404 returned error can't find the container with id 607766d84128c08a50c95e6d9b357ff03a0b60d93e7b3a4390d99a7411c843ce Jun 12 22:21:35.296503 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:35.296484 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da5abd4_9d9b_4288_92bb_4eb5b926d4bd.slice/crio-749df645d4abe0addcaa3f1e5b8e23c57cbe176ae7e5dc64f11511b429fac0c9 WatchSource:0}: Error finding container 749df645d4abe0addcaa3f1e5b8e23c57cbe176ae7e5dc64f11511b429fac0c9: Status 404 returned error can't find the container with id 749df645d4abe0addcaa3f1e5b8e23c57cbe176ae7e5dc64f11511b429fac0c9 Jun 12 22:21:35.412714 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.412677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:35.415697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.415673 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chmrs\"" Jun 12 22:21:35.416119 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.415715 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 22:21:35.416119 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.415903 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 22:21:35.611518 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.611434 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" event={"ID":"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b","Type":"ContainerStarted","Data":"c4e30f32d2338cfb29d5bff275972a6b6fc35e190f3c3fba852dbfe6c28f7c03"} Jun 12 22:21:35.611518 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.611511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" event={"ID":"b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b","Type":"ContainerStarted","Data":"99ccc892d17542983a81040bb769bff91aba27c4f9e4d70f28024e7f68117ef8"} Jun 12 22:21:35.611742 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.611538 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:35.612652 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.612625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njmqj" event={"ID":"3da5abd4-9d9b-4288-92bb-4eb5b926d4bd","Type":"ContainerStarted","Data":"749df645d4abe0addcaa3f1e5b8e23c57cbe176ae7e5dc64f11511b429fac0c9"} Jun 12 22:21:35.613821 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.613787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9s2kj" event={"ID":"426010f2-435c-4186-ae22-7e4db75fa599","Type":"ContainerStarted","Data":"607766d84128c08a50c95e6d9b357ff03a0b60d93e7b3a4390d99a7411c843ce"} Jun 12 22:21:35.632392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:35.632343 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" podStartSLOduration=1.632329696 podStartE2EDuration="1.632329696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:35.632050632 +0000 UTC m=+54.670514969" watchObservedRunningTime="2026-06-12 22:21:35.632329696 +0000 UTC m=+54.670794016" Jun 12 22:21:36.412922 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:36.412888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:36.413135 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:36.413110 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:36.417210 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:36.416980 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qtb4q\"" Jun 12 22:21:36.417210 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:36.417026 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 22:21:36.417210 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:36.417044 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 22:21:37.620621 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:37.620520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njmqj" event={"ID":"3da5abd4-9d9b-4288-92bb-4eb5b926d4bd","Type":"ContainerStarted","Data":"f450a1a31bfc85b2f56914c243797e65af1e4c7696b15d386dba71cb3c965776"} Jun 12 22:21:37.622323 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:37.622291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9s2kj" event={"ID":"426010f2-435c-4186-ae22-7e4db75fa599","Type":"ContainerStarted","Data":"d3ad4410954c54f93f8286bf69ca818ff1569f7789ea2b71d44f1cd7c1cfe5c7"} Jun 12 22:21:37.622453 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:37.622343 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9s2kj" event={"ID":"426010f2-435c-4186-ae22-7e4db75fa599","Type":"ContainerStarted","Data":"09658f06ae45ab11a40855a3ee3b5e7889b6c378041314a847d6305e92e448a1"} Jun 12 22:21:37.622453 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:37.622387 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:37.638004 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:37.637964 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-njmqj" podStartSLOduration=1.617351738 podStartE2EDuration="3.637950609s" totalImagesPullingTime="2.020598871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:37.637485121 +0000 UTC m=+56.675949440" watchObservedRunningTime="2026-06-12 22:21:37.637950609 +0000 UTC m=+56.676414929" Jun 12 22:21:37.657530 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:37.657463 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9s2kj" podStartSLOduration=1.637980969 podStartE2EDuration="3.657444357s" totalImagesPullingTime="2.019463388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:37.65676243 +0000 UTC m=+56.695226755" watchObservedRunningTime="2026-06-12 22:21:37.657444357 +0000 UTC m=+56.695908737" Jun 12 22:21:42.741071 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:42.741043 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz2xp" Jun 12 22:21:46.101219 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.101187 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pdgcd"] Jun 12 22:21:46.137406 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.137374 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pdgcd"] Jun 12 22:21:46.137554 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.137484 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.140620 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.140596 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 22:21:46.140761 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.140596 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 22:21:46.140761 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.140600 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 22:21:46.141375 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.141360 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 22:21:46.141684 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.141669 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zdzp6\"" Jun 12 22:21:46.253380 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.253339 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.253380 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.253382 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.253589 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.253489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65e675ef-08b7-4f6b-9fe1-b08637096d7a-crio-socket\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.253589 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.253558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzvr\" (UniqueName: \"kubernetes.io/projected/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-api-access-5hzvr\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.253669 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.253591 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65e675ef-08b7-4f6b-9fe1-b08637096d7a-data-volume\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.354097 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.353996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.354097 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.354031 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.354270 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.354076 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65e675ef-08b7-4f6b-9fe1-b08637096d7a-crio-socket\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.354270 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:46.354143 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:21:46.354270 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.354166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzvr\" (UniqueName: \"kubernetes.io/projected/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-api-access-5hzvr\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.354270 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.354208 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65e675ef-08b7-4f6b-9fe1-b08637096d7a-data-volume\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.354270 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:46.354232 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm podName:65e675ef-08b7-4f6b-9fe1-b08637096d7a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:46.854213049 +0000 UTC m=+65.892677364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pdgcd" (UID: "65e675ef-08b7-4f6b-9fe1-b08637096d7a") : configmap "kube-rbac-proxy" not found Jun 12 22:21:46.354270 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:46.354230 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:21:46.354471 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:46.354304 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls podName:65e675ef-08b7-4f6b-9fe1-b08637096d7a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:46.854286936 +0000 UTC m=+65.892751236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pdgcd" (UID: "65e675ef-08b7-4f6b-9fe1-b08637096d7a") : secret "insights-runtime-extractor-tls" not found Jun 12 22:21:46.354471 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.354394 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65e675ef-08b7-4f6b-9fe1-b08637096d7a-crio-socket\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.354540 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.354497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65e675ef-08b7-4f6b-9fe1-b08637096d7a-data-volume\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.365843 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.365807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzvr\" (UniqueName: \"kubernetes.io/projected/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-api-access-5hzvr\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.684568 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.684469 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9s2kj_426010f2-435c-4186-ae22-7e4db75fa599/dns/0.log" Jun 12 22:21:46.857248 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.857192 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.857248 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.857254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:46.857456 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:46.857324 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 22:21:46.857456 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:46.857390 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm podName:65e675ef-08b7-4f6b-9fe1-b08637096d7a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:47.857374201 +0000 UTC m=+66.895838500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pdgcd" (UID: "65e675ef-08b7-4f6b-9fe1-b08637096d7a") : configmap "kube-rbac-proxy" not found Jun 12 22:21:46.857456 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:46.857422 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:21:46.857610 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:46.857478 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls podName:65e675ef-08b7-4f6b-9fe1-b08637096d7a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:47.857466155 +0000 UTC m=+66.895930453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pdgcd" (UID: "65e675ef-08b7-4f6b-9fe1-b08637096d7a") : secret "insights-runtime-extractor-tls" not found Jun 12 22:21:46.883930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:46.883889 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9s2kj_426010f2-435c-4186-ae22-7e4db75fa599/kube-rbac-proxy/0.log" Jun 12 22:21:47.159365 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.159327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:47.161851 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.161833 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 22:21:47.172451 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.172420 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d1d3c0a-52a9-41fc-9da6-709a48ff47af-original-pull-secret\") pod \"global-pull-secret-syncer-76jj7\" (UID: \"3d1d3c0a-52a9-41fc-9da6-709a48ff47af\") " pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:47.230326 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.230285 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-76jj7" Jun 12 22:21:47.260066 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.260036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:47.262709 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.262689 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 22:21:47.273312 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.273284 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d274c226-9653-45b2-b20c-0eae6c5650da-metrics-certs\") pod \"network-metrics-daemon-gh5x7\" (UID: \"d274c226-9653-45b2-b20c-0eae6c5650da\") " pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:47.354861 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.354828 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-76jj7"] Jun 12 22:21:47.357570 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:47.357543 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d1d3c0a_52a9_41fc_9da6_709a48ff47af.slice/crio-a26258dc99288b613018bf95730f7d5fe636bca385400da3516833655e3d3e54 WatchSource:0}: Error finding container a26258dc99288b613018bf95730f7d5fe636bca385400da3516833655e3d3e54: Status 404 returned error can't find the container with id a26258dc99288b613018bf95730f7d5fe636bca385400da3516833655e3d3e54 Jun 12 22:21:47.361005 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.360983 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:47.363239 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.363222 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 22:21:47.373902 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.373880 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 22:21:47.384578 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.384549 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j488k\" (UniqueName: \"kubernetes.io/projected/aa5a7593-0ab7-4dcb-9f2b-dee55c287409-kube-api-access-j488k\") pod \"network-check-target-2dwq2\" (UID: \"aa5a7593-0ab7-4dcb-9f2b-dee55c287409\") " pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:47.423405 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.423325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-chmrs\"" Jun 12 22:21:47.431482 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.431462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:47.527755 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.527727 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qtb4q\"" Jun 12 22:21:47.535908 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.535884 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gh5x7" Jun 12 22:21:47.560888 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.560848 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2dwq2"] Jun 12 22:21:47.563636 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:47.563609 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5a7593_0ab7_4dcb_9f2b_dee55c287409.slice/crio-4354ea84de27587eeb930db2935d7896b55064afc6e396234cb66259a0bff665 WatchSource:0}: Error finding container 4354ea84de27587eeb930db2935d7896b55064afc6e396234cb66259a0bff665: Status 404 returned error can't find the container with id 4354ea84de27587eeb930db2935d7896b55064afc6e396234cb66259a0bff665 Jun 12 22:21:47.626871 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.626840 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9s2kj" Jun 12 22:21:47.647932 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.647900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2dwq2" event={"ID":"aa5a7593-0ab7-4dcb-9f2b-dee55c287409","Type":"ContainerStarted","Data":"4354ea84de27587eeb930db2935d7896b55064afc6e396234cb66259a0bff665"} Jun 12 22:21:47.649051 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.649015 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-76jj7" event={"ID":"3d1d3c0a-52a9-41fc-9da6-709a48ff47af","Type":"ContainerStarted","Data":"a26258dc99288b613018bf95730f7d5fe636bca385400da3516833655e3d3e54"} Jun 12 22:21:47.667791 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.667760 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gh5x7"] Jun 12 22:21:47.671278 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:47.671250 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd274c226_9653_45b2_b20c_0eae6c5650da.slice/crio-dcccadf45e357614fcfff43b01baaf51309bf59c0b60b903a595256d64d47bcc WatchSource:0}: Error finding container dcccadf45e357614fcfff43b01baaf51309bf59c0b60b903a595256d64d47bcc: Status 404 returned error can't find the container with id dcccadf45e357614fcfff43b01baaf51309bf59c0b60b903a595256d64d47bcc Jun 12 22:21:47.864535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.864496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:47.864762 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.864547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:47.864762 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:47.864712 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 22:21:47.864890 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:47.864800 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls podName:65e675ef-08b7-4f6b-9fe1-b08637096d7a nodeName:}" failed. No retries permitted until 2026-06-12 22:21:49.864779705 +0000 UTC m=+68.903244006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pdgcd" (UID: "65e675ef-08b7-4f6b-9fe1-b08637096d7a") : secret "insights-runtime-extractor-tls" not found Jun 12 22:21:47.865243 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.865213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65e675ef-08b7-4f6b-9fe1-b08637096d7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:47.883233 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:47.883201 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7t2mm_24ae138a-81a1-4c68-ad2b-2f0af46a67fa/dns-node-resolver/0.log" Jun 12 22:21:48.484638 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:48.484584 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69dd584db6-jtlnk_b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b/registry/0.log" Jun 12 22:21:48.655176 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:48.655136 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh5x7" event={"ID":"d274c226-9653-45b2-b20c-0eae6c5650da","Type":"ContainerStarted","Data":"dcccadf45e357614fcfff43b01baaf51309bf59c0b60b903a595256d64d47bcc"} Jun 12 22:21:49.284519 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:49.284436 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrk8m_8f546eac-f83b-4fbe-972b-f4244b271180/node-ca/0.log" Jun 12 22:21:49.662067 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:49.661976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh5x7" event={"ID":"d274c226-9653-45b2-b20c-0eae6c5650da","Type":"ContainerStarted","Data":"ba5a4e4d01716ed7903a567377eb7dcf0c61b093f2c7d3fe77e4122db8b822a8"} Jun 12 22:21:49.662067 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:49.662046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gh5x7" event={"ID":"d274c226-9653-45b2-b20c-0eae6c5650da","Type":"ContainerStarted","Data":"63acd03b99976b903c1eb31863a81d3e8f307004a650d4553eb53fbe8bd87d1c"} Jun 12 22:21:49.680071 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:49.680013 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gh5x7" podStartSLOduration=67.350409176 podStartE2EDuration="1m8.679991238s" totalImagesPullingTime="1.329582062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:49.67941273 +0000 UTC m=+68.717877064" watchObservedRunningTime="2026-06-12 22:21:49.679991238 +0000 UTC m=+68.718455559" Jun 12 22:21:49.882892 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:49.882854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:49.884163 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:49.884133 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njmqj_3da5abd4-9d9b-4288-92bb-4eb5b926d4bd/serve-healthcheck-canary/0.log" Jun 12 22:21:49.885759 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:49.885733 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65e675ef-08b7-4f6b-9fe1-b08637096d7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pdgcd\" (UID: \"65e675ef-08b7-4f6b-9fe1-b08637096d7a\") " pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:50.046408 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:50.046350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pdgcd" Jun 12 22:21:52.052342 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:52.052298 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pdgcd"] Jun 12 22:21:52.055398 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:52.055371 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e675ef_08b7_4f6b_9fe1_b08637096d7a.slice/crio-8078cb2d12a6be83d8535f575e0f251c2e1000bac95cd9570f7b86f445228ef5 WatchSource:0}: Error finding container 8078cb2d12a6be83d8535f575e0f251c2e1000bac95cd9570f7b86f445228ef5: Status 404 returned error can't find the container with id 8078cb2d12a6be83d8535f575e0f251c2e1000bac95cd9570f7b86f445228ef5 Jun 12 22:21:52.675139 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:52.674952 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdgcd" event={"ID":"65e675ef-08b7-4f6b-9fe1-b08637096d7a","Type":"ContainerStarted","Data":"8078cb2d12a6be83d8535f575e0f251c2e1000bac95cd9570f7b86f445228ef5"} Jun 12 22:21:52.678067 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:52.677997 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2dwq2" event={"ID":"aa5a7593-0ab7-4dcb-9f2b-dee55c287409","Type":"ContainerStarted","Data":"c01f321dd0724ae72779cd7a5ca928cceb04ca6369c161f6e49bd623a7be652c"} Jun 12 22:21:52.678344 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:52.678150 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:21:52.679959 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:52.679825 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-76jj7" event={"ID":"3d1d3c0a-52a9-41fc-9da6-709a48ff47af","Type":"ContainerStarted","Data":"71146274049ea132e6675b7e07e73739c1b050600bc58c1fe13ab3cbdf8c7e98"} Jun 12 22:21:52.694259 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:52.694197 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2dwq2" podStartSLOduration=67.33927369 podStartE2EDuration="1m11.694180441s" totalImagesPullingTime="4.354906751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:52.69338753 +0000 UTC m=+71.731851852" watchObservedRunningTime="2026-06-12 22:21:52.694180441 +0000 UTC m=+71.732644764" Jun 12 22:21:52.709277 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:52.709217 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-76jj7" podStartSLOduration=67.141305941 podStartE2EDuration="1m11.709195971s" totalImagesPullingTime="4.56789003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:52.707819326 +0000 UTC m=+71.746283648" watchObservedRunningTime="2026-06-12 22:21:52.709195971 +0000 UTC m=+71.747660294" Jun 12 22:21:55.104141 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.104077 2580 patch_prober.go:28] interesting pod/image-registry-69dd584db6-jtlnk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 22:21:55.104588 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.104166 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" podUID="b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 22:21:55.225213 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.225180 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ffcf6468c-vmhg4"] Jun 12 22:21:55.227374 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.227351 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.230200 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.230177 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 22:21:55.231178 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.231151 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 22:21:55.231291 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.231212 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h5f4g\"" Jun 12 22:21:55.231357 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.231161 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 22:21:55.231437 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.231418 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 22:21:55.231736 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.231719 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 22:21:55.231838 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.231820 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 22:21:55.231988 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.231970 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 22:21:55.236144 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.236124 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 22:21:55.240036 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.240009 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffcf6468c-vmhg4"] Jun 12 22:21:55.322682 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.322659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-trusted-ca-bundle\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.322740 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.322701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-oauth-config\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.322740 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.322719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-config\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.322819 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.322768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-service-ca\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.322819 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.322796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-oauth-serving-cert\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.322892 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.322822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrwnq\" (UniqueName: \"kubernetes.io/projected/e2803c03-52bf-4e95-9b5f-9f8d8391043d-kube-api-access-nrwnq\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.322892 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.322845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-serving-cert\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.423697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.423670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrwnq\" (UniqueName: \"kubernetes.io/projected/e2803c03-52bf-4e95-9b5f-9f8d8391043d-kube-api-access-nrwnq\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.423875 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.423705 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-serving-cert\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.423875 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.423735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-trusted-ca-bundle\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.423875 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.423855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-oauth-config\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.424029 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.423884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-config\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.424029 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.423907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-service-ca\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.424029 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.423929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-oauth-serving-cert\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.424638 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.424610 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-service-ca\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.424742 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.424644 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-oauth-serving-cert\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.424742 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.424644 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-config\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.424742 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.424688 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-trusted-ca-bundle\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.426288 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.426268 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-serving-cert\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.426385 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.426292 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-oauth-config\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.436982 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.436958 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrwnq\" (UniqueName: \"kubernetes.io/projected/e2803c03-52bf-4e95-9b5f-9f8d8391043d-kube-api-access-nrwnq\") pod \"console-5ffcf6468c-vmhg4\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.538329 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.538288 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:21:55.674034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.673999 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ffcf6468c-vmhg4"] Jun 12 22:21:55.677897 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:55.677867 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2803c03_52bf_4e95_9b5f_9f8d8391043d.slice/crio-6c439c28d1796dc91dad3d0656b2ba5384825d0bca821cccc60fcaaa5d039dbc WatchSource:0}: Error finding container 6c439c28d1796dc91dad3d0656b2ba5384825d0bca821cccc60fcaaa5d039dbc: Status 404 returned error can't find the container with id 6c439c28d1796dc91dad3d0656b2ba5384825d0bca821cccc60fcaaa5d039dbc Jun 12 22:21:55.692328 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.692297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffcf6468c-vmhg4" event={"ID":"e2803c03-52bf-4e95-9b5f-9f8d8391043d","Type":"ContainerStarted","Data":"6c439c28d1796dc91dad3d0656b2ba5384825d0bca821cccc60fcaaa5d039dbc"} Jun 12 22:21:55.693830 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:55.693806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdgcd" event={"ID":"65e675ef-08b7-4f6b-9fe1-b08637096d7a","Type":"ContainerStarted","Data":"d8de1b0fcae652872b588cad9af8738d2ed7f2733f7f6779fe31c4df1d818e8e"} Jun 12 22:21:56.622157 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:56.622123 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69dd584db6-jtlnk" Jun 12 22:21:56.700287 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:56.700206 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdgcd" event={"ID":"65e675ef-08b7-4f6b-9fe1-b08637096d7a","Type":"ContainerStarted","Data":"1c928613fe8eb1a2015b8b53c812531561f1b9f7aea1f7e4798fa93591b6fa57"} Jun 12 22:21:58.709686 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:58.709647 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffcf6468c-vmhg4" event={"ID":"e2803c03-52bf-4e95-9b5f-9f8d8391043d","Type":"ContainerStarted","Data":"44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885"} Jun 12 22:21:58.711845 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:58.711817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pdgcd" event={"ID":"65e675ef-08b7-4f6b-9fe1-b08637096d7a","Type":"ContainerStarted","Data":"a980b42a6183d684e3efecbd336bbdea4db73bdf177b59ba84363b2594388de4"} Jun 12 22:21:58.727120 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:58.727050 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ffcf6468c-vmhg4" podStartSLOduration=0.797898747 podStartE2EDuration="3.727035466s" totalImagesPullingTime="2.929136719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:58.725901105 +0000 UTC m=+77.764365428" watchObservedRunningTime="2026-06-12 22:21:58.727035466 +0000 UTC m=+77.765499786" Jun 12 22:21:58.743564 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:58.743514 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pdgcd" podStartSLOduration=6.296209397 podStartE2EDuration="12.743496467s" totalImagesPullingTime="6.44728707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:21:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:21:58.742742862 +0000 UTC m=+77.781207184" watchObservedRunningTime="2026-06-12 22:21:58.743496467 +0000 UTC m=+77.781960800" Jun 12 22:21:59.071311 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.071273 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6"] Jun 12 22:21:59.073455 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.073439 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.075953 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.075931 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 22:21:59.076121 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.075955 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 22:21:59.076121 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.075970 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 22:21:59.076944 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.076925 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-274bz\"" Jun 12 22:21:59.077023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.076952 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 22:21:59.077023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.077002 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 22:21:59.086572 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.086550 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6"] Jun 12 22:21:59.096200 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.096177 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn"] Jun 12 22:21:59.098507 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.098491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.100988 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.100968 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 22:21:59.101114 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.101038 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 22:21:59.101281 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.101264 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 22:21:59.101326 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.101316 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kfkpg\"" Jun 12 22:21:59.110957 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.110931 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn"] Jun 12 22:21:59.127742 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.127714 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zcbk9"] Jun 12 22:21:59.130175 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.130157 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.132477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.132453 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 22:21:59.132578 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.132558 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 22:21:59.132638 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.132586 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 22:21:59.132690 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.132647 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ndjg9\"" Jun 12 22:21:59.152693 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6b055e93-1964-49a9-bb45-82d25e776e01-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.152826 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.152826 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152721 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3932190b-bca5-4b16-b571-4df885f7e47c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.152826 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.152826 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsw9w\" (UniqueName: \"kubernetes.io/projected/6b055e93-1964-49a9-bb45-82d25e776e01-kube-api-access-nsw9w\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.153034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3932190b-bca5-4b16-b571-4df885f7e47c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.153034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3932190b-bca5-4b16-b571-4df885f7e47c-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.153034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27t5c\" (UniqueName: \"kubernetes.io/projected/3932190b-bca5-4b16-b571-4df885f7e47c-kube-api-access-27t5c\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.153034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b055e93-1964-49a9-bb45-82d25e776e01-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.153034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.152955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.253535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-sys\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.253707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253553 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6b055e93-1964-49a9-bb45-82d25e776e01-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.253707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-tls\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.253707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.253707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-wtmp\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.253707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7szcc\" (UniqueName: \"kubernetes.io/projected/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-kube-api-access-7szcc\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.253707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3932190b-bca5-4b16-b571-4df885f7e47c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.253930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.253930 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:59.253754 2580 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 12 22:21:59.253930 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:59.253826 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-tls podName:6b055e93-1964-49a9-bb45-82d25e776e01 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:59.753804756 +0000 UTC m=+78.792269057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-c8bmn" (UID: "6b055e93-1964-49a9-bb45-82d25e776e01") : secret "kube-state-metrics-tls" not found Jun 12 22:21:59.253930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.253930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-textfile\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.253930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.254269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253956 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6b055e93-1964-49a9-bb45-82d25e776e01-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.254269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.253969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsw9w\" (UniqueName: \"kubernetes.io/projected/6b055e93-1964-49a9-bb45-82d25e776e01-kube-api-access-nsw9w\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.254269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-metrics-client-ca\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.254269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3932190b-bca5-4b16-b571-4df885f7e47c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.254269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254067 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3932190b-bca5-4b16-b571-4df885f7e47c-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.254269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-root\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.254269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27t5c\" (UniqueName: \"kubernetes.io/projected/3932190b-bca5-4b16-b571-4df885f7e47c-kube-api-access-27t5c\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.254269 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b055e93-1964-49a9-bb45-82d25e776e01-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.254664 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.254763 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254738 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.254830 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.254743 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3932190b-bca5-4b16-b571-4df885f7e47c-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.255215 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.255190 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b055e93-1964-49a9-bb45-82d25e776e01-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.256491 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.256470 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3932190b-bca5-4b16-b571-4df885f7e47c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.256574 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.256551 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3932190b-bca5-4b16-b571-4df885f7e47c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.256871 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.256855 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.262764 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.262737 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsw9w\" (UniqueName: \"kubernetes.io/projected/6b055e93-1964-49a9-bb45-82d25e776e01-kube-api-access-nsw9w\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.263230 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.263206 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27t5c\" (UniqueName: \"kubernetes.io/projected/3932190b-bca5-4b16-b571-4df885f7e47c-kube-api-access-27t5c\") pod \"openshift-state-metrics-6b8d965dd5-hltp6\" (UID: \"3932190b-bca5-4b16-b571-4df885f7e47c\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.355652 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-metrics-client-ca\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.355652 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355597 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-root\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.355861 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355661 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-root\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.355861 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-sys\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.355861 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-tls\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.355861 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355753 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-wtmp\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.355861 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355769 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7szcc\" (UniqueName: \"kubernetes.io/projected/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-kube-api-access-7szcc\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.355861 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.355861 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355815 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-sys\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.356216 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:59.355871 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 22:21:59.356216 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-textfile\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.356216 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355925 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-wtmp\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.356216 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:21:59.355939 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-tls podName:a78cf6e6-3d17-405f-9e2f-b8210298f0b3 nodeName:}" failed. No retries permitted until 2026-06-12 22:21:59.855919226 +0000 UTC m=+78.894383525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-tls") pod "node-exporter-zcbk9" (UID: "a78cf6e6-3d17-405f-9e2f-b8210298f0b3") : secret "node-exporter-tls" not found Jun 12 22:21:59.356216 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.355973 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.356400 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.356223 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-metrics-client-ca\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.356400 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.356244 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-textfile\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.356400 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.356283 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.358274 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.358258 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.365337 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.365318 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7szcc\" (UniqueName: \"kubernetes.io/projected/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-kube-api-access-7szcc\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.382249 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.382215 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" Jun 12 22:21:59.511712 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.511681 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6"] Jun 12 22:21:59.515692 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:21:59.515660 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3932190b_bca5_4b16_b571_4df885f7e47c.slice/crio-3929f75b642f9c93788f07756770e900642c30c8c230648f0e2fcf603bb470a3 WatchSource:0}: Error finding container 3929f75b642f9c93788f07756770e900642c30c8c230648f0e2fcf603bb470a3: Status 404 returned error can't find the container with id 3929f75b642f9c93788f07756770e900642c30c8c230648f0e2fcf603bb470a3 Jun 12 22:21:59.717077 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.717039 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" event={"ID":"3932190b-bca5-4b16-b571-4df885f7e47c","Type":"ContainerStarted","Data":"30901c2b3029e43cd6893099c3b812f21b3abc9f57e5da728a93fdd13fb4fe72"} Jun 12 22:21:59.717458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.717117 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" event={"ID":"3932190b-bca5-4b16-b571-4df885f7e47c","Type":"ContainerStarted","Data":"5035862ad1502b92e886f4b81a8d27e5d12381517bbdcb4abc8ec122e281ac39"} Jun 12 22:21:59.717458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.717137 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" event={"ID":"3932190b-bca5-4b16-b571-4df885f7e47c","Type":"ContainerStarted","Data":"3929f75b642f9c93788f07756770e900642c30c8c230648f0e2fcf603bb470a3"} Jun 12 22:21:59.758016 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.757987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.760517 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.760496 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6b055e93-1964-49a9-bb45-82d25e776e01-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-c8bmn\" (UID: \"6b055e93-1964-49a9-bb45-82d25e776e01\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:21:59.859457 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.859420 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-tls\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:21:59.861948 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:21:59.861888 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a78cf6e6-3d17-405f-9e2f-b8210298f0b3-node-exporter-tls\") pod \"node-exporter-zcbk9\" (UID: \"a78cf6e6-3d17-405f-9e2f-b8210298f0b3\") " pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:22:00.006870 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:00.006835 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" Jun 12 22:22:00.038892 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:00.038656 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zcbk9" Jun 12 22:22:00.053006 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:22:00.052970 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78cf6e6_3d17_405f_9e2f_b8210298f0b3.slice/crio-34ae5bbc86d7f4915b70bdf9747e73bf0c4b30cdc1dffe0997525b77f0c2a3ed WatchSource:0}: Error finding container 34ae5bbc86d7f4915b70bdf9747e73bf0c4b30cdc1dffe0997525b77f0c2a3ed: Status 404 returned error can't find the container with id 34ae5bbc86d7f4915b70bdf9747e73bf0c4b30cdc1dffe0997525b77f0c2a3ed Jun 12 22:22:00.190718 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:00.190634 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn"] Jun 12 22:22:00.193796 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:22:00.193767 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b055e93_1964_49a9_bb45_82d25e776e01.slice/crio-71374ed16b7a1b827496a8cafc673669f7a04a136be2ee59b17e4761587dda42 WatchSource:0}: Error finding container 71374ed16b7a1b827496a8cafc673669f7a04a136be2ee59b17e4761587dda42: Status 404 returned error can't find the container with id 71374ed16b7a1b827496a8cafc673669f7a04a136be2ee59b17e4761587dda42 Jun 12 22:22:00.722559 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:00.722519 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" event={"ID":"6b055e93-1964-49a9-bb45-82d25e776e01","Type":"ContainerStarted","Data":"71374ed16b7a1b827496a8cafc673669f7a04a136be2ee59b17e4761587dda42"} Jun 12 22:22:00.724234 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:00.724195 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcbk9" event={"ID":"a78cf6e6-3d17-405f-9e2f-b8210298f0b3","Type":"ContainerStarted","Data":"34ae5bbc86d7f4915b70bdf9747e73bf0c4b30cdc1dffe0997525b77f0c2a3ed"} Jun 12 22:22:00.726827 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:00.726790 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" event={"ID":"3932190b-bca5-4b16-b571-4df885f7e47c","Type":"ContainerStarted","Data":"dae4d153bb491dae8d1b04ed75e75f21543fb2777e69fca146cb36df44f0c8a5"} Jun 12 22:22:00.749637 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:00.749580 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-hltp6" podStartSLOduration=0.921032883 podStartE2EDuration="1.749563014s" totalImagesPullingTime="828.530131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:00.746711057 +0000 UTC m=+79.785175432" watchObservedRunningTime="2026-06-12 22:22:00.749563014 +0000 UTC m=+79.788027335" Jun 12 22:22:01.566970 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:22:01.566932 2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78cf6e6_3d17_405f_9e2f_b8210298f0b3.slice/crio-1f2a0185c2053f654fca8facbcc6a8699b56d734aeb60f76e2ae402dfe1fe257.scope\": RecentStats: unable to find data in memory cache]" Jun 12 22:22:01.732476 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:01.732434 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" event={"ID":"6b055e93-1964-49a9-bb45-82d25e776e01","Type":"ContainerStarted","Data":"f45148f14b8119d4ffe6b7efdcb371cf5b232ccdfd8150adff548ee208764e88"} Jun 12 22:22:01.732956 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:01.732548 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" event={"ID":"6b055e93-1964-49a9-bb45-82d25e776e01","Type":"ContainerStarted","Data":"64492250eacdd16920dc21cceaf64a2693aff67beb9dbd04b31d967f232f64c1"} Jun 12 22:22:01.732956 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:01.732577 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" event={"ID":"6b055e93-1964-49a9-bb45-82d25e776e01","Type":"ContainerStarted","Data":"6e68aaa8041f5d3c4abb978867600737fdcb42aac764c6f7dd6120361e45fbcd"} Jun 12 22:22:01.734064 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:01.734034 2580 generic.go:356] "Generic (PLEG): container finished" podID="a78cf6e6-3d17-405f-9e2f-b8210298f0b3" containerID="1f2a0185c2053f654fca8facbcc6a8699b56d734aeb60f76e2ae402dfe1fe257" exitCode=0 Jun 12 22:22:01.734202 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:01.734120 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcbk9" event={"ID":"a78cf6e6-3d17-405f-9e2f-b8210298f0b3","Type":"ContainerDied","Data":"1f2a0185c2053f654fca8facbcc6a8699b56d734aeb60f76e2ae402dfe1fe257"} Jun 12 22:22:01.771053 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:01.770985 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-c8bmn" podStartSLOduration=1.605291551 podStartE2EDuration="2.770962736s" totalImagesPullingTime="1.165671185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:01.751222462 +0000 UTC m=+80.789686797" watchObservedRunningTime="2026-06-12 22:22:01.770962736 +0000 UTC m=+80.809427059" Jun 12 22:22:02.740030 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:02.739981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcbk9" event={"ID":"a78cf6e6-3d17-405f-9e2f-b8210298f0b3","Type":"ContainerStarted","Data":"b906b9d5d6039c149c732740b320fd81b04e7a3f215941aad33cb3b20eb0d351"} Jun 12 22:22:02.740416 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:02.740051 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcbk9" event={"ID":"a78cf6e6-3d17-405f-9e2f-b8210298f0b3","Type":"ContainerStarted","Data":"8db2069805d3f4090b6778ea3a35bd3a30565721fe46194d88a2600ad3cdfdce"} Jun 12 22:22:02.762139 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:02.762069 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zcbk9" podStartSLOduration=2.35041242 podStartE2EDuration="3.76205262s" totalImagesPullingTime="1.304887596s" totalInitContainerRuntime="106.752604ms" isStatefulPod=true podCreationTimestamp="2026-06-12 22:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:02.760805951 +0000 UTC m=+81.799270283" watchObservedRunningTime="2026-06-12 22:22:02.76205262 +0000 UTC m=+81.800516941" Jun 12 22:22:03.392525 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.392490 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85bfc4b48d-44n9d"] Jun 12 22:22:03.396569 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.396553 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.399237 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.399210 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 12 22:22:03.399346 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.399246 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 12 22:22:03.399346 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.399260 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gbgnp\"" Jun 12 22:22:03.399346 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.399260 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 22:22:03.400287 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.400268 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 12 22:22:03.400399 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.400326 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-42b4oqep2228f\"" Jun 12 22:22:03.405396 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.405375 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85bfc4b48d-44n9d"] Jun 12 22:22:03.486331 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.486286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-audit-log\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.486331 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.486337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-secret-metrics-server-tls\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.486559 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.486364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.486559 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.486427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-secret-metrics-server-client-certs\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.486559 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.486486 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-client-ca-bundle\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.486559 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.486509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-metrics-server-audit-profiles\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.486559 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.486527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh5vh\" (UniqueName: \"kubernetes.io/projected/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-kube-api-access-jh5vh\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.587825 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.587788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-audit-log\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.587825 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.587831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-secret-metrics-server-tls\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.588000 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.587856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.588000 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.587879 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-secret-metrics-server-client-certs\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.588000 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.587893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-client-ca-bundle\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.588000 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.587910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-metrics-server-audit-profiles\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.588000 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.587948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh5vh\" (UniqueName: \"kubernetes.io/projected/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-kube-api-access-jh5vh\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.588311 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.588284 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-audit-log\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.588936 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.588914 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-metrics-server-audit-profiles\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.589035 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.589007 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.590559 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.590527 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-secret-metrics-server-client-certs\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.590709 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.590688 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-secret-metrics-server-tls\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.590875 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.590860 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-client-ca-bundle\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.597464 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.597445 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh5vh\" (UniqueName: \"kubernetes.io/projected/06f8aa8d-fd81-4481-8b93-3fa8f89c2978-kube-api-access-jh5vh\") pod \"metrics-server-85bfc4b48d-44n9d\" (UID: \"06f8aa8d-fd81-4481-8b93-3fa8f89c2978\") " pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.706107 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.705977 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:03.867518 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.867353 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85bfc4b48d-44n9d"] Jun 12 22:22:03.869960 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:22:03.869934 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f8aa8d_fd81_4481_8b93_3fa8f89c2978.slice/crio-b2479acfe1b0dcc5b517c62190fb100a593d44e95c66addf0bd0fe322f8a1744 WatchSource:0}: Error finding container b2479acfe1b0dcc5b517c62190fb100a593d44e95c66addf0bd0fe322f8a1744: Status 404 returned error can't find the container with id b2479acfe1b0dcc5b517c62190fb100a593d44e95c66addf0bd0fe322f8a1744 Jun 12 22:22:03.879239 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.879217 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7"] Jun 12 22:22:03.883385 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.883368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:03.885818 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.885797 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 22:22:03.885930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.885830 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-927lt\"" Jun 12 22:22:03.890435 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.890182 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7"] Jun 12 22:22:03.990692 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.990662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e45c7e7-e051-451d-8381-a6208c4d9073-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-mr7c7\" (UID: \"8e45c7e7-e051-451d-8381-a6208c4d9073\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:03.990857 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:03.990711 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccwtx\" (UniqueName: \"kubernetes.io/projected/8e45c7e7-e051-451d-8381-a6208c4d9073-kube-api-access-ccwtx\") pod \"monitoring-plugin-589576dfc7-mr7c7\" (UID: \"8e45c7e7-e051-451d-8381-a6208c4d9073\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:04.091596 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:04.091559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccwtx\" (UniqueName: \"kubernetes.io/projected/8e45c7e7-e051-451d-8381-a6208c4d9073-kube-api-access-ccwtx\") pod \"monitoring-plugin-589576dfc7-mr7c7\" (UID: \"8e45c7e7-e051-451d-8381-a6208c4d9073\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:04.091811 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:04.091664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e45c7e7-e051-451d-8381-a6208c4d9073-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-mr7c7\" (UID: \"8e45c7e7-e051-451d-8381-a6208c4d9073\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:04.094350 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:04.094323 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e45c7e7-e051-451d-8381-a6208c4d9073-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-mr7c7\" (UID: \"8e45c7e7-e051-451d-8381-a6208c4d9073\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:04.099728 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:04.099703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccwtx\" (UniqueName: \"kubernetes.io/projected/8e45c7e7-e051-451d-8381-a6208c4d9073-kube-api-access-ccwtx\") pod \"monitoring-plugin-589576dfc7-mr7c7\" (UID: \"8e45c7e7-e051-451d-8381-a6208c4d9073\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:04.192931 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:04.192893 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:04.332351 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:04.332316 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7"] Jun 12 22:22:04.335197 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:22:04.335167 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e45c7e7_e051_451d_8381_a6208c4d9073.slice/crio-70a646c9e4283a24d53ba94d23b13a9541f41f33b0f996feeca004d39a709908 WatchSource:0}: Error finding container 70a646c9e4283a24d53ba94d23b13a9541f41f33b0f996feeca004d39a709908: Status 404 returned error can't find the container with id 70a646c9e4283a24d53ba94d23b13a9541f41f33b0f996feeca004d39a709908 Jun 12 22:22:04.749844 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:04.749808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" event={"ID":"06f8aa8d-fd81-4481-8b93-3fa8f89c2978","Type":"ContainerStarted","Data":"b2479acfe1b0dcc5b517c62190fb100a593d44e95c66addf0bd0fe322f8a1744"} Jun 12 22:22:04.751329 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:04.751296 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" event={"ID":"8e45c7e7-e051-451d-8381-a6208c4d9073","Type":"ContainerStarted","Data":"70a646c9e4283a24d53ba94d23b13a9541f41f33b0f996feeca004d39a709908"} Jun 12 22:22:05.538902 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.538865 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:22:05.539363 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.538938 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:22:05.544645 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.544622 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:22:05.756972 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.756936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" event={"ID":"8e45c7e7-e051-451d-8381-a6208c4d9073","Type":"ContainerStarted","Data":"c277a57082b5d60389c2e6f1335d05d1b120b7d650b756d67a7fb8e8637cd303"} Jun 12 22:22:05.757157 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.757004 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:05.758847 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.758797 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" event={"ID":"06f8aa8d-fd81-4481-8b93-3fa8f89c2978","Type":"ContainerStarted","Data":"0bfd21a7fc8b23e252f837082d95b4fd829af6adfe50568ba1770235d0a1e634"} Jun 12 22:22:05.758970 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.758862 2580 patch_prober.go:28] interesting pod/monitoring-plugin-589576dfc7-mr7c7 container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.133.0.14:9443/health\": dial tcp 10.133.0.14:9443: connect: connection refused" start-of-body= Jun 12 22:22:05.758970 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.758907 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" podUID="8e45c7e7-e051-451d-8381-a6208c4d9073" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.133.0.14:9443/health\": dial tcp 10.133.0.14:9443: connect: connection refused" Jun 12 22:22:05.762975 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.762949 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:22:05.774895 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.774804 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" podStartSLOduration=1.426056528 podStartE2EDuration="2.774782451s" totalImagesPullingTime="1.348725923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:05.774516725 +0000 UTC m=+84.812981047" watchObservedRunningTime="2026-06-12 22:22:05.774782451 +0000 UTC m=+84.813246773" Jun 12 22:22:05.827940 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:05.827838 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" podStartSLOduration=1.016111958 podStartE2EDuration="2.827815872s" totalImagesPullingTime="1.811703914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:05.827473543 +0000 UTC m=+84.865937866" watchObservedRunningTime="2026-06-12 22:22:05.827815872 +0000 UTC m=+84.866280197" Jun 12 22:22:06.766488 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:06.766459 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-mr7c7" Jun 12 22:22:09.434476 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.434437 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-787df9f577-b67ns"] Jun 12 22:22:09.437925 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.437901 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.449044 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.449017 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787df9f577-b67ns"] Jun 12 22:22:09.541220 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.541184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-serving-cert\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.541396 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.541248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-trusted-ca-bundle\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.541396 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.541271 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-oauth-serving-cert\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.541396 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.541314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-console-config\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.541540 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.541398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-oauth-config\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.541540 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.541422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-service-ca\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.541540 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.541441 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzwc\" (UniqueName: \"kubernetes.io/projected/ed857a47-73b2-4c47-97ea-fc119d1df795-kube-api-access-2rzwc\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.641897 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.641856 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-console-config\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.642072 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.641914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-oauth-config\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.642072 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.641930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-service-ca\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.642072 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.641953 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzwc\" (UniqueName: \"kubernetes.io/projected/ed857a47-73b2-4c47-97ea-fc119d1df795-kube-api-access-2rzwc\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.642271 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.642069 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-serving-cert\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.642271 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.642160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-trusted-ca-bundle\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.642271 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.642184 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-oauth-serving-cert\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.642716 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.642694 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-console-config\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.642814 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.642788 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-service-ca\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.643020 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.642999 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-oauth-serving-cert\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.643215 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.643197 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-trusted-ca-bundle\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.644628 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.644605 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-serving-cert\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.644696 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.644650 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-oauth-config\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.655046 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.655018 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzwc\" (UniqueName: \"kubernetes.io/projected/ed857a47-73b2-4c47-97ea-fc119d1df795-kube-api-access-2rzwc\") pod \"console-787df9f577-b67ns\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.747248 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.747196 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:09.881155 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:09.881115 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787df9f577-b67ns"] Jun 12 22:22:09.883613 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:22:09.883584 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded857a47_73b2_4c47_97ea_fc119d1df795.slice/crio-f960e7a07f18e87390aaaf164cd51777357f82d0841524c7ca26263e7be42ac3 WatchSource:0}: Error finding container f960e7a07f18e87390aaaf164cd51777357f82d0841524c7ca26263e7be42ac3: Status 404 returned error can't find the container with id f960e7a07f18e87390aaaf164cd51777357f82d0841524c7ca26263e7be42ac3 Jun 12 22:22:10.777575 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:10.777536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787df9f577-b67ns" event={"ID":"ed857a47-73b2-4c47-97ea-fc119d1df795","Type":"ContainerStarted","Data":"d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1"} Jun 12 22:22:10.777928 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:10.777592 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787df9f577-b67ns" event={"ID":"ed857a47-73b2-4c47-97ea-fc119d1df795","Type":"ContainerStarted","Data":"f960e7a07f18e87390aaaf164cd51777357f82d0841524c7ca26263e7be42ac3"} Jun 12 22:22:10.797481 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:10.797426 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-787df9f577-b67ns" podStartSLOduration=1.797407303 podStartE2EDuration="1.797407303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:22:10.796591179 +0000 UTC m=+89.835055502" watchObservedRunningTime="2026-06-12 22:22:10.797407303 +0000 UTC m=+89.835871614" Jun 12 22:22:12.497496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:12.497460 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787df9f577-b67ns"] Jun 12 22:22:19.748018 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:19.747986 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:23.014055 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:23.014025 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ffcf6468c-vmhg4"] Jun 12 22:22:23.686270 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:23.686245 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2dwq2" Jun 12 22:22:23.706372 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:23.706338 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:23.706534 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:23.706381 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:37.805689 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:37.805636 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-787df9f577-b67ns" podUID="ed857a47-73b2-4c47-97ea-fc119d1df795" containerName="console" containerID="cri-o://d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1" gracePeriod=15 Jun 12 22:22:38.055113 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.055071 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:38.163140 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163026 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-console-config\") pod \"ed857a47-73b2-4c47-97ea-fc119d1df795\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " Jun 12 22:22:38.163140 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163061 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rzwc\" (UniqueName: \"kubernetes.io/projected/ed857a47-73b2-4c47-97ea-fc119d1df795-kube-api-access-2rzwc\") pod \"ed857a47-73b2-4c47-97ea-fc119d1df795\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " Jun 12 22:22:38.163140 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163108 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-oauth-config\") pod \"ed857a47-73b2-4c47-97ea-fc119d1df795\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " Jun 12 22:22:38.163140 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163136 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-oauth-serving-cert\") pod \"ed857a47-73b2-4c47-97ea-fc119d1df795\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " Jun 12 22:22:38.163396 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163272 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-trusted-ca-bundle\") pod \"ed857a47-73b2-4c47-97ea-fc119d1df795\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " Jun 12 22:22:38.163396 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163312 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-service-ca\") pod \"ed857a47-73b2-4c47-97ea-fc119d1df795\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " Jun 12 22:22:38.163396 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163383 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-serving-cert\") pod \"ed857a47-73b2-4c47-97ea-fc119d1df795\" (UID: \"ed857a47-73b2-4c47-97ea-fc119d1df795\") " Jun 12 22:22:38.163541 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163524 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ed857a47-73b2-4c47-97ea-fc119d1df795" (UID: "ed857a47-73b2-4c47-97ea-fc119d1df795"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:38.163655 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163562 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-console-config" (OuterVolumeSpecName: "console-config") pod "ed857a47-73b2-4c47-97ea-fc119d1df795" (UID: "ed857a47-73b2-4c47-97ea-fc119d1df795"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:38.163759 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163734 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-service-ca" (OuterVolumeSpecName: "service-ca") pod "ed857a47-73b2-4c47-97ea-fc119d1df795" (UID: "ed857a47-73b2-4c47-97ea-fc119d1df795"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:38.163759 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163709 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ed857a47-73b2-4c47-97ea-fc119d1df795" (UID: "ed857a47-73b2-4c47-97ea-fc119d1df795"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:38.163884 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163764 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-console-config\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:38.163884 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.163781 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-oauth-serving-cert\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:38.165679 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.165659 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ed857a47-73b2-4c47-97ea-fc119d1df795" (UID: "ed857a47-73b2-4c47-97ea-fc119d1df795"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:22:38.165865 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.165839 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ed857a47-73b2-4c47-97ea-fc119d1df795" (UID: "ed857a47-73b2-4c47-97ea-fc119d1df795"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:22:38.165865 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.165849 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed857a47-73b2-4c47-97ea-fc119d1df795-kube-api-access-2rzwc" (OuterVolumeSpecName: "kube-api-access-2rzwc") pod "ed857a47-73b2-4c47-97ea-fc119d1df795" (UID: "ed857a47-73b2-4c47-97ea-fc119d1df795"). InnerVolumeSpecName "kube-api-access-2rzwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:22:38.265134 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.265067 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-trusted-ca-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:38.265134 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.265123 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ed857a47-73b2-4c47-97ea-fc119d1df795-service-ca\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:38.265134 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.265136 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-serving-cert\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:38.265365 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.265147 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rzwc\" (UniqueName: \"kubernetes.io/projected/ed857a47-73b2-4c47-97ea-fc119d1df795-kube-api-access-2rzwc\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:38.265365 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.265159 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ed857a47-73b2-4c47-97ea-fc119d1df795-console-oauth-config\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:38.877406 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.877372 2580 generic.go:356] "Generic (PLEG): container finished" podID="ed857a47-73b2-4c47-97ea-fc119d1df795" containerID="d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1" exitCode=0 Jun 12 22:22:38.877843 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.877421 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787df9f577-b67ns" Jun 12 22:22:38.877843 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.877421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787df9f577-b67ns" event={"ID":"ed857a47-73b2-4c47-97ea-fc119d1df795","Type":"ContainerDied","Data":"d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1"} Jun 12 22:22:38.877843 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.877550 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787df9f577-b67ns" event={"ID":"ed857a47-73b2-4c47-97ea-fc119d1df795","Type":"ContainerDied","Data":"f960e7a07f18e87390aaaf164cd51777357f82d0841524c7ca26263e7be42ac3"} Jun 12 22:22:38.877843 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.877583 2580 scope.go:117] "RemoveContainer" containerID="d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1" Jun 12 22:22:38.886137 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.886121 2580 scope.go:117] "RemoveContainer" containerID="d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1" Jun 12 22:22:38.886383 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:22:38.886362 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1\": container with ID starting with d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1 not found: ID does not exist" containerID="d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1" Jun 12 22:22:38.886426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.886391 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1"} err="failed to get container status \"d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1\": rpc error: code = NotFound desc = could not find container \"d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1\": container with ID starting with d98794f300b42c46a42cb87ff15e57fdba32b631314c40db6297b913b59f00e1 not found: ID does not exist" Jun 12 22:22:38.902871 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.902840 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787df9f577-b67ns"] Jun 12 22:22:38.906294 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:38.906272 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-787df9f577-b67ns"] Jun 12 22:22:39.417157 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:39.417119 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed857a47-73b2-4c47-97ea-fc119d1df795" path="/var/lib/kubelet/pods/ed857a47-73b2-4c47-97ea-fc119d1df795/volumes" Jun 12 22:22:43.711756 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:43.711728 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:43.715653 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:43.715631 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85bfc4b48d-44n9d" Jun 12 22:22:48.034553 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.034484 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5ffcf6468c-vmhg4" podUID="e2803c03-52bf-4e95-9b5f-9f8d8391043d" containerName="console" containerID="cri-o://44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885" gracePeriod=15 Jun 12 22:22:48.278362 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.278337 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:22:48.340851 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.340756 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-oauth-config\") pod \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " Jun 12 22:22:48.340851 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.340794 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrwnq\" (UniqueName: \"kubernetes.io/projected/e2803c03-52bf-4e95-9b5f-9f8d8391043d-kube-api-access-nrwnq\") pod \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " Jun 12 22:22:48.341069 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.340904 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-service-ca\") pod \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " Jun 12 22:22:48.341069 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.340976 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-serving-cert\") pod \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " Jun 12 22:22:48.341069 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.341017 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-trusted-ca-bundle\") pod \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " Jun 12 22:22:48.341069 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.341046 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-config\") pod \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " Jun 12 22:22:48.341303 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.341112 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-oauth-serving-cert\") pod \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\" (UID: \"e2803c03-52bf-4e95-9b5f-9f8d8391043d\") " Jun 12 22:22:48.341425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.341384 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-service-ca" (OuterVolumeSpecName: "service-ca") pod "e2803c03-52bf-4e95-9b5f-9f8d8391043d" (UID: "e2803c03-52bf-4e95-9b5f-9f8d8391043d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:48.341584 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.341513 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e2803c03-52bf-4e95-9b5f-9f8d8391043d" (UID: "e2803c03-52bf-4e95-9b5f-9f8d8391043d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:48.341654 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.341614 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e2803c03-52bf-4e95-9b5f-9f8d8391043d" (UID: "e2803c03-52bf-4e95-9b5f-9f8d8391043d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:48.341703 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.341536 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-config" (OuterVolumeSpecName: "console-config") pod "e2803c03-52bf-4e95-9b5f-9f8d8391043d" (UID: "e2803c03-52bf-4e95-9b5f-9f8d8391043d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:22:48.343114 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.343057 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e2803c03-52bf-4e95-9b5f-9f8d8391043d" (UID: "e2803c03-52bf-4e95-9b5f-9f8d8391043d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:22:48.343680 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.343657 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2803c03-52bf-4e95-9b5f-9f8d8391043d-kube-api-access-nrwnq" (OuterVolumeSpecName: "kube-api-access-nrwnq") pod "e2803c03-52bf-4e95-9b5f-9f8d8391043d" (UID: "e2803c03-52bf-4e95-9b5f-9f8d8391043d"). InnerVolumeSpecName "kube-api-access-nrwnq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:22:48.343745 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.343655 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e2803c03-52bf-4e95-9b5f-9f8d8391043d" (UID: "e2803c03-52bf-4e95-9b5f-9f8d8391043d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:22:48.442401 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.442363 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-oauth-config\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:48.442401 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.442396 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrwnq\" (UniqueName: \"kubernetes.io/projected/e2803c03-52bf-4e95-9b5f-9f8d8391043d-kube-api-access-nrwnq\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:48.442401 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.442408 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-service-ca\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:48.442639 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.442417 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-serving-cert\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:48.442639 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.442427 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-trusted-ca-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:48.442639 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.442436 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-console-config\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:48.442639 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.442444 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e2803c03-52bf-4e95-9b5f-9f8d8391043d-oauth-serving-cert\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:22:48.915558 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.915517 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2803c03-52bf-4e95-9b5f-9f8d8391043d" containerID="44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885" exitCode=0 Jun 12 22:22:48.915725 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.915569 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ffcf6468c-vmhg4" Jun 12 22:22:48.915725 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.915605 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffcf6468c-vmhg4" event={"ID":"e2803c03-52bf-4e95-9b5f-9f8d8391043d","Type":"ContainerDied","Data":"44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885"} Jun 12 22:22:48.915725 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.915659 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ffcf6468c-vmhg4" event={"ID":"e2803c03-52bf-4e95-9b5f-9f8d8391043d","Type":"ContainerDied","Data":"6c439c28d1796dc91dad3d0656b2ba5384825d0bca821cccc60fcaaa5d039dbc"} Jun 12 22:22:48.915725 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.915682 2580 scope.go:117] "RemoveContainer" containerID="44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885" Jun 12 22:22:48.924337 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.924320 2580 scope.go:117] "RemoveContainer" containerID="44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885" Jun 12 22:22:48.924610 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:22:48.924591 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885\": container with ID starting with 44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885 not found: ID does not exist" containerID="44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885" Jun 12 22:22:48.924661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.924619 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885"} err="failed to get container status \"44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885\": rpc error: code = NotFound desc = could not find container \"44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885\": container with ID starting with 44d7f5375201207888f63baff07501c4da783aa0756d94d0a6a7a41e82a68885 not found: ID does not exist" Jun 12 22:22:48.935397 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.935368 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ffcf6468c-vmhg4"] Jun 12 22:22:48.937576 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:48.937556 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ffcf6468c-vmhg4"] Jun 12 22:22:49.417571 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:22:49.417535 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2803c03-52bf-4e95-9b5f-9f8d8391043d" path="/var/lib/kubelet/pods/e2803c03-52bf-4e95-9b5f-9f8d8391043d/volumes" Jun 12 22:23:35.541029 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.540943 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7977c87887-qz692"] Jun 12 22:23:35.541546 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.541213 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed857a47-73b2-4c47-97ea-fc119d1df795" containerName="console" Jun 12 22:23:35.541546 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.541225 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed857a47-73b2-4c47-97ea-fc119d1df795" containerName="console" Jun 12 22:23:35.541546 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.541234 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2803c03-52bf-4e95-9b5f-9f8d8391043d" containerName="console" Jun 12 22:23:35.541546 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.541240 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2803c03-52bf-4e95-9b5f-9f8d8391043d" containerName="console" Jun 12 22:23:35.541546 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.541286 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2803c03-52bf-4e95-9b5f-9f8d8391043d" containerName="console" Jun 12 22:23:35.541546 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.541294 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed857a47-73b2-4c47-97ea-fc119d1df795" containerName="console" Jun 12 22:23:35.543146 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.543129 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.545591 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.545571 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 22:23:35.545808 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.545787 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 22:23:35.545918 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.545792 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 22:23:35.545982 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.545962 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 22:23:35.546060 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.546044 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 22:23:35.546140 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.546050 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 22:23:35.546323 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.546298 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h5f4g\"" Jun 12 22:23:35.546489 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.546467 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 22:23:35.551102 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.551070 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 22:23:35.556965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.556943 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7977c87887-qz692"] Jun 12 22:23:35.599505 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.599477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-config\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.599657 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.599511 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-serving-cert\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.599657 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.599538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-trusted-ca-bundle\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.599657 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.599590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-oauth-serving-cert\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.599657 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.599617 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7pg\" (UniqueName: \"kubernetes.io/projected/b31d748a-13ba-4559-9f34-8c30d86f7e13-kube-api-access-mg7pg\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.599657 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.599640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-service-ca\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.599830 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.599670 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-oauth-config\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.700275 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.700236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-config\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.700275 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.700277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-serving-cert\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.700514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.700307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-trusted-ca-bundle\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.700514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.700330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-oauth-serving-cert\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.700514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.700361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7pg\" (UniqueName: \"kubernetes.io/projected/b31d748a-13ba-4559-9f34-8c30d86f7e13-kube-api-access-mg7pg\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.700514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.700384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-service-ca\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.700720 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.700572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-oauth-config\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.701110 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.701048 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-config\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.701110 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.701104 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-service-ca\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.701110 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.701120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-oauth-serving-cert\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.701426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.701339 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-trusted-ca-bundle\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.702908 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.702884 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-serving-cert\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.703065 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.703049 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-oauth-config\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.710917 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.710897 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7pg\" (UniqueName: \"kubernetes.io/projected/b31d748a-13ba-4559-9f34-8c30d86f7e13-kube-api-access-mg7pg\") pod \"console-7977c87887-qz692\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.853363 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.853257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:35.980626 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:35.980594 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7977c87887-qz692"] Jun 12 22:23:35.983921 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:23:35.983895 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31d748a_13ba_4559_9f34_8c30d86f7e13.slice/crio-07254120c9e7abde93640906af3db391aabf0e1c67323e6541d846668a80bc20 WatchSource:0}: Error finding container 07254120c9e7abde93640906af3db391aabf0e1c67323e6541d846668a80bc20: Status 404 returned error can't find the container with id 07254120c9e7abde93640906af3db391aabf0e1c67323e6541d846668a80bc20 Jun 12 22:23:36.074038 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:36.074005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7977c87887-qz692" event={"ID":"b31d748a-13ba-4559-9f34-8c30d86f7e13","Type":"ContainerStarted","Data":"f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083"} Jun 12 22:23:36.074208 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:36.074057 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7977c87887-qz692" event={"ID":"b31d748a-13ba-4559-9f34-8c30d86f7e13","Type":"ContainerStarted","Data":"07254120c9e7abde93640906af3db391aabf0e1c67323e6541d846668a80bc20"} Jun 12 22:23:36.093710 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:36.093652 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7977c87887-qz692" podStartSLOduration=1.093636868 podStartE2EDuration="1.093636868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:23:36.091764395 +0000 UTC m=+175.130228717" watchObservedRunningTime="2026-06-12 22:23:36.093636868 +0000 UTC m=+175.132101189" Jun 12 22:23:45.854003 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:45.853964 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:45.854486 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:45.854038 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:45.858906 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:45.858884 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:46.113111 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:46.113009 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7977c87887-qz692" Jun 12 22:23:52.752619 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.752583 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk"] Jun 12 22:23:52.755439 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.755421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.757980 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.757955 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp7nm\"" Jun 12 22:23:52.758110 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.757966 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 22:23:52.759200 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.759182 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 22:23:52.765741 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.765721 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk"] Jun 12 22:23:52.832434 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.832398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.832604 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.832443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcvrf\" (UniqueName: \"kubernetes.io/projected/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-kube-api-access-gcvrf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.832604 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.832509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.933184 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.933135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.933184 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.933194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcvrf\" (UniqueName: \"kubernetes.io/projected/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-kube-api-access-gcvrf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.933376 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.933226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.933531 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.933512 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.933567 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.933535 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:52.942153 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:52.942120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcvrf\" (UniqueName: \"kubernetes.io/projected/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-kube-api-access-gcvrf\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:53.063887 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:53.063799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:23:53.196178 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:53.196135 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk"] Jun 12 22:23:53.198722 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:23:53.198691 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64aa43b8_17a5_4b45_a2fb_9ddf1e556678.slice/crio-53a00ddd572b5f0a97848f29c9af07fc3608a34cf8e77b6bec8740aa933fb9f3 WatchSource:0}: Error finding container 53a00ddd572b5f0a97848f29c9af07fc3608a34cf8e77b6bec8740aa933fb9f3: Status 404 returned error can't find the container with id 53a00ddd572b5f0a97848f29c9af07fc3608a34cf8e77b6bec8740aa933fb9f3 Jun 12 22:23:54.137237 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:23:54.137197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" event={"ID":"64aa43b8-17a5-4b45-a2fb-9ddf1e556678","Type":"ContainerStarted","Data":"53a00ddd572b5f0a97848f29c9af07fc3608a34cf8e77b6bec8740aa933fb9f3"} Jun 12 22:24:01.163629 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:01.163586 2580 generic.go:356] "Generic (PLEG): container finished" podID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerID="0a0dc51c6fd5608d29bde6cebd821c07383ad20be49aa4c112148dc9f78aaf2f" exitCode=0 Jun 12 22:24:01.163998 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:01.163653 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" event={"ID":"64aa43b8-17a5-4b45-a2fb-9ddf1e556678","Type":"ContainerDied","Data":"0a0dc51c6fd5608d29bde6cebd821c07383ad20be49aa4c112148dc9f78aaf2f"} Jun 12 22:24:05.180494 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:05.180457 2580 generic.go:356] "Generic (PLEG): container finished" podID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerID="4ba57683a50bcc5ea8c4f94c0c2a766238c8c44bfa08c584ced52eb8f7667c4c" exitCode=0 Jun 12 22:24:05.180866 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:05.180547 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" event={"ID":"64aa43b8-17a5-4b45-a2fb-9ddf1e556678","Type":"ContainerDied","Data":"4ba57683a50bcc5ea8c4f94c0c2a766238c8c44bfa08c584ced52eb8f7667c4c"} Jun 12 22:24:16.228280 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:16.228244 2580 generic.go:356] "Generic (PLEG): container finished" podID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerID="5175d2ccb400e22b387c6586df38ce6eb7159b741c63bb730d0f1392d3cd8a2f" exitCode=0 Jun 12 22:24:16.228654 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:16.228308 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" event={"ID":"64aa43b8-17a5-4b45-a2fb-9ddf1e556678","Type":"ContainerDied","Data":"5175d2ccb400e22b387c6586df38ce6eb7159b741c63bb730d0f1392d3cd8a2f"} Jun 12 22:24:17.354447 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.354413 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:24:17.439977 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.439913 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-util\") pod \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " Jun 12 22:24:17.439977 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.439983 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-bundle\") pod \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " Jun 12 22:24:17.440250 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.440026 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcvrf\" (UniqueName: \"kubernetes.io/projected/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-kube-api-access-gcvrf\") pod \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\" (UID: \"64aa43b8-17a5-4b45-a2fb-9ddf1e556678\") " Jun 12 22:24:17.440774 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.440659 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-bundle" (OuterVolumeSpecName: "bundle") pod "64aa43b8-17a5-4b45-a2fb-9ddf1e556678" (UID: "64aa43b8-17a5-4b45-a2fb-9ddf1e556678"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:24:17.442480 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.442448 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-kube-api-access-gcvrf" (OuterVolumeSpecName: "kube-api-access-gcvrf") pod "64aa43b8-17a5-4b45-a2fb-9ddf1e556678" (UID: "64aa43b8-17a5-4b45-a2fb-9ddf1e556678"). InnerVolumeSpecName "kube-api-access-gcvrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:24:17.444407 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.444388 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-util" (OuterVolumeSpecName: "util") pod "64aa43b8-17a5-4b45-a2fb-9ddf1e556678" (UID: "64aa43b8-17a5-4b45-a2fb-9ddf1e556678"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:24:17.541351 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.541261 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcvrf\" (UniqueName: \"kubernetes.io/projected/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-kube-api-access-gcvrf\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:17.541351 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.541293 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:17.541351 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:17.541301 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64aa43b8-17a5-4b45-a2fb-9ddf1e556678-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:18.237626 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:18.237588 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" event={"ID":"64aa43b8-17a5-4b45-a2fb-9ddf1e556678","Type":"ContainerDied","Data":"53a00ddd572b5f0a97848f29c9af07fc3608a34cf8e77b6bec8740aa933fb9f3"} Jun 12 22:24:18.237626 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:18.237628 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dmr8fk" Jun 12 22:24:18.237824 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:18.237635 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53a00ddd572b5f0a97848f29c9af07fc3608a34cf8e77b6bec8740aa933fb9f3" Jun 12 22:24:25.937844 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.937809 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj"] Jun 12 22:24:25.938355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.938051 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerName="extract" Jun 12 22:24:25.938355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.938061 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerName="extract" Jun 12 22:24:25.938355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.938101 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerName="util" Jun 12 22:24:25.938355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.938107 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerName="util" Jun 12 22:24:25.938355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.938114 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerName="pull" Jun 12 22:24:25.938355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.938120 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerName="pull" Jun 12 22:24:25.938355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.938165 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="64aa43b8-17a5-4b45-a2fb-9ddf1e556678" containerName="extract" Jun 12 22:24:25.940562 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.940544 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" Jun 12 22:24:25.943778 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.943749 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 12 22:24:25.943976 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.943950 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 12 22:24:25.944057 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.943976 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7zcm5\"" Jun 12 22:24:25.957870 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:25.957842 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj"] Jun 12 22:24:26.107529 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:26.107477 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knks7\" (UniqueName: \"kubernetes.io/projected/0024dfb0-652f-4b45-b67e-7482ff5d9978-kube-api-access-knks7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jc7sj\" (UID: \"0024dfb0-652f-4b45-b67e-7482ff5d9978\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" Jun 12 22:24:26.107727 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:26.107601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0024dfb0-652f-4b45-b67e-7482ff5d9978-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jc7sj\" (UID: \"0024dfb0-652f-4b45-b67e-7482ff5d9978\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" Jun 12 22:24:26.208823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:26.208719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knks7\" (UniqueName: \"kubernetes.io/projected/0024dfb0-652f-4b45-b67e-7482ff5d9978-kube-api-access-knks7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jc7sj\" (UID: \"0024dfb0-652f-4b45-b67e-7482ff5d9978\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" Jun 12 22:24:26.208823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:26.208788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0024dfb0-652f-4b45-b67e-7482ff5d9978-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jc7sj\" (UID: \"0024dfb0-652f-4b45-b67e-7482ff5d9978\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" Jun 12 22:24:26.209228 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:26.209207 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0024dfb0-652f-4b45-b67e-7482ff5d9978-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jc7sj\" (UID: \"0024dfb0-652f-4b45-b67e-7482ff5d9978\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" Jun 12 22:24:26.220261 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:26.220234 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knks7\" (UniqueName: \"kubernetes.io/projected/0024dfb0-652f-4b45-b67e-7482ff5d9978-kube-api-access-knks7\") pod \"cert-manager-operator-controller-manager-57757f7cfc-jc7sj\" (UID: \"0024dfb0-652f-4b45-b67e-7482ff5d9978\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" Jun 12 22:24:26.249666 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:26.249634 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" Jun 12 22:24:26.389161 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:26.389117 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj"] Jun 12 22:24:26.394110 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:24:26.394063 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0024dfb0_652f_4b45_b67e_7482ff5d9978.slice/crio-d0354eb010d60d774c61fb6ccbef6b194a9857a371e77fa0c29219f7646b97f1 WatchSource:0}: Error finding container d0354eb010d60d774c61fb6ccbef6b194a9857a371e77fa0c29219f7646b97f1: Status 404 returned error can't find the container with id d0354eb010d60d774c61fb6ccbef6b194a9857a371e77fa0c29219f7646b97f1 Jun 12 22:24:27.275344 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:27.275302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" event={"ID":"0024dfb0-652f-4b45-b67e-7482ff5d9978","Type":"ContainerStarted","Data":"d0354eb010d60d774c61fb6ccbef6b194a9857a371e77fa0c29219f7646b97f1"} Jun 12 22:24:28.280286 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:28.280249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" event={"ID":"0024dfb0-652f-4b45-b67e-7482ff5d9978","Type":"ContainerStarted","Data":"58d5dc06b519c075dbde44d0f14da1ae45311ce46542c929ca9fc713f25d6462"} Jun 12 22:24:28.305391 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:28.305336 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-jc7sj" podStartSLOduration=2.120765239 podStartE2EDuration="3.305319655s" totalImagesPullingTime="1.184554416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:28.303757175 +0000 UTC m=+227.342221497" watchObservedRunningTime="2026-06-12 22:24:28.305319655 +0000 UTC m=+227.343783976" Jun 12 22:24:30.016146 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.016104 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth"] Jun 12 22:24:30.022161 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.022132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.025188 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.025161 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 22:24:30.025316 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.025161 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp7nm\"" Jun 12 22:24:30.026178 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.026155 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 22:24:30.028433 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.028397 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth"] Jun 12 22:24:30.140970 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.140934 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.140970 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.140971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.141199 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.141037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6t9\" (UniqueName: \"kubernetes.io/projected/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-kube-api-access-vf6t9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.242108 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.242040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6t9\" (UniqueName: \"kubernetes.io/projected/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-kube-api-access-vf6t9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.242284 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.242142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.242284 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.242166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.242545 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.242525 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.242579 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.242555 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.251195 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.251171 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6t9\" (UniqueName: \"kubernetes.io/projected/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-kube-api-access-vf6t9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.331889 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.331797 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:30.461068 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:30.461036 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth"] Jun 12 22:24:30.464537 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:24:30.464496 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09cfdda0_6fbf_49de_bec3_25fd48c6dddf.slice/crio-c8f0bd43db17fb63f4b42fb6271466deab75d43cd1917af3fec95dbe57db677a WatchSource:0}: Error finding container c8f0bd43db17fb63f4b42fb6271466deab75d43cd1917af3fec95dbe57db677a: Status 404 returned error can't find the container with id c8f0bd43db17fb63f4b42fb6271466deab75d43cd1917af3fec95dbe57db677a Jun 12 22:24:31.293381 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:31.293348 2580 generic.go:356] "Generic (PLEG): container finished" podID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerID="aecefe4c377f4888299c3d6e685458cdbad019b583e83a011db732c8751061b2" exitCode=0 Jun 12 22:24:31.293784 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:31.293414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" event={"ID":"09cfdda0-6fbf-49de-bec3-25fd48c6dddf","Type":"ContainerDied","Data":"aecefe4c377f4888299c3d6e685458cdbad019b583e83a011db732c8751061b2"} Jun 12 22:24:31.293784 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:31.293474 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" event={"ID":"09cfdda0-6fbf-49de-bec3-25fd48c6dddf","Type":"ContainerStarted","Data":"c8f0bd43db17fb63f4b42fb6271466deab75d43cd1917af3fec95dbe57db677a"} Jun 12 22:24:33.659424 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.659399 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f"] Jun 12 22:24:33.662854 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.662836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" Jun 12 22:24:33.671398 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.671374 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-k9wgj\"" Jun 12 22:24:33.672226 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.672208 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 22:24:33.672370 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.672354 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 22:24:33.679485 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.679452 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f"] Jun 12 22:24:33.772947 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.772900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e75b5b42-39a8-491a-86c2-82d10d73b7ca-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pzz2f\" (UID: \"e75b5b42-39a8-491a-86c2-82d10d73b7ca\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" Jun 12 22:24:33.773139 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.773028 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2t5\" (UniqueName: \"kubernetes.io/projected/e75b5b42-39a8-491a-86c2-82d10d73b7ca-kube-api-access-nm2t5\") pod \"cert-manager-cainjector-5d99449ffd-pzz2f\" (UID: \"e75b5b42-39a8-491a-86c2-82d10d73b7ca\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" Jun 12 22:24:33.874512 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.874477 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2t5\" (UniqueName: \"kubernetes.io/projected/e75b5b42-39a8-491a-86c2-82d10d73b7ca-kube-api-access-nm2t5\") pod \"cert-manager-cainjector-5d99449ffd-pzz2f\" (UID: \"e75b5b42-39a8-491a-86c2-82d10d73b7ca\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" Jun 12 22:24:33.874688 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.874518 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e75b5b42-39a8-491a-86c2-82d10d73b7ca-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pzz2f\" (UID: \"e75b5b42-39a8-491a-86c2-82d10d73b7ca\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" Jun 12 22:24:33.886218 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.886180 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2t5\" (UniqueName: \"kubernetes.io/projected/e75b5b42-39a8-491a-86c2-82d10d73b7ca-kube-api-access-nm2t5\") pod \"cert-manager-cainjector-5d99449ffd-pzz2f\" (UID: \"e75b5b42-39a8-491a-86c2-82d10d73b7ca\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" Jun 12 22:24:33.886514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:33.886496 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e75b5b42-39a8-491a-86c2-82d10d73b7ca-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-pzz2f\" (UID: \"e75b5b42-39a8-491a-86c2-82d10d73b7ca\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" Jun 12 22:24:34.007727 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:34.007693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" Jun 12 22:24:34.140178 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:34.140153 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f"] Jun 12 22:24:34.142474 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:24:34.142439 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode75b5b42_39a8_491a_86c2_82d10d73b7ca.slice/crio-700249daba8c0245d8a5ff7e6fc02719336543a0ce6a7786a5640bdcd83f9dbb WatchSource:0}: Error finding container 700249daba8c0245d8a5ff7e6fc02719336543a0ce6a7786a5640bdcd83f9dbb: Status 404 returned error can't find the container with id 700249daba8c0245d8a5ff7e6fc02719336543a0ce6a7786a5640bdcd83f9dbb Jun 12 22:24:34.306815 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:34.306724 2580 generic.go:356] "Generic (PLEG): container finished" podID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerID="720493c39da6832850ef0cb7264b2a5ac4767da1b26ffb27696f7d11813e3cba" exitCode=0 Jun 12 22:24:34.306992 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:34.306813 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" event={"ID":"09cfdda0-6fbf-49de-bec3-25fd48c6dddf","Type":"ContainerDied","Data":"720493c39da6832850ef0cb7264b2a5ac4767da1b26ffb27696f7d11813e3cba"} Jun 12 22:24:34.308030 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:34.308006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" event={"ID":"e75b5b42-39a8-491a-86c2-82d10d73b7ca","Type":"ContainerStarted","Data":"700249daba8c0245d8a5ff7e6fc02719336543a0ce6a7786a5640bdcd83f9dbb"} Jun 12 22:24:35.313995 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:35.313957 2580 generic.go:356] "Generic (PLEG): container finished" podID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerID="7d32f908d42b4192177b38d23eefea0c6ea3b58566f6efc09be18aa51be2ebe4" exitCode=0 Jun 12 22:24:35.314390 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:35.314051 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" event={"ID":"09cfdda0-6fbf-49de-bec3-25fd48c6dddf","Type":"ContainerDied","Data":"7d32f908d42b4192177b38d23eefea0c6ea3b58566f6efc09be18aa51be2ebe4"} Jun 12 22:24:37.176452 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.176428 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:37.200228 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.200197 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf6t9\" (UniqueName: \"kubernetes.io/projected/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-kube-api-access-vf6t9\") pod \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " Jun 12 22:24:37.202463 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.202404 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-kube-api-access-vf6t9" (OuterVolumeSpecName: "kube-api-access-vf6t9") pod "09cfdda0-6fbf-49de-bec3-25fd48c6dddf" (UID: "09cfdda0-6fbf-49de-bec3-25fd48c6dddf"). InnerVolumeSpecName "kube-api-access-vf6t9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:24:37.300595 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.300560 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-bundle\") pod \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " Jun 12 22:24:37.300595 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.300594 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-util\") pod \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\" (UID: \"09cfdda0-6fbf-49de-bec3-25fd48c6dddf\") " Jun 12 22:24:37.300751 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.300742 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf6t9\" (UniqueName: \"kubernetes.io/projected/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-kube-api-access-vf6t9\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:37.300889 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.300866 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-bundle" (OuterVolumeSpecName: "bundle") pod "09cfdda0-6fbf-49de-bec3-25fd48c6dddf" (UID: "09cfdda0-6fbf-49de-bec3-25fd48c6dddf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:24:37.305519 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.305489 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-util" (OuterVolumeSpecName: "util") pod "09cfdda0-6fbf-49de-bec3-25fd48c6dddf" (UID: "09cfdda0-6fbf-49de-bec3-25fd48c6dddf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:24:37.325307 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.325277 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" event={"ID":"e75b5b42-39a8-491a-86c2-82d10d73b7ca","Type":"ContainerStarted","Data":"06823a8a767b32e0f626a06e42df1d5cd8a3bdb4e2cf9feb015e52c9a09fce33"} Jun 12 22:24:37.327428 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.327400 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" event={"ID":"09cfdda0-6fbf-49de-bec3-25fd48c6dddf","Type":"ContainerDied","Data":"c8f0bd43db17fb63f4b42fb6271466deab75d43cd1917af3fec95dbe57db677a"} Jun 12 22:24:37.327428 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.327420 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frppth" Jun 12 22:24:37.327577 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.327449 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8f0bd43db17fb63f4b42fb6271466deab75d43cd1917af3fec95dbe57db677a" Jun 12 22:24:37.343871 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.343643 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-pzz2f" podStartSLOduration=1.261159106 podStartE2EDuration="4.343623195s" totalImagesPullingTime="3.082464089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:37.342325534 +0000 UTC m=+236.380789855" watchObservedRunningTime="2026-06-12 22:24:37.343623195 +0000 UTC m=+236.382087519" Jun 12 22:24:37.401433 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.401387 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:37.401433 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:37.401418 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09cfdda0-6fbf-49de-bec3-25fd48c6dddf-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:40.853031 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.852992 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pjp87"] Jun 12 22:24:40.853520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.853382 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerName="extract" Jun 12 22:24:40.853520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.853400 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerName="extract" Jun 12 22:24:40.853520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.853413 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerName="pull" Jun 12 22:24:40.853520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.853421 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerName="pull" Jun 12 22:24:40.853520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.853442 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerName="util" Jun 12 22:24:40.853520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.853450 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerName="util" Jun 12 22:24:40.853790 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.853532 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="09cfdda0-6fbf-49de-bec3-25fd48c6dddf" containerName="extract" Jun 12 22:24:40.856646 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.856625 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:40.859437 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.859414 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lbwhp\"" Jun 12 22:24:40.865445 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.865424 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pjp87"] Jun 12 22:24:40.925076 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.925036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9k4l\" (UniqueName: \"kubernetes.io/projected/2bd001c4-2592-40cc-85c4-08d20038c6b5-kube-api-access-t9k4l\") pod \"cert-manager-webhook-7dc76cbb94-pjp87\" (UID: \"2bd001c4-2592-40cc-85c4-08d20038c6b5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:40.925271 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:40.925115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bd001c4-2592-40cc-85c4-08d20038c6b5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pjp87\" (UID: \"2bd001c4-2592-40cc-85c4-08d20038c6b5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:41.025697 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:41.025660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bd001c4-2592-40cc-85c4-08d20038c6b5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pjp87\" (UID: \"2bd001c4-2592-40cc-85c4-08d20038c6b5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:41.025843 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:41.025732 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9k4l\" (UniqueName: \"kubernetes.io/projected/2bd001c4-2592-40cc-85c4-08d20038c6b5-kube-api-access-t9k4l\") pod \"cert-manager-webhook-7dc76cbb94-pjp87\" (UID: \"2bd001c4-2592-40cc-85c4-08d20038c6b5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:41.034261 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:41.034225 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9k4l\" (UniqueName: \"kubernetes.io/projected/2bd001c4-2592-40cc-85c4-08d20038c6b5-kube-api-access-t9k4l\") pod \"cert-manager-webhook-7dc76cbb94-pjp87\" (UID: \"2bd001c4-2592-40cc-85c4-08d20038c6b5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:41.034367 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:41.034231 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2bd001c4-2592-40cc-85c4-08d20038c6b5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-pjp87\" (UID: \"2bd001c4-2592-40cc-85c4-08d20038c6b5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:41.166145 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:41.166009 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:41.296633 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:41.296596 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-pjp87"] Jun 12 22:24:41.300052 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:24:41.300016 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bd001c4_2592_40cc_85c4_08d20038c6b5.slice/crio-0a5d2bbd71a9c59322fc08900ac8b9d44577bfbc710b4974a614637bfd6eeb36 WatchSource:0}: Error finding container 0a5d2bbd71a9c59322fc08900ac8b9d44577bfbc710b4974a614637bfd6eeb36: Status 404 returned error can't find the container with id 0a5d2bbd71a9c59322fc08900ac8b9d44577bfbc710b4974a614637bfd6eeb36 Jun 12 22:24:41.346352 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:41.346325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" event={"ID":"2bd001c4-2592-40cc-85c4-08d20038c6b5","Type":"ContainerStarted","Data":"0a5d2bbd71a9c59322fc08900ac8b9d44577bfbc710b4974a614637bfd6eeb36"} Jun 12 22:24:42.351366 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:42.351328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" event={"ID":"2bd001c4-2592-40cc-85c4-08d20038c6b5","Type":"ContainerStarted","Data":"b7e613737a43f79130e832ff3c56fb476a1437705057ee931f269016abc73707"} Jun 12 22:24:42.351821 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:42.351382 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:42.367603 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:42.367556 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" podStartSLOduration=2.367542739 podStartE2EDuration="2.367542739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:24:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:24:42.365973687 +0000 UTC m=+241.404438022" watchObservedRunningTime="2026-06-12 22:24:42.367542739 +0000 UTC m=+241.406007060" Jun 12 22:24:48.358020 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:48.357980 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-pjp87" Jun 12 22:24:49.277784 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.277747 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr"] Jun 12 22:24:49.282367 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.282346 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.285057 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.285033 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 22:24:49.285210 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.285033 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 22:24:49.286053 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.286036 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp7nm\"" Jun 12 22:24:49.289345 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.289317 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr"] Jun 12 22:24:49.390056 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.390021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.390467 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.390056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8cjz\" (UniqueName: \"kubernetes.io/projected/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-kube-api-access-m8cjz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.390467 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.390197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.490875 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.490831 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.491052 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.490922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.491052 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.490948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8cjz\" (UniqueName: \"kubernetes.io/projected/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-kube-api-access-m8cjz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.491362 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.491327 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.491435 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.491352 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.500184 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.500146 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8cjz\" (UniqueName: \"kubernetes.io/projected/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-kube-api-access-m8cjz\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.592315 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.592221 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:49.725192 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:49.725020 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr"] Jun 12 22:24:49.727936 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:24:49.727908 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852d5636_f3dc_4ec2_a0de_d61341bbb0e5.slice/crio-d1065ad71be5e0e9406e043aa5c6f60157c736a7a844d03d7ae31f806bd198ef WatchSource:0}: Error finding container d1065ad71be5e0e9406e043aa5c6f60157c736a7a844d03d7ae31f806bd198ef: Status 404 returned error can't find the container with id d1065ad71be5e0e9406e043aa5c6f60157c736a7a844d03d7ae31f806bd198ef Jun 12 22:24:50.385419 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:50.385386 2580 generic.go:356] "Generic (PLEG): container finished" podID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerID="269adcc7b6a0c42f51c9a654f0821f95c47e842f9414da461692086c51ed3d9c" exitCode=0 Jun 12 22:24:50.385592 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:50.385457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" event={"ID":"852d5636-f3dc-4ec2-a0de-d61341bbb0e5","Type":"ContainerDied","Data":"269adcc7b6a0c42f51c9a654f0821f95c47e842f9414da461692086c51ed3d9c"} Jun 12 22:24:50.385592 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:50.385534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" event={"ID":"852d5636-f3dc-4ec2-a0de-d61341bbb0e5","Type":"ContainerStarted","Data":"d1065ad71be5e0e9406e043aa5c6f60157c736a7a844d03d7ae31f806bd198ef"} Jun 12 22:24:51.392761 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:51.392722 2580 generic.go:356] "Generic (PLEG): container finished" podID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerID="05c00ce5c2bf586ea22063c9e34d9a4b092327f8914d42bc2be417dd5e3ca8ab" exitCode=0 Jun 12 22:24:51.393150 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:51.392809 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" event={"ID":"852d5636-f3dc-4ec2-a0de-d61341bbb0e5","Type":"ContainerDied","Data":"05c00ce5c2bf586ea22063c9e34d9a4b092327f8914d42bc2be417dd5e3ca8ab"} Jun 12 22:24:52.399017 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:52.398979 2580 generic.go:356] "Generic (PLEG): container finished" podID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerID="e97b1456c9a47865b2b12d8563b146c439db856775fca865bc08c7cc7312e6cd" exitCode=0 Jun 12 22:24:52.399429 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:52.399035 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" event={"ID":"852d5636-f3dc-4ec2-a0de-d61341bbb0e5","Type":"ContainerDied","Data":"e97b1456c9a47865b2b12d8563b146c439db856775fca865bc08c7cc7312e6cd"} Jun 12 22:24:53.532562 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.532538 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:53.626385 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.626343 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8cjz\" (UniqueName: \"kubernetes.io/projected/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-kube-api-access-m8cjz\") pod \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " Jun 12 22:24:53.626385 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.626393 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-bundle\") pod \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " Jun 12 22:24:53.626643 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.626474 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-util\") pod \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\" (UID: \"852d5636-f3dc-4ec2-a0de-d61341bbb0e5\") " Jun 12 22:24:53.627153 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.627126 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-bundle" (OuterVolumeSpecName: "bundle") pod "852d5636-f3dc-4ec2-a0de-d61341bbb0e5" (UID: "852d5636-f3dc-4ec2-a0de-d61341bbb0e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:24:53.628587 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.628566 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-kube-api-access-m8cjz" (OuterVolumeSpecName: "kube-api-access-m8cjz") pod "852d5636-f3dc-4ec2-a0de-d61341bbb0e5" (UID: "852d5636-f3dc-4ec2-a0de-d61341bbb0e5"). InnerVolumeSpecName "kube-api-access-m8cjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:24:53.634754 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.634680 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-util" (OuterVolumeSpecName: "util") pod "852d5636-f3dc-4ec2-a0de-d61341bbb0e5" (UID: "852d5636-f3dc-4ec2-a0de-d61341bbb0e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:24:53.727797 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.727768 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:53.727797 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.727796 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8cjz\" (UniqueName: \"kubernetes.io/projected/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-kube-api-access-m8cjz\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:53.727984 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:53.727807 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/852d5636-f3dc-4ec2-a0de-d61341bbb0e5-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:24:54.409390 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:54.409351 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" event={"ID":"852d5636-f3dc-4ec2-a0de-d61341bbb0e5","Type":"ContainerDied","Data":"d1065ad71be5e0e9406e043aa5c6f60157c736a7a844d03d7ae31f806bd198ef"} Jun 12 22:24:54.409390 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:54.409391 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrnkhr" Jun 12 22:24:54.409585 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:24:54.409426 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1065ad71be5e0e9406e043aa5c6f60157c736a7a844d03d7ae31f806bd198ef" Jun 12 22:25:05.972331 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.972242 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m"] Jun 12 22:25:05.972805 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.972660 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerName="util" Jun 12 22:25:05.972805 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.972678 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerName="util" Jun 12 22:25:05.972805 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.972714 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerName="pull" Jun 12 22:25:05.972805 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.972723 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerName="pull" Jun 12 22:25:05.972805 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.972741 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerName="extract" Jun 12 22:25:05.972805 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.972750 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerName="extract" Jun 12 22:25:05.973113 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.972822 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="852d5636-f3dc-4ec2-a0de-d61341bbb0e5" containerName="extract" Jun 12 22:25:05.974951 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.974931 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:05.978665 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.978644 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hv5kw\"" Jun 12 22:25:05.978793 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.978646 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 22:25:05.978793 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.978678 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 22:25:05.978793 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.978709 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 22:25:05.978793 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:05.978709 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 22:25:06.004563 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.004537 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m"] Jun 12 22:25:06.033895 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.033857 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-tmp\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.033895 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.033897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.034142 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.033920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4bs\" (UniqueName: \"kubernetes.io/projected/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-kube-api-access-lt4bs\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.034142 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.034013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.034142 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.034100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-manifests\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.135284 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.135249 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-manifests\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.135284 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.135294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-tmp\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.135530 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.135320 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.135530 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.135347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4bs\" (UniqueName: \"kubernetes.io/projected/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-kube-api-access-lt4bs\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.135530 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.135387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.135687 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.135664 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-manifests\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.137676 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.137646 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-tmp\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.137905 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.137886 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.137947 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.137925 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.146365 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.146338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4bs\" (UniqueName: \"kubernetes.io/projected/e93d2a79-201f-4c26-9fdc-88dc69cf3a2a-kube-api-access-lt4bs\") pod \"opendatahub-operator-controller-manager-69cd748fbc-8654m\" (UID: \"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a\") " pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.284614 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.284531 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:06.443960 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.443922 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m"] Jun 12 22:25:06.448225 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:06.448196 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93d2a79_201f_4c26_9fdc_88dc69cf3a2a.slice/crio-ddf1beba4edb8977430c0d0121f404cb62b0dddc08addfbfccb60a657365c516 WatchSource:0}: Error finding container ddf1beba4edb8977430c0d0121f404cb62b0dddc08addfbfccb60a657365c516: Status 404 returned error can't find the container with id ddf1beba4edb8977430c0d0121f404cb62b0dddc08addfbfccb60a657365c516 Jun 12 22:25:06.459456 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:06.459420 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" event={"ID":"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a","Type":"ContainerStarted","Data":"ddf1beba4edb8977430c0d0121f404cb62b0dddc08addfbfccb60a657365c516"} Jun 12 22:25:09.476186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:09.476149 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" event={"ID":"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a","Type":"ContainerStarted","Data":"8062ae1dbd3211cf661d3947160f3c47af241e95166595e8a88ccfc25829d938"} Jun 12 22:25:10.481663 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:10.481631 2580 generic.go:356] "Generic (PLEG): container finished" podID="e93d2a79-201f-4c26-9fdc-88dc69cf3a2a" containerID="8062ae1dbd3211cf661d3947160f3c47af241e95166595e8a88ccfc25829d938" exitCode=0 Jun 12 22:25:10.482024 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:10.481694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" event={"ID":"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a","Type":"ContainerDied","Data":"8062ae1dbd3211cf661d3947160f3c47af241e95166595e8a88ccfc25829d938"} Jun 12 22:25:11.486796 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:11.486756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" event={"ID":"e93d2a79-201f-4c26-9fdc-88dc69cf3a2a","Type":"ContainerStarted","Data":"4425b81d32a6410d2e7a54d36defa35f01a342951bd328b7c4a0a1cf9c979641"} Jun 12 22:25:11.487218 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:11.486898 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:11.513479 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:11.513409 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" podStartSLOduration=2.217401837 podStartE2EDuration="6.513384619s" totalImagesPullingTime="3.305949834s" totalInitContainerRuntime="990.032948ms" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:11.511548679 +0000 UTC m=+270.550013000" watchObservedRunningTime="2026-06-12 22:25:11.513384619 +0000 UTC m=+270.551848941" Jun 12 22:25:22.493979 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:22.493942 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69cd748fbc-8654m" Jun 12 22:25:25.634787 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.634750 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9zwgl"] Jun 12 22:25:25.644844 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.644815 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:25.648361 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.648151 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fdxbh\"" Jun 12 22:25:25.648361 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.648332 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 12 22:25:25.649940 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.649911 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9zwgl"] Jun 12 22:25:25.802858 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.802825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbk4z\" (UniqueName: \"kubernetes.io/projected/8b00ac87-a6ec-42ce-923c-ec711217926e-kube-api-access-nbk4z\") pod \"odh-model-controller-6dc94f689f-9zwgl\" (UID: \"8b00ac87-a6ec-42ce-923c-ec711217926e\") " pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:25.802858 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.802864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b00ac87-a6ec-42ce-923c-ec711217926e-cert\") pod \"odh-model-controller-6dc94f689f-9zwgl\" (UID: \"8b00ac87-a6ec-42ce-923c-ec711217926e\") " pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:25.903625 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.903519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbk4z\" (UniqueName: \"kubernetes.io/projected/8b00ac87-a6ec-42ce-923c-ec711217926e-kube-api-access-nbk4z\") pod \"odh-model-controller-6dc94f689f-9zwgl\" (UID: \"8b00ac87-a6ec-42ce-923c-ec711217926e\") " pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:25.903625 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.903588 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b00ac87-a6ec-42ce-923c-ec711217926e-cert\") pod \"odh-model-controller-6dc94f689f-9zwgl\" (UID: \"8b00ac87-a6ec-42ce-923c-ec711217926e\") " pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:25.903812 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:25:25.903691 2580 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 12 22:25:25.903812 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:25:25.903785 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b00ac87-a6ec-42ce-923c-ec711217926e-cert podName:8b00ac87-a6ec-42ce-923c-ec711217926e nodeName:}" failed. No retries permitted until 2026-06-12 22:25:26.403769117 +0000 UTC m=+285.442233419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8b00ac87-a6ec-42ce-923c-ec711217926e-cert") pod "odh-model-controller-6dc94f689f-9zwgl" (UID: "8b00ac87-a6ec-42ce-923c-ec711217926e") : secret "odh-model-controller-webhook-cert" not found Jun 12 22:25:25.916835 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:25.916808 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbk4z\" (UniqueName: \"kubernetes.io/projected/8b00ac87-a6ec-42ce-923c-ec711217926e-kube-api-access-nbk4z\") pod \"odh-model-controller-6dc94f689f-9zwgl\" (UID: \"8b00ac87-a6ec-42ce-923c-ec711217926e\") " pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:26.299352 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.299316 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xs9sv"] Jun 12 22:25:26.301620 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.301596 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:26.305234 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.305213 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 12 22:25:26.319352 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.319326 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xs9sv"] Jun 12 22:25:26.408682 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.408638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7aec0f4-37d4-49e4-960a-506950bcfc21-tls-certs\") pod \"model-serving-api-5dd488fc48-xs9sv\" (UID: \"d7aec0f4-37d4-49e4-960a-506950bcfc21\") " pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:26.408682 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.408680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvff8\" (UniqueName: \"kubernetes.io/projected/d7aec0f4-37d4-49e4-960a-506950bcfc21-kube-api-access-fvff8\") pod \"model-serving-api-5dd488fc48-xs9sv\" (UID: \"d7aec0f4-37d4-49e4-960a-506950bcfc21\") " pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:26.408882 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.408754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b00ac87-a6ec-42ce-923c-ec711217926e-cert\") pod \"odh-model-controller-6dc94f689f-9zwgl\" (UID: \"8b00ac87-a6ec-42ce-923c-ec711217926e\") " pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:26.411259 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.411236 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b00ac87-a6ec-42ce-923c-ec711217926e-cert\") pod \"odh-model-controller-6dc94f689f-9zwgl\" (UID: \"8b00ac87-a6ec-42ce-923c-ec711217926e\") " pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:26.510252 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.510219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7aec0f4-37d4-49e4-960a-506950bcfc21-tls-certs\") pod \"model-serving-api-5dd488fc48-xs9sv\" (UID: \"d7aec0f4-37d4-49e4-960a-506950bcfc21\") " pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:26.510252 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.510252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvff8\" (UniqueName: \"kubernetes.io/projected/d7aec0f4-37d4-49e4-960a-506950bcfc21-kube-api-access-fvff8\") pod \"model-serving-api-5dd488fc48-xs9sv\" (UID: \"d7aec0f4-37d4-49e4-960a-506950bcfc21\") " pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:26.512965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.512938 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7aec0f4-37d4-49e4-960a-506950bcfc21-tls-certs\") pod \"model-serving-api-5dd488fc48-xs9sv\" (UID: \"d7aec0f4-37d4-49e4-960a-506950bcfc21\") " pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:26.518977 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.518944 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvff8\" (UniqueName: \"kubernetes.io/projected/d7aec0f4-37d4-49e4-960a-506950bcfc21-kube-api-access-fvff8\") pod \"model-serving-api-5dd488fc48-xs9sv\" (UID: \"d7aec0f4-37d4-49e4-960a-506950bcfc21\") " pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:26.560750 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.560651 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:26.611864 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.611440 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:26.709758 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.709733 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-9zwgl"] Jun 12 22:25:26.711590 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:26.711560 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b00ac87_a6ec_42ce_923c_ec711217926e.slice/crio-59c1ba2d4f3af78dc25673795d48e044f6a3cb673e2a2ac5833b298e8c94a899 WatchSource:0}: Error finding container 59c1ba2d4f3af78dc25673795d48e044f6a3cb673e2a2ac5833b298e8c94a899: Status 404 returned error can't find the container with id 59c1ba2d4f3af78dc25673795d48e044f6a3cb673e2a2ac5833b298e8c94a899 Jun 12 22:25:26.769545 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:26.769520 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-xs9sv"] Jun 12 22:25:26.771230 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:26.771197 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7aec0f4_37d4_49e4_960a_506950bcfc21.slice/crio-75e172e219f968436f0905124641a7f40848efd8800904cd2ff3e20e3b786e71 WatchSource:0}: Error finding container 75e172e219f968436f0905124641a7f40848efd8800904cd2ff3e20e3b786e71: Status 404 returned error can't find the container with id 75e172e219f968436f0905124641a7f40848efd8800904cd2ff3e20e3b786e71 Jun 12 22:25:27.566994 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:27.566949 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" event={"ID":"d7aec0f4-37d4-49e4-960a-506950bcfc21","Type":"ContainerStarted","Data":"75e172e219f968436f0905124641a7f40848efd8800904cd2ff3e20e3b786e71"} Jun 12 22:25:27.568749 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:27.568716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" event={"ID":"8b00ac87-a6ec-42ce-923c-ec711217926e","Type":"ContainerStarted","Data":"59c1ba2d4f3af78dc25673795d48e044f6a3cb673e2a2ac5833b298e8c94a899"} Jun 12 22:25:30.992065 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:30.991976 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8"] Jun 12 22:25:30.995238 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:30.995217 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:30.997926 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:30.997885 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 22:25:30.999065 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:30.999045 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lxmxg\"" Jun 12 22:25:30.999065 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:30.999055 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 22:25:30.999252 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:30.999047 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 22:25:30.999252 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:30.999053 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 22:25:31.011558 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.007621 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8"] Jun 12 22:25:31.052119 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.052060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tls-certs\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.052272 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.052127 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d89k7\" (UniqueName: \"kubernetes.io/projected/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-kube-api-access-d89k7\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.052272 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.052207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tmp\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.153464 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.153427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tls-certs\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.153464 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.153469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d89k7\" (UniqueName: \"kubernetes.io/projected/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-kube-api-access-d89k7\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.153714 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:25:31.153596 2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 12 22:25:31.153714 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.153608 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tmp\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.153714 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:25:31.153671 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tls-certs podName:1ee720b1-a1f9-4187-b370-1af79e5b3fbf nodeName:}" failed. No retries permitted until 2026-06-12 22:25:31.653649332 +0000 UTC m=+290.692113631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tls-certs") pod "kube-auth-proxy-b7dfdf5dc-842t8" (UID: "1ee720b1-a1f9-4187-b370-1af79e5b3fbf") : secret "kube-auth-proxy-tls" not found Jun 12 22:25:31.156264 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.156241 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tmp\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.163800 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.163769 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d89k7\" (UniqueName: \"kubernetes.io/projected/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-kube-api-access-d89k7\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.590524 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.590489 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" event={"ID":"8b00ac87-a6ec-42ce-923c-ec711217926e","Type":"ContainerStarted","Data":"f7fc359c65738150373e17eb97f9f692db5155c7e03640ea334cd01880604228"} Jun 12 22:25:31.590706 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.590579 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:31.591959 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.591931 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" event={"ID":"d7aec0f4-37d4-49e4-960a-506950bcfc21","Type":"ContainerStarted","Data":"86fe0cf211ba7c5d16e254f36dd715842dd723627638df5ae003f4bc816cbe71"} Jun 12 22:25:31.592098 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.592067 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:31.606208 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.606167 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" podStartSLOduration=2.585184292 podStartE2EDuration="6.606152284s" totalImagesPullingTime="4.020967992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:31.605361562 +0000 UTC m=+290.643825883" watchObservedRunningTime="2026-06-12 22:25:31.606152284 +0000 UTC m=+290.644616606" Jun 12 22:25:31.622532 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.622482 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" podStartSLOduration=1.6200748699999998 podStartE2EDuration="5.62245482s" totalImagesPullingTime="4.00237995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:31.621647159 +0000 UTC m=+290.660111479" watchObservedRunningTime="2026-06-12 22:25:31.62245482 +0000 UTC m=+290.660919141" Jun 12 22:25:31.657176 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.657136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tls-certs\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.659737 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.659710 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee720b1-a1f9-4187-b370-1af79e5b3fbf-tls-certs\") pod \"kube-auth-proxy-b7dfdf5dc-842t8\" (UID: \"1ee720b1-a1f9-4187-b370-1af79e5b3fbf\") " pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:31.905238 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:31.905151 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" Jun 12 22:25:32.055783 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.055746 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8"] Jun 12 22:25:32.058921 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:32.058895 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee720b1_a1f9_4187_b370_1af79e5b3fbf.slice/crio-2459682bdd41d10a3c3b4895fbd35e0b83f9702c95cae4efa2e347429a91c109 WatchSource:0}: Error finding container 2459682bdd41d10a3c3b4895fbd35e0b83f9702c95cae4efa2e347429a91c109: Status 404 returned error can't find the container with id 2459682bdd41d10a3c3b4895fbd35e0b83f9702c95cae4efa2e347429a91c109 Jun 12 22:25:32.600063 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.599978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" event={"ID":"1ee720b1-a1f9-4187-b370-1af79e5b3fbf","Type":"ContainerStarted","Data":"2459682bdd41d10a3c3b4895fbd35e0b83f9702c95cae4efa2e347429a91c109"} Jun 12 22:25:32.636204 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.636167 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5"] Jun 12 22:25:32.639888 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.639854 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.642819 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.642796 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp7nm\"" Jun 12 22:25:32.642819 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.642808 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 22:25:32.644060 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.644037 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 22:25:32.649705 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.649580 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5"] Jun 12 22:25:32.767110 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.767044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.767298 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.767169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.767298 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.767205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdfpm\" (UniqueName: \"kubernetes.io/projected/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-kube-api-access-tdfpm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.868475 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.868392 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.868475 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.868444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.868663 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.868572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdfpm\" (UniqueName: \"kubernetes.io/projected/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-kube-api-access-tdfpm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.868827 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.868808 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.868913 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.868893 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.883675 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.883645 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdfpm\" (UniqueName: \"kubernetes.io/projected/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-kube-api-access-tdfpm\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:32.953042 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:32.953005 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:33.112692 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:33.112655 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5"] Jun 12 22:25:33.114773 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:33.114746 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c4af7ab_471a_40aa_9e1b_f04e1f40707a.slice/crio-60dbe6d37069300249636c71689eecac4a72696fb8dc288897f64a3ed924a079 WatchSource:0}: Error finding container 60dbe6d37069300249636c71689eecac4a72696fb8dc288897f64a3ed924a079: Status 404 returned error can't find the container with id 60dbe6d37069300249636c71689eecac4a72696fb8dc288897f64a3ed924a079 Jun 12 22:25:33.609185 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:33.609155 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerID="974639be48715ca1a5c88aea81680093ecfb97fadd6afbb2cf7cfb62b4d59351" exitCode=0 Jun 12 22:25:33.609392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:33.609219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" event={"ID":"0c4af7ab-471a-40aa-9e1b-f04e1f40707a","Type":"ContainerDied","Data":"974639be48715ca1a5c88aea81680093ecfb97fadd6afbb2cf7cfb62b4d59351"} Jun 12 22:25:33.609392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:33.609271 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" event={"ID":"0c4af7ab-471a-40aa-9e1b-f04e1f40707a","Type":"ContainerStarted","Data":"60dbe6d37069300249636c71689eecac4a72696fb8dc288897f64a3ed924a079"} Jun 12 22:25:35.622726 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:35.622683 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" event={"ID":"1ee720b1-a1f9-4187-b370-1af79e5b3fbf","Type":"ContainerStarted","Data":"c386f01d120d322cf41425fa884ac4b84fade55527594c5ab17854c4254e5f8e"} Jun 12 22:25:35.624537 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:35.624507 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerID="77a0eaef20a6ed8573d54f3d4ce309011b3088b62fca06324c025affacb61841" exitCode=0 Jun 12 22:25:35.624654 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:35.624546 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" event={"ID":"0c4af7ab-471a-40aa-9e1b-f04e1f40707a","Type":"ContainerDied","Data":"77a0eaef20a6ed8573d54f3d4ce309011b3088b62fca06324c025affacb61841"} Jun 12 22:25:35.673299 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:35.672945 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b7dfdf5dc-842t8" podStartSLOduration=3.036314805 podStartE2EDuration="5.672923762s" totalImagesPullingTime="2.636608957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:35.671138091 +0000 UTC m=+294.709602412" watchObservedRunningTime="2026-06-12 22:25:35.672923762 +0000 UTC m=+294.711388086" Jun 12 22:25:36.085186 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.085144 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-s8d78"] Jun 12 22:25:36.088877 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.088849 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:36.092703 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.092677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-h7gnj\"" Jun 12 22:25:36.092993 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.092971 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 12 22:25:36.102882 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.102862 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj"] Jun 12 22:25:36.106076 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.106056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:36.109058 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.109022 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-m2ddt\"" Jun 12 22:25:36.109557 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.109406 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 12 22:25:36.112160 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.112135 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-s8d78"] Jun 12 22:25:36.126906 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.126876 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj"] Jun 12 22:25:36.199165 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.199125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-cert\") pod \"kserve-controller-manager-69fc866d76-s8d78\" (UID: \"bcc73f57-9c8e-44d9-b38d-910c9f6719d9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:36.199355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.199204 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6dr2\" (UniqueName: \"kubernetes.io/projected/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-kube-api-access-r6dr2\") pod \"kserve-controller-manager-69fc866d76-s8d78\" (UID: \"bcc73f57-9c8e-44d9-b38d-910c9f6719d9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:36.199355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.199241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3364edc5-336f-47b5-b587-9e5fa593a1fb-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lthnj\" (UID: \"3364edc5-336f-47b5-b587-9e5fa593a1fb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:36.199355 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.199260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb2gk\" (UniqueName: \"kubernetes.io/projected/3364edc5-336f-47b5-b587-9e5fa593a1fb-kube-api-access-cb2gk\") pod \"llmisvc-controller-manager-864bfd7bc9-lthnj\" (UID: \"3364edc5-336f-47b5-b587-9e5fa593a1fb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:36.300520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.300483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3364edc5-336f-47b5-b587-9e5fa593a1fb-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lthnj\" (UID: \"3364edc5-336f-47b5-b587-9e5fa593a1fb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:36.300520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.300526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb2gk\" (UniqueName: \"kubernetes.io/projected/3364edc5-336f-47b5-b587-9e5fa593a1fb-kube-api-access-cb2gk\") pod \"llmisvc-controller-manager-864bfd7bc9-lthnj\" (UID: \"3364edc5-336f-47b5-b587-9e5fa593a1fb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:36.300725 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.300563 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-cert\") pod \"kserve-controller-manager-69fc866d76-s8d78\" (UID: \"bcc73f57-9c8e-44d9-b38d-910c9f6719d9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:36.300725 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.300629 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6dr2\" (UniqueName: \"kubernetes.io/projected/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-kube-api-access-r6dr2\") pod \"kserve-controller-manager-69fc866d76-s8d78\" (UID: \"bcc73f57-9c8e-44d9-b38d-910c9f6719d9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:36.300802 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:25:36.300735 2580 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 12 22:25:36.300872 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:25:36.300817 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-cert podName:bcc73f57-9c8e-44d9-b38d-910c9f6719d9 nodeName:}" failed. No retries permitted until 2026-06-12 22:25:36.800795632 +0000 UTC m=+295.839259947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-cert") pod "kserve-controller-manager-69fc866d76-s8d78" (UID: "bcc73f57-9c8e-44d9-b38d-910c9f6719d9") : secret "kserve-webhook-server-cert" not found Jun 12 22:25:36.303155 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.303125 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3364edc5-336f-47b5-b587-9e5fa593a1fb-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-lthnj\" (UID: \"3364edc5-336f-47b5-b587-9e5fa593a1fb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:36.316893 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.316868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6dr2\" (UniqueName: \"kubernetes.io/projected/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-kube-api-access-r6dr2\") pod \"kserve-controller-manager-69fc866d76-s8d78\" (UID: \"bcc73f57-9c8e-44d9-b38d-910c9f6719d9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:36.328159 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.328135 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb2gk\" (UniqueName: \"kubernetes.io/projected/3364edc5-336f-47b5-b587-9e5fa593a1fb-kube-api-access-cb2gk\") pod \"llmisvc-controller-manager-864bfd7bc9-lthnj\" (UID: \"3364edc5-336f-47b5-b587-9e5fa593a1fb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:36.416928 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.416816 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:36.562165 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.562138 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj"] Jun 12 22:25:36.563719 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:36.563696 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3364edc5_336f_47b5_b587_9e5fa593a1fb.slice/crio-e514207c1730e373ad2738c874efbb28ec1d6e39505c6806f7c3d3482ff67315 WatchSource:0}: Error finding container e514207c1730e373ad2738c874efbb28ec1d6e39505c6806f7c3d3482ff67315: Status 404 returned error can't find the container with id e514207c1730e373ad2738c874efbb28ec1d6e39505c6806f7c3d3482ff67315 Jun 12 22:25:36.632063 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.632023 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" event={"ID":"3364edc5-336f-47b5-b587-9e5fa593a1fb","Type":"ContainerStarted","Data":"e514207c1730e373ad2738c874efbb28ec1d6e39505c6806f7c3d3482ff67315"} Jun 12 22:25:36.637727 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.637697 2580 generic.go:356] "Generic (PLEG): container finished" podID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerID="51407848069bd67107b7ec382a05baf8c7ffa3f989846d972fd88d87efb54f9e" exitCode=0 Jun 12 22:25:36.637943 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.637763 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" event={"ID":"0c4af7ab-471a-40aa-9e1b-f04e1f40707a","Type":"ContainerDied","Data":"51407848069bd67107b7ec382a05baf8c7ffa3f989846d972fd88d87efb54f9e"} Jun 12 22:25:36.805479 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.805424 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-cert\") pod \"kserve-controller-manager-69fc866d76-s8d78\" (UID: \"bcc73f57-9c8e-44d9-b38d-910c9f6719d9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:36.807991 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.807969 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcc73f57-9c8e-44d9-b38d-910c9f6719d9-cert\") pod \"kserve-controller-manager-69fc866d76-s8d78\" (UID: \"bcc73f57-9c8e-44d9-b38d-910c9f6719d9\") " pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:36.999612 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:36.999571 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:37.139213 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.139129 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-s8d78"] Jun 12 22:25:37.141739 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:37.141713 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc73f57_9c8e_44d9_b38d_910c9f6719d9.slice/crio-f42850ce38abb5b518091757535595a8b7df1d8839a6de6829e8544d429d9e6c WatchSource:0}: Error finding container f42850ce38abb5b518091757535595a8b7df1d8839a6de6829e8544d429d9e6c: Status 404 returned error can't find the container with id f42850ce38abb5b518091757535595a8b7df1d8839a6de6829e8544d429d9e6c Jun 12 22:25:37.655539 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.655474 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" event={"ID":"bcc73f57-9c8e-44d9-b38d-910c9f6719d9","Type":"ContainerStarted","Data":"f42850ce38abb5b518091757535595a8b7df1d8839a6de6829e8544d429d9e6c"} Jun 12 22:25:37.813862 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.813833 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:37.914847 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.914768 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdfpm\" (UniqueName: \"kubernetes.io/projected/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-kube-api-access-tdfpm\") pod \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " Jun 12 22:25:37.914847 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.914837 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-util\") pod \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " Jun 12 22:25:37.915065 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.914867 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-bundle\") pod \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\" (UID: \"0c4af7ab-471a-40aa-9e1b-f04e1f40707a\") " Jun 12 22:25:37.916075 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.916046 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-bundle" (OuterVolumeSpecName: "bundle") pod "0c4af7ab-471a-40aa-9e1b-f04e1f40707a" (UID: "0c4af7ab-471a-40aa-9e1b-f04e1f40707a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:25:37.917232 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.917190 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-kube-api-access-tdfpm" (OuterVolumeSpecName: "kube-api-access-tdfpm") pod "0c4af7ab-471a-40aa-9e1b-f04e1f40707a" (UID: "0c4af7ab-471a-40aa-9e1b-f04e1f40707a"). InnerVolumeSpecName "kube-api-access-tdfpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:25:37.921190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:37.921163 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-util" (OuterVolumeSpecName: "util") pod "0c4af7ab-471a-40aa-9e1b-f04e1f40707a" (UID: "0c4af7ab-471a-40aa-9e1b-f04e1f40707a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:25:38.015798 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:38.015757 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdfpm\" (UniqueName: \"kubernetes.io/projected/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-kube-api-access-tdfpm\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:25:38.015798 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:38.015788 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:25:38.015798 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:38.015798 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c4af7ab-471a-40aa-9e1b-f04e1f40707a-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:25:38.664952 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:38.664910 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" event={"ID":"0c4af7ab-471a-40aa-9e1b-f04e1f40707a","Type":"ContainerDied","Data":"60dbe6d37069300249636c71689eecac4a72696fb8dc288897f64a3ed924a079"} Jun 12 22:25:38.664952 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:38.664948 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064xtl5" Jun 12 22:25:38.665460 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:38.664971 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60dbe6d37069300249636c71689eecac4a72696fb8dc288897f64a3ed924a079" Jun 12 22:25:40.676964 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:40.676919 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" event={"ID":"bcc73f57-9c8e-44d9-b38d-910c9f6719d9","Type":"ContainerStarted","Data":"f9459a42bf5305e26bb922f797f911d4782be26f9c796ba0abc58a6c1e5fbe47"} Jun 12 22:25:40.677441 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:40.677025 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:25:40.678642 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:40.678616 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" event={"ID":"3364edc5-336f-47b5-b587-9e5fa593a1fb","Type":"ContainerStarted","Data":"005b3f641343f107303ac7e7fe56511bc3a25893a49d02b2fe6251eaceeb1c28"} Jun 12 22:25:40.678767 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:40.678684 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:25:40.696902 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:40.696843 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" podStartSLOduration=1.745236258 podStartE2EDuration="4.696826509s" totalImagesPullingTime="2.951590251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:40.695352311 +0000 UTC m=+299.733816633" watchObservedRunningTime="2026-06-12 22:25:40.696826509 +0000 UTC m=+299.735290829" Jun 12 22:25:40.714991 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:40.714924 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" podStartSLOduration=1.187358259 podStartE2EDuration="4.714903115s" totalImagesPullingTime="3.527544856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:40.713780793 +0000 UTC m=+299.752245116" watchObservedRunningTime="2026-06-12 22:25:40.714903115 +0000 UTC m=+299.753367437" Jun 12 22:25:41.370959 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:41.370919 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:25:41.371175 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:41.371163 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:25:41.376664 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:41.376644 2580 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 22:25:42.604929 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:42.604902 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-xs9sv" Jun 12 22:25:42.611597 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:42.611571 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-9zwgl" Jun 12 22:25:47.323938 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.323898 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8"] Jun 12 22:25:47.324434 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.324382 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerName="pull" Jun 12 22:25:47.324434 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.324400 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerName="pull" Jun 12 22:25:47.324434 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.324415 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerName="util" Jun 12 22:25:47.324434 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.324424 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerName="util" Jun 12 22:25:47.324644 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.324437 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerName="extract" Jun 12 22:25:47.324644 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.324446 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerName="extract" Jun 12 22:25:47.324644 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.324553 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c4af7ab-471a-40aa-9e1b-f04e1f40707a" containerName="extract" Jun 12 22:25:47.327995 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.327961 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.331593 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.331555 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 22:25:47.331727 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.331706 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp7nm\"" Jun 12 22:25:47.332950 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.332929 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 22:25:47.351369 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.351343 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8"] Jun 12 22:25:47.397177 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.397135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.397366 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.397216 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8wtl\" (UniqueName: \"kubernetes.io/projected/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-kube-api-access-r8wtl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.397430 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.397353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.498457 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.498400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8wtl\" (UniqueName: \"kubernetes.io/projected/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-kube-api-access-r8wtl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.498628 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.498517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.498628 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.498565 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.498940 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.498919 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.498983 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.498951 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.514127 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.514075 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8wtl\" (UniqueName: \"kubernetes.io/projected/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-kube-api-access-r8wtl\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.638494 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.638393 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:47.799945 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:47.799919 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8"] Jun 12 22:25:47.802191 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:47.802156 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da3cb3b_0f1b_43b0_8984_0b1db453dda7.slice/crio-c6f7245ee9428979bd89d8b8489b61f4cd23b16477e5225ae1ab61f3c4732fb5 WatchSource:0}: Error finding container c6f7245ee9428979bd89d8b8489b61f4cd23b16477e5225ae1ab61f3c4732fb5: Status 404 returned error can't find the container with id c6f7245ee9428979bd89d8b8489b61f4cd23b16477e5225ae1ab61f3c4732fb5 Jun 12 22:25:48.533745 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.533709 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-hnks4"] Jun 12 22:25:48.537235 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.537209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:48.540207 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.540182 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 12 22:25:48.540207 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.540206 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-v2vgf\"" Jun 12 22:25:48.540392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.540193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 12 22:25:48.552502 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.552478 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-hnks4"] Jun 12 22:25:48.607596 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.607565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qrwz\" (UniqueName: \"kubernetes.io/projected/4530ccf9-1e19-4cc4-8ddc-872151825f27-kube-api-access-7qrwz\") pod \"servicemesh-operator3-57f65f65fb-hnks4\" (UID: \"4530ccf9-1e19-4cc4-8ddc-872151825f27\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:48.607768 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.607609 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4530ccf9-1e19-4cc4-8ddc-872151825f27-operator-config\") pod \"servicemesh-operator3-57f65f65fb-hnks4\" (UID: \"4530ccf9-1e19-4cc4-8ddc-872151825f27\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:48.708495 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.708452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qrwz\" (UniqueName: \"kubernetes.io/projected/4530ccf9-1e19-4cc4-8ddc-872151825f27-kube-api-access-7qrwz\") pod \"servicemesh-operator3-57f65f65fb-hnks4\" (UID: \"4530ccf9-1e19-4cc4-8ddc-872151825f27\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:48.708669 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.708509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4530ccf9-1e19-4cc4-8ddc-872151825f27-operator-config\") pod \"servicemesh-operator3-57f65f65fb-hnks4\" (UID: \"4530ccf9-1e19-4cc4-8ddc-872151825f27\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:48.711404 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.711367 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/4530ccf9-1e19-4cc4-8ddc-872151825f27-operator-config\") pod \"servicemesh-operator3-57f65f65fb-hnks4\" (UID: \"4530ccf9-1e19-4cc4-8ddc-872151825f27\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:48.717572 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.717547 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qrwz\" (UniqueName: \"kubernetes.io/projected/4530ccf9-1e19-4cc4-8ddc-872151825f27-kube-api-access-7qrwz\") pod \"servicemesh-operator3-57f65f65fb-hnks4\" (UID: \"4530ccf9-1e19-4cc4-8ddc-872151825f27\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:48.729295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.729268 2580 generic.go:356] "Generic (PLEG): container finished" podID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerID="42b044fe55ca6587dab7a7d901d4019a43876798ca6a7ad512ec04dd3d916116" exitCode=0 Jun 12 22:25:48.729442 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.729352 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" event={"ID":"5da3cb3b-0f1b-43b0-8984-0b1db453dda7","Type":"ContainerDied","Data":"42b044fe55ca6587dab7a7d901d4019a43876798ca6a7ad512ec04dd3d916116"} Jun 12 22:25:48.729442 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.729407 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" event={"ID":"5da3cb3b-0f1b-43b0-8984-0b1db453dda7","Type":"ContainerStarted","Data":"c6f7245ee9428979bd89d8b8489b61f4cd23b16477e5225ae1ab61f3c4732fb5"} Jun 12 22:25:48.730416 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.730399 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:25:48.847770 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.847686 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:48.997492 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:48.997437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-hnks4"] Jun 12 22:25:48.999908 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:25:48.999885 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4530ccf9_1e19_4cc4_8ddc_872151825f27.slice/crio-c41c851e95a8d8acb9ec5c05f7db2ad6c39da2237bf0d357b3c2ee8615f11b2f WatchSource:0}: Error finding container c41c851e95a8d8acb9ec5c05f7db2ad6c39da2237bf0d357b3c2ee8615f11b2f: Status 404 returned error can't find the container with id c41c851e95a8d8acb9ec5c05f7db2ad6c39da2237bf0d357b3c2ee8615f11b2f Jun 12 22:25:49.739490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:49.739453 2580 generic.go:356] "Generic (PLEG): container finished" podID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerID="3f404d653c531b808278ac8d5e806cff7f286e2aef3f7a7e17ed964809e4f943" exitCode=0 Jun 12 22:25:49.739939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:49.739531 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" event={"ID":"5da3cb3b-0f1b-43b0-8984-0b1db453dda7","Type":"ContainerDied","Data":"3f404d653c531b808278ac8d5e806cff7f286e2aef3f7a7e17ed964809e4f943"} Jun 12 22:25:49.744468 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:49.744437 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" event={"ID":"4530ccf9-1e19-4cc4-8ddc-872151825f27","Type":"ContainerStarted","Data":"c41c851e95a8d8acb9ec5c05f7db2ad6c39da2237bf0d357b3c2ee8615f11b2f"} Jun 12 22:25:50.753049 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:50.753016 2580 generic.go:356] "Generic (PLEG): container finished" podID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerID="2571c16024ba58b67eec418e9178417c59b347d674133c0f27a9526e33cd2401" exitCode=0 Jun 12 22:25:50.753655 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:50.753127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" event={"ID":"5da3cb3b-0f1b-43b0-8984-0b1db453dda7","Type":"ContainerDied","Data":"2571c16024ba58b67eec418e9178417c59b347d674133c0f27a9526e33cd2401"} Jun 12 22:25:51.760285 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.760234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" event={"ID":"4530ccf9-1e19-4cc4-8ddc-872151825f27","Type":"ContainerStarted","Data":"7cee30af18e26d8950d4ef74523ac62d5c17b7628d41afb6133228a3192f3aa3"} Jun 12 22:25:51.760748 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.760425 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:25:51.803833 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.803694 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" podStartSLOduration=1.263996176 podStartE2EDuration="3.803669773s" totalImagesPullingTime="2.539673597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:25:51.800522897 +0000 UTC m=+310.838987211" watchObservedRunningTime="2026-06-12 22:25:51.803669773 +0000 UTC m=+310.842134095" Jun 12 22:25:51.909492 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.909467 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:51.939779 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.939739 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-bundle\") pod \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " Jun 12 22:25:51.939967 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.939788 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-util\") pod \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " Jun 12 22:25:51.939967 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.939868 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8wtl\" (UniqueName: \"kubernetes.io/projected/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-kube-api-access-r8wtl\") pod \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\" (UID: \"5da3cb3b-0f1b-43b0-8984-0b1db453dda7\") " Jun 12 22:25:51.941442 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.941410 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-bundle" (OuterVolumeSpecName: "bundle") pod "5da3cb3b-0f1b-43b0-8984-0b1db453dda7" (UID: "5da3cb3b-0f1b-43b0-8984-0b1db453dda7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:25:51.942572 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.942534 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-kube-api-access-r8wtl" (OuterVolumeSpecName: "kube-api-access-r8wtl") pod "5da3cb3b-0f1b-43b0-8984-0b1db453dda7" (UID: "5da3cb3b-0f1b-43b0-8984-0b1db453dda7"). InnerVolumeSpecName "kube-api-access-r8wtl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:25:51.949216 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:51.947636 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-util" (OuterVolumeSpecName: "util") pod "5da3cb3b-0f1b-43b0-8984-0b1db453dda7" (UID: "5da3cb3b-0f1b-43b0-8984-0b1db453dda7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:25:52.041477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:52.041441 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8wtl\" (UniqueName: \"kubernetes.io/projected/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-kube-api-access-r8wtl\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:25:52.041477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:52.041470 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:25:52.041477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:52.041480 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5da3cb3b-0f1b-43b0-8984-0b1db453dda7-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:25:52.768185 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:52.768151 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" Jun 12 22:25:52.768641 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:52.768199 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acj7r8" event={"ID":"5da3cb3b-0f1b-43b0-8984-0b1db453dda7","Type":"ContainerDied","Data":"c6f7245ee9428979bd89d8b8489b61f4cd23b16477e5225ae1ab61f3c4732fb5"} Jun 12 22:25:52.768641 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:25:52.768242 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6f7245ee9428979bd89d8b8489b61f4cd23b16477e5225ae1ab61f3c4732fb5" Jun 12 22:26:02.770622 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:02.770567 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-hnks4" Jun 12 22:26:03.765239 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.765202 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg"] Jun 12 22:26:03.765548 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.765535 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerName="extract" Jun 12 22:26:03.765591 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.765549 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerName="extract" Jun 12 22:26:03.765591 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.765561 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerName="pull" Jun 12 22:26:03.765591 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.765566 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerName="pull" Jun 12 22:26:03.765591 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.765582 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerName="util" Jun 12 22:26:03.765591 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.765587 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerName="util" Jun 12 22:26:03.765778 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.765637 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da3cb3b-0f1b-43b0-8984-0b1db453dda7" containerName="extract" Jun 12 22:26:03.826235 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.826199 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg"] Jun 12 22:26:03.826660 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.826315 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:03.831250 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.831227 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 12 22:26:03.831386 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.831341 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 12 22:26:03.831386 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.831346 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 22:26:03.831492 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.831467 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 12 22:26:03.831603 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.831585 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nlbfx\"" Jun 12 22:26:03.941280 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.941243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:03.941496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.941305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:03.941496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.941372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4pxl\" (UniqueName: \"kubernetes.io/projected/325898a0-c9e9-4cf3-bf56-eecd690d32f8-kube-api-access-w4pxl\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:03.941496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.941403 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/325898a0-c9e9-4cf3-bf56-eecd690d32f8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:03.941496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.941458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:03.941496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.941482 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:03.941780 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:03.941516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.042917 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.042833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.042917 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.042878 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.043132 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.043000 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.043132 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.043039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4pxl\" (UniqueName: \"kubernetes.io/projected/325898a0-c9e9-4cf3-bf56-eecd690d32f8-kube-api-access-w4pxl\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.043132 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.043062 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/325898a0-c9e9-4cf3-bf56-eecd690d32f8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.043282 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.043148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.043282 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.043182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.043733 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.043679 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.045565 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.045538 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.045682 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.045586 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.045682 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.045607 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.045833 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.045818 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/325898a0-c9e9-4cf3-bf56-eecd690d32f8-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.052381 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.052351 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4pxl\" (UniqueName: \"kubernetes.io/projected/325898a0-c9e9-4cf3-bf56-eecd690d32f8-kube-api-access-w4pxl\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.056960 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.056938 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/325898a0-c9e9-4cf3-bf56-eecd690d32f8-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-4bmsg\" (UID: \"325898a0-c9e9-4cf3-bf56-eecd690d32f8\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.135803 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.135761 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:04.334029 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.334003 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg"] Jun 12 22:26:04.336124 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:26:04.336057 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325898a0_c9e9_4cf3_bf56_eecd690d32f8.slice/crio-481a3f774d2b26e51fb44005eecad9609a504caff0617d02228d2e3538021fdc WatchSource:0}: Error finding container 481a3f774d2b26e51fb44005eecad9609a504caff0617d02228d2e3538021fdc: Status 404 returned error can't find the container with id 481a3f774d2b26e51fb44005eecad9609a504caff0617d02228d2e3538021fdc Jun 12 22:26:04.830002 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:04.829965 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" event={"ID":"325898a0-c9e9-4cf3-bf56-eecd690d32f8","Type":"ContainerStarted","Data":"481a3f774d2b26e51fb44005eecad9609a504caff0617d02228d2e3538021fdc"} Jun 12 22:26:07.414490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:07.414453 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:26:07.414834 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:07.414530 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:26:07.847182 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:07.847145 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" event={"ID":"325898a0-c9e9-4cf3-bf56-eecd690d32f8","Type":"ContainerStarted","Data":"a1f45ecdde215d63012219e61b38ae727587ed0acec93c752fe91fbd78be986a"} Jun 12 22:26:07.847374 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:07.847312 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:07.869485 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:07.869432 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" podStartSLOduration=1.7933063360000001 podStartE2EDuration="4.869417632s" totalImagesPullingTime="3.076111296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:26:07.867050413 +0000 UTC m=+326.905514746" watchObservedRunningTime="2026-06-12 22:26:07.869417632 +0000 UTC m=+326.907881952" Jun 12 22:26:08.228531 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.228317 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k"] Jun 12 22:26:08.231345 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.231320 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.234158 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.234136 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tcv88\"" Jun 12 22:26:08.245897 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.245870 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k"] Jun 12 22:26:08.385129 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33550ce-aca2-4af8-ba7e-57776734de12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.385326 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385231 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.385326 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdb5f\" (UniqueName: \"kubernetes.io/projected/d33550ce-aca2-4af8-ba7e-57776734de12-kube-api-access-cdb5f\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.385419 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33550ce-aca2-4af8-ba7e-57776734de12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.385419 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.385501 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385426 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.385501 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.385501 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33550ce-aca2-4af8-ba7e-57776734de12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.385645 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.385542 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486353 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33550ce-aca2-4af8-ba7e-57776734de12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486353 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486353 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486332 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33550ce-aca2-4af8-ba7e-57776734de12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdb5f\" (UniqueName: \"kubernetes.io/projected/d33550ce-aca2-4af8-ba7e-57776734de12-kube-api-access-cdb5f\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33550ce-aca2-4af8-ba7e-57776734de12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486433 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486868 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.486939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.486927 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.487551 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.487028 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.487551 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.487173 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.487551 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.487316 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d33550ce-aca2-4af8-ba7e-57776734de12-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.488998 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.488971 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d33550ce-aca2-4af8-ba7e-57776734de12-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.489154 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.489072 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d33550ce-aca2-4af8-ba7e-57776734de12-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.512135 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.512106 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdb5f\" (UniqueName: \"kubernetes.io/projected/d33550ce-aca2-4af8-ba7e-57776734de12-kube-api-access-cdb5f\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.513255 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.513232 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d33550ce-aca2-4af8-ba7e-57776734de12-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcrpc8k\" (UID: \"d33550ce-aca2-4af8-ba7e-57776734de12\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.541797 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.541766 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:08.703928 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.703899 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k"] Jun 12 22:26:08.706639 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:26:08.706609 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33550ce_aca2_4af8_ba7e_57776734de12.slice/crio-e943c117cebe30fa5eb7a6e25c7ffc5930289981c6828dcbc645cad7f40ceff4 WatchSource:0}: Error finding container e943c117cebe30fa5eb7a6e25c7ffc5930289981c6828dcbc645cad7f40ceff4: Status 404 returned error can't find the container with id e943c117cebe30fa5eb7a6e25c7ffc5930289981c6828dcbc645cad7f40ceff4 Jun 12 22:26:08.853859 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.853760 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" event={"ID":"d33550ce-aca2-4af8-ba7e-57776734de12","Type":"ContainerStarted","Data":"e943c117cebe30fa5eb7a6e25c7ffc5930289981c6828dcbc645cad7f40ceff4"} Jun 12 22:26:08.855706 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:08.855678 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-4bmsg" Jun 12 22:26:11.393187 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:11.393154 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:26:11.393460 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:11.393224 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:26:11.393460 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:11.393252 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:26:11.691394 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:11.691301 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-lthnj" Jun 12 22:26:11.694194 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:11.694169 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-s8d78" Jun 12 22:26:11.873406 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:11.873371 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" event={"ID":"d33550ce-aca2-4af8-ba7e-57776734de12","Type":"ContainerStarted","Data":"fa28265cb889c81930a286cf84a1d1d88df385e0c8183b427ca242187e89097c"} Jun 12 22:26:11.914028 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:11.913965 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" podStartSLOduration=1.229743899 podStartE2EDuration="3.913942447s" totalImagesPullingTime="2.684198548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:26:11.909837723 +0000 UTC m=+330.948302043" watchObservedRunningTime="2026-06-12 22:26:11.913942447 +0000 UTC m=+330.952406769" Jun 12 22:26:12.468214 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.468169 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-864595bf9c-cfhvg"] Jun 12 22:26:12.470747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.470729 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" Jun 12 22:26:12.482978 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.482954 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qjksb\"" Jun 12 22:26:12.482978 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.482976 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 22:26:12.490117 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.490068 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-864595bf9c-cfhvg"] Jun 12 22:26:12.542311 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.542270 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:12.549319 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.549291 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:12.627501 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.627466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xf5v\" (UniqueName: \"kubernetes.io/projected/050ea97e-3812-4d8d-a307-139da59c4ff2-kube-api-access-8xf5v\") pod \"dashboard-redirect-864595bf9c-cfhvg\" (UID: \"050ea97e-3812-4d8d-a307-139da59c4ff2\") " pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" Jun 12 22:26:12.627501 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.627504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/050ea97e-3812-4d8d-a307-139da59c4ff2-redirect-config\") pod \"dashboard-redirect-864595bf9c-cfhvg\" (UID: \"050ea97e-3812-4d8d-a307-139da59c4ff2\") " pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" Jun 12 22:26:12.729006 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.728967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xf5v\" (UniqueName: \"kubernetes.io/projected/050ea97e-3812-4d8d-a307-139da59c4ff2-kube-api-access-8xf5v\") pod \"dashboard-redirect-864595bf9c-cfhvg\" (UID: \"050ea97e-3812-4d8d-a307-139da59c4ff2\") " pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" Jun 12 22:26:12.729205 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.729014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/050ea97e-3812-4d8d-a307-139da59c4ff2-redirect-config\") pod \"dashboard-redirect-864595bf9c-cfhvg\" (UID: \"050ea97e-3812-4d8d-a307-139da59c4ff2\") " pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" Jun 12 22:26:12.729905 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.729884 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/050ea97e-3812-4d8d-a307-139da59c4ff2-redirect-config\") pod \"dashboard-redirect-864595bf9c-cfhvg\" (UID: \"050ea97e-3812-4d8d-a307-139da59c4ff2\") " pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" Jun 12 22:26:12.742491 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.742464 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xf5v\" (UniqueName: \"kubernetes.io/projected/050ea97e-3812-4d8d-a307-139da59c4ff2-kube-api-access-8xf5v\") pod \"dashboard-redirect-864595bf9c-cfhvg\" (UID: \"050ea97e-3812-4d8d-a307-139da59c4ff2\") " pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" Jun 12 22:26:12.781430 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.780623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" Jun 12 22:26:12.879407 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.879373 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:12.880607 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.880584 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcrpc8k" Jun 12 22:26:12.926976 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:26:12.926946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050ea97e_3812_4d8d_a307_139da59c4ff2.slice/crio-67152e962e5976f606fdcee1cd7f710859cc6a1dc988bb7dcf75a9181f9819ec WatchSource:0}: Error finding container 67152e962e5976f606fdcee1cd7f710859cc6a1dc988bb7dcf75a9181f9819ec: Status 404 returned error can't find the container with id 67152e962e5976f606fdcee1cd7f710859cc6a1dc988bb7dcf75a9181f9819ec Jun 12 22:26:12.927387 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:12.927359 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-864595bf9c-cfhvg"] Jun 12 22:26:13.887392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:13.887341 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" event={"ID":"050ea97e-3812-4d8d-a307-139da59c4ff2","Type":"ContainerStarted","Data":"67152e962e5976f606fdcee1cd7f710859cc6a1dc988bb7dcf75a9181f9819ec"} Jun 12 22:26:14.894556 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:14.894520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" event={"ID":"050ea97e-3812-4d8d-a307-139da59c4ff2","Type":"ContainerStarted","Data":"b4084922ed829d69aee9b4cf0f10981a6357f58cb9fc6399fb0f461b15860c4b"} Jun 12 22:26:14.916076 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:14.916027 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-864595bf9c-cfhvg" podStartSLOduration=1.114044568 podStartE2EDuration="2.916011054s" totalImagesPullingTime="1.801966486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:26:14.914719472 +0000 UTC m=+333.953183806" watchObservedRunningTime="2026-06-12 22:26:14.916011054 +0000 UTC m=+333.954475375" Jun 12 22:26:42.045042 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.044965 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7"] Jun 12 22:26:42.050618 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.050599 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.054298 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.054206 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 22:26:42.054460 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.054440 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 22:26:42.054562 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.054464 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ctwcv\"" Jun 12 22:26:42.056070 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.056045 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7"] Jun 12 22:26:42.082477 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.082444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.082661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.082508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.082661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.082575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nkkh\" (UniqueName: \"kubernetes.io/projected/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-kube-api-access-8nkkh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.183801 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.183760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.183980 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.183818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.183980 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.183844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nkkh\" (UniqueName: \"kubernetes.io/projected/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-kube-api-access-8nkkh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.184180 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.184161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.184235 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.184213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.194837 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.194807 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nkkh\" (UniqueName: \"kubernetes.io/projected/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-kube-api-access-8nkkh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.360766 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.360678 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:42.495696 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.495669 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7"] Jun 12 22:26:42.497057 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:26:42.497031 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13304b68_e9ad_4ab5_aa8f_6b819dfc9d33.slice/crio-fd692f3497633ca559975d17f68ea3cdad191e44e19ec3f8e9a860d6a343d483 WatchSource:0}: Error finding container fd692f3497633ca559975d17f68ea3cdad191e44e19ec3f8e9a860d6a343d483: Status 404 returned error can't find the container with id fd692f3497633ca559975d17f68ea3cdad191e44e19ec3f8e9a860d6a343d483 Jun 12 22:26:42.842926 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.842869 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n"] Jun 12 22:26:42.845562 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.845536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:42.854138 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.854111 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n"] Jun 12 22:26:42.889846 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.889815 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnmvs\" (UniqueName: \"kubernetes.io/projected/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-kube-api-access-dnmvs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:42.889991 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.889885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:42.889991 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.889933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:42.991212 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.991177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnmvs\" (UniqueName: \"kubernetes.io/projected/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-kube-api-access-dnmvs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:42.991387 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.991245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:42.991387 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.991278 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:42.991677 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.991657 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:42.991715 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:42.991668 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:43.000060 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.000036 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnmvs\" (UniqueName: \"kubernetes.io/projected/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-kube-api-access-dnmvs\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:43.033928 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.033888 2580 generic.go:356] "Generic (PLEG): container finished" podID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerID="70050e3338b687e171677df38c543eb1a8ac17c543121df00ade98baeea1d557" exitCode=0 Jun 12 22:26:43.034074 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.033930 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" event={"ID":"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33","Type":"ContainerDied","Data":"70050e3338b687e171677df38c543eb1a8ac17c543121df00ade98baeea1d557"} Jun 12 22:26:43.034074 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.033983 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" event={"ID":"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33","Type":"ContainerStarted","Data":"fd692f3497633ca559975d17f68ea3cdad191e44e19ec3f8e9a860d6a343d483"} Jun 12 22:26:43.155282 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.155194 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:43.290846 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.290820 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n"] Jun 12 22:26:43.292703 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:26:43.292676 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d88b7fd_ca43_4e2a_9d1b_ac48d680c15b.slice/crio-4302f9bfa0d5c13c84fc59f5c18c54cd01cb1c7f8f264c2b7e39da9a5b5f175a WatchSource:0}: Error finding container 4302f9bfa0d5c13c84fc59f5c18c54cd01cb1c7f8f264c2b7e39da9a5b5f175a: Status 404 returned error can't find the container with id 4302f9bfa0d5c13c84fc59f5c18c54cd01cb1c7f8f264c2b7e39da9a5b5f175a Jun 12 22:26:43.440142 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.440111 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt"] Jun 12 22:26:43.442473 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.442457 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.451981 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.451958 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt"] Jun 12 22:26:43.495853 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.495828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdwjs\" (UniqueName: \"kubernetes.io/projected/452d2f4f-79e6-47ac-bf95-611e70b29c19-kube-api-access-zdwjs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.495973 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.495860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.495973 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.495887 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.596613 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.596573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwjs\" (UniqueName: \"kubernetes.io/projected/452d2f4f-79e6-47ac-bf95-611e70b29c19-kube-api-access-zdwjs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.596613 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.596614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.596848 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.596788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.596902 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.596889 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.597073 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.597056 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.606398 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.606365 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwjs\" (UniqueName: \"kubernetes.io/projected/452d2f4f-79e6-47ac-bf95-611e70b29c19-kube-api-access-zdwjs\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.793302 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.793276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:43.849188 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.849074 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w"] Jun 12 22:26:43.851597 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.851573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:43.860539 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.860511 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w"] Jun 12 22:26:43.898937 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.898903 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbd65\" (UniqueName: \"kubernetes.io/projected/5df628f8-a665-43da-bc45-2b6d398ee1b0-kube-api-access-zbd65\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:43.899066 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.898968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:43.899066 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.899036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:43.944423 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.944392 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt"] Jun 12 22:26:43.945696 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:26:43.945673 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452d2f4f_79e6_47ac_bf95_611e70b29c19.slice/crio-adaa25af940da408ea2f4725bfade1a7cba0235e087dbb8a1c61936194979a43 WatchSource:0}: Error finding container adaa25af940da408ea2f4725bfade1a7cba0235e087dbb8a1c61936194979a43: Status 404 returned error can't find the container with id adaa25af940da408ea2f4725bfade1a7cba0235e087dbb8a1c61936194979a43 Jun 12 22:26:43.999867 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.999839 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:44.000037 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:43.999917 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:44.000037 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.000023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbd65\" (UniqueName: \"kubernetes.io/projected/5df628f8-a665-43da-bc45-2b6d398ee1b0-kube-api-access-zbd65\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:44.000311 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.000280 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:44.000311 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.000302 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:44.008445 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.008408 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbd65\" (UniqueName: \"kubernetes.io/projected/5df628f8-a665-43da-bc45-2b6d398ee1b0-kube-api-access-zbd65\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:44.044370 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.044337 2580 generic.go:356] "Generic (PLEG): container finished" podID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerID="370df23e592ed10f16d245d025abb3aead9c2f4a4f90cd0510aedfa6d2089fd6" exitCode=0 Jun 12 22:26:44.044552 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.044402 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" event={"ID":"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b","Type":"ContainerDied","Data":"370df23e592ed10f16d245d025abb3aead9c2f4a4f90cd0510aedfa6d2089fd6"} Jun 12 22:26:44.044552 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.044470 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" event={"ID":"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b","Type":"ContainerStarted","Data":"4302f9bfa0d5c13c84fc59f5c18c54cd01cb1c7f8f264c2b7e39da9a5b5f175a"} Jun 12 22:26:44.046496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.046467 2580 generic.go:356] "Generic (PLEG): container finished" podID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerID="193db1ec3aa5fd41732a8a5f9f32567265f17dfb859a3598b84b9ba9dfadfbb4" exitCode=0 Jun 12 22:26:44.046732 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.046535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" event={"ID":"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33","Type":"ContainerDied","Data":"193db1ec3aa5fd41732a8a5f9f32567265f17dfb859a3598b84b9ba9dfadfbb4"} Jun 12 22:26:44.048449 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.048422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" event={"ID":"452d2f4f-79e6-47ac-bf95-611e70b29c19","Type":"ContainerStarted","Data":"296219e7aa716d6af4ab0b7141b0cea899dbd2c8e388eee7afeb9f31d6be64c3"} Jun 12 22:26:44.048538 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.048469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" event={"ID":"452d2f4f-79e6-47ac-bf95-611e70b29c19","Type":"ContainerStarted","Data":"adaa25af940da408ea2f4725bfade1a7cba0235e087dbb8a1c61936194979a43"} Jun 12 22:26:44.197499 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.197460 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:44.339354 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:44.339326 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w"] Jun 12 22:26:44.341384 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:26:44.341345 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df628f8_a665_43da_bc45_2b6d398ee1b0.slice/crio-ad585486ef68b209dd03f159db6f7af7836ba4c8d20ad58285b4de867d4d02e5 WatchSource:0}: Error finding container ad585486ef68b209dd03f159db6f7af7836ba4c8d20ad58285b4de867d4d02e5: Status 404 returned error can't find the container with id ad585486ef68b209dd03f159db6f7af7836ba4c8d20ad58285b4de867d4d02e5 Jun 12 22:26:45.056647 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:45.056617 2580 generic.go:356] "Generic (PLEG): container finished" podID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerID="1dd88ed2cf1ec1c78faa0dac8a2b5b6ff52327c36d1c0e6c9f10fb6d40336fbf" exitCode=0 Jun 12 22:26:45.056828 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:45.056692 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" event={"ID":"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33","Type":"ContainerDied","Data":"1dd88ed2cf1ec1c78faa0dac8a2b5b6ff52327c36d1c0e6c9f10fb6d40336fbf"} Jun 12 22:26:45.058311 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:45.058289 2580 generic.go:356] "Generic (PLEG): container finished" podID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerID="0f96f5ced9186408fa35bf7f0ac6a2be87ae9e2679e58599a1ba4e81bd221201" exitCode=0 Jun 12 22:26:45.058440 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:45.058376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" event={"ID":"5df628f8-a665-43da-bc45-2b6d398ee1b0","Type":"ContainerDied","Data":"0f96f5ced9186408fa35bf7f0ac6a2be87ae9e2679e58599a1ba4e81bd221201"} Jun 12 22:26:45.058440 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:45.058421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" event={"ID":"5df628f8-a665-43da-bc45-2b6d398ee1b0","Type":"ContainerStarted","Data":"ad585486ef68b209dd03f159db6f7af7836ba4c8d20ad58285b4de867d4d02e5"} Jun 12 22:26:45.060226 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:45.060162 2580 generic.go:356] "Generic (PLEG): container finished" podID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerID="296219e7aa716d6af4ab0b7141b0cea899dbd2c8e388eee7afeb9f31d6be64c3" exitCode=0 Jun 12 22:26:45.060226 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:45.060222 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" event={"ID":"452d2f4f-79e6-47ac-bf95-611e70b29c19","Type":"ContainerDied","Data":"296219e7aa716d6af4ab0b7141b0cea899dbd2c8e388eee7afeb9f31d6be64c3"} Jun 12 22:26:46.067911 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.067879 2580 generic.go:356] "Generic (PLEG): container finished" podID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerID="f9540304349237d6b770b2081e0fb9b426b0590646aab73d9fb0d5d61891e35b" exitCode=0 Jun 12 22:26:46.068389 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.067952 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" event={"ID":"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b","Type":"ContainerDied","Data":"f9540304349237d6b770b2081e0fb9b426b0590646aab73d9fb0d5d61891e35b"} Jun 12 22:26:46.070338 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.070314 2580 generic.go:356] "Generic (PLEG): container finished" podID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerID="7782ff2fa17a23e84301eeab7ec12cf2f6f98162a16796c689766f9fb4576950" exitCode=0 Jun 12 22:26:46.070431 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.070394 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" event={"ID":"5df628f8-a665-43da-bc45-2b6d398ee1b0","Type":"ContainerDied","Data":"7782ff2fa17a23e84301eeab7ec12cf2f6f98162a16796c689766f9fb4576950"} Jun 12 22:26:46.072377 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.072355 2580 generic.go:356] "Generic (PLEG): container finished" podID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerID="bd7f727e5de56e401550f7430787908c27e4659179e3d3e2a75064ade698db31" exitCode=0 Jun 12 22:26:46.072484 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.072423 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" event={"ID":"452d2f4f-79e6-47ac-bf95-611e70b29c19","Type":"ContainerDied","Data":"bd7f727e5de56e401550f7430787908c27e4659179e3d3e2a75064ade698db31"} Jun 12 22:26:46.212562 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.212527 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:46.321732 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.321695 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-bundle\") pod \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " Jun 12 22:26:46.321917 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.321801 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nkkh\" (UniqueName: \"kubernetes.io/projected/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-kube-api-access-8nkkh\") pod \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " Jun 12 22:26:46.321917 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.321839 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-util\") pod \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\" (UID: \"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33\") " Jun 12 22:26:46.322305 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.322280 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-bundle" (OuterVolumeSpecName: "bundle") pod "13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" (UID: "13304b68-e9ad-4ab5-aa8f-6b819dfc9d33"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:46.324189 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.324166 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-kube-api-access-8nkkh" (OuterVolumeSpecName: "kube-api-access-8nkkh") pod "13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" (UID: "13304b68-e9ad-4ab5-aa8f-6b819dfc9d33"). InnerVolumeSpecName "kube-api-access-8nkkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:26:46.327734 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.327712 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-util" (OuterVolumeSpecName: "util") pod "13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" (UID: "13304b68-e9ad-4ab5-aa8f-6b819dfc9d33"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:46.422941 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.422867 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nkkh\" (UniqueName: \"kubernetes.io/projected/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-kube-api-access-8nkkh\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:46.422941 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.422895 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:46.422941 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:46.422904 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13304b68-e9ad-4ab5-aa8f-6b819dfc9d33-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:47.080309 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.080275 2580 generic.go:356] "Generic (PLEG): container finished" podID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerID="bcc2c88f00418ab2a0c69f7235be84d23f27b3493fb2e52253d839d9d64a993e" exitCode=0 Jun 12 22:26:47.080745 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.080357 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" event={"ID":"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b","Type":"ContainerDied","Data":"bcc2c88f00418ab2a0c69f7235be84d23f27b3493fb2e52253d839d9d64a993e"} Jun 12 22:26:47.082216 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.082198 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" Jun 12 22:26:47.082332 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.082197 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7" event={"ID":"13304b68-e9ad-4ab5-aa8f-6b819dfc9d33","Type":"ContainerDied","Data":"fd692f3497633ca559975d17f68ea3cdad191e44e19ec3f8e9a860d6a343d483"} Jun 12 22:26:47.082332 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.082311 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd692f3497633ca559975d17f68ea3cdad191e44e19ec3f8e9a860d6a343d483" Jun 12 22:26:47.084116 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.084096 2580 generic.go:356] "Generic (PLEG): container finished" podID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerID="ac575a23a4bc5b6346f52ad415b8a1fbc24cfa32f9a85d5af5c71fdee137bdee" exitCode=0 Jun 12 22:26:47.084217 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.084196 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" event={"ID":"5df628f8-a665-43da-bc45-2b6d398ee1b0","Type":"ContainerDied","Data":"ac575a23a4bc5b6346f52ad415b8a1fbc24cfa32f9a85d5af5c71fdee137bdee"} Jun 12 22:26:47.086393 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.086371 2580 generic.go:356] "Generic (PLEG): container finished" podID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerID="1db1097697f306c1286792cc25e4d2e05e513ba4c357fb67a030201a5e9d2a2b" exitCode=0 Jun 12 22:26:47.086481 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:47.086418 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" event={"ID":"452d2f4f-79e6-47ac-bf95-611e70b29c19","Type":"ContainerDied","Data":"1db1097697f306c1286792cc25e4d2e05e513ba4c357fb67a030201a5e9d2a2b"} Jun 12 22:26:48.263266 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.263242 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:48.275334 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.275309 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:48.277532 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.277516 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:48.342373 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342281 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-util\") pod \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " Jun 12 22:26:48.342373 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342318 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-bundle\") pod \"5df628f8-a665-43da-bc45-2b6d398ee1b0\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " Jun 12 22:26:48.342373 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342356 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnmvs\" (UniqueName: \"kubernetes.io/projected/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-kube-api-access-dnmvs\") pod \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " Jun 12 22:26:48.342666 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342393 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-bundle\") pod \"452d2f4f-79e6-47ac-bf95-611e70b29c19\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " Jun 12 22:26:48.342666 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342441 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-bundle\") pod \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\" (UID: \"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b\") " Jun 12 22:26:48.342666 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342470 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbd65\" (UniqueName: \"kubernetes.io/projected/5df628f8-a665-43da-bc45-2b6d398ee1b0-kube-api-access-zbd65\") pod \"5df628f8-a665-43da-bc45-2b6d398ee1b0\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " Jun 12 22:26:48.342666 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342500 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-util\") pod \"452d2f4f-79e6-47ac-bf95-611e70b29c19\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " Jun 12 22:26:48.342666 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342541 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdwjs\" (UniqueName: \"kubernetes.io/projected/452d2f4f-79e6-47ac-bf95-611e70b29c19-kube-api-access-zdwjs\") pod \"452d2f4f-79e6-47ac-bf95-611e70b29c19\" (UID: \"452d2f4f-79e6-47ac-bf95-611e70b29c19\") " Jun 12 22:26:48.342666 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.342585 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-util\") pod \"5df628f8-a665-43da-bc45-2b6d398ee1b0\" (UID: \"5df628f8-a665-43da-bc45-2b6d398ee1b0\") " Jun 12 22:26:48.343303 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.343207 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-bundle" (OuterVolumeSpecName: "bundle") pod "5df628f8-a665-43da-bc45-2b6d398ee1b0" (UID: "5df628f8-a665-43da-bc45-2b6d398ee1b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:48.343496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.343231 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-bundle" (OuterVolumeSpecName: "bundle") pod "5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" (UID: "5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:48.343718 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.343290 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-bundle" (OuterVolumeSpecName: "bundle") pod "452d2f4f-79e6-47ac-bf95-611e70b29c19" (UID: "452d2f4f-79e6-47ac-bf95-611e70b29c19"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:48.345160 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.345050 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df628f8-a665-43da-bc45-2b6d398ee1b0-kube-api-access-zbd65" (OuterVolumeSpecName: "kube-api-access-zbd65") pod "5df628f8-a665-43da-bc45-2b6d398ee1b0" (UID: "5df628f8-a665-43da-bc45-2b6d398ee1b0"). InnerVolumeSpecName "kube-api-access-zbd65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:26:48.345160 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.345120 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-kube-api-access-dnmvs" (OuterVolumeSpecName: "kube-api-access-dnmvs") pod "5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" (UID: "5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b"). InnerVolumeSpecName "kube-api-access-dnmvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:26:48.345582 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.345560 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452d2f4f-79e6-47ac-bf95-611e70b29c19-kube-api-access-zdwjs" (OuterVolumeSpecName: "kube-api-access-zdwjs") pod "452d2f4f-79e6-47ac-bf95-611e70b29c19" (UID: "452d2f4f-79e6-47ac-bf95-611e70b29c19"). InnerVolumeSpecName "kube-api-access-zdwjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:26:48.348020 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.347999 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-util" (OuterVolumeSpecName: "util") pod "5df628f8-a665-43da-bc45-2b6d398ee1b0" (UID: "5df628f8-a665-43da-bc45-2b6d398ee1b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:48.349034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.349016 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-util" (OuterVolumeSpecName: "util") pod "5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" (UID: "5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:48.349458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.349437 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-util" (OuterVolumeSpecName: "util") pod "452d2f4f-79e6-47ac-bf95-611e70b29c19" (UID: "452d2f4f-79e6-47ac-bf95-611e70b29c19"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:26:48.443756 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443719 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbd65\" (UniqueName: \"kubernetes.io/projected/5df628f8-a665-43da-bc45-2b6d398ee1b0-kube-api-access-zbd65\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:48.443756 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443751 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:48.443961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443767 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdwjs\" (UniqueName: \"kubernetes.io/projected/452d2f4f-79e6-47ac-bf95-611e70b29c19-kube-api-access-zdwjs\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:48.443961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443779 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:48.443961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443787 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:48.443961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443794 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df628f8-a665-43da-bc45-2b6d398ee1b0-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:48.443961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443801 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnmvs\" (UniqueName: \"kubernetes.io/projected/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-kube-api-access-dnmvs\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:48.443961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443809 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/452d2f4f-79e6-47ac-bf95-611e70b29c19-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:48.443961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:48.443817 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:26:49.099469 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.099439 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" Jun 12 22:26:49.099469 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.099463 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt" event={"ID":"452d2f4f-79e6-47ac-bf95-611e70b29c19","Type":"ContainerDied","Data":"adaa25af940da408ea2f4725bfade1a7cba0235e087dbb8a1c61936194979a43"} Jun 12 22:26:49.099682 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.099512 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="adaa25af940da408ea2f4725bfade1a7cba0235e087dbb8a1c61936194979a43" Jun 12 22:26:49.101445 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.101423 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" Jun 12 22:26:49.101554 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.101421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n" event={"ID":"5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b","Type":"ContainerDied","Data":"4302f9bfa0d5c13c84fc59f5c18c54cd01cb1c7f8f264c2b7e39da9a5b5f175a"} Jun 12 22:26:49.101554 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.101538 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4302f9bfa0d5c13c84fc59f5c18c54cd01cb1c7f8f264c2b7e39da9a5b5f175a" Jun 12 22:26:49.103308 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.103287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" event={"ID":"5df628f8-a665-43da-bc45-2b6d398ee1b0","Type":"ContainerDied","Data":"ad585486ef68b209dd03f159db6f7af7836ba4c8d20ad58285b4de867d4d02e5"} Jun 12 22:26:49.103420 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.103312 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w" Jun 12 22:26:49.103420 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:26:49.103318 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad585486ef68b209dd03f159db6f7af7836ba4c8d20ad58285b4de867d4d02e5" Jun 12 22:27:01.808104 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808042 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk"] Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808383 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerName="util" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808395 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerName="util" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808403 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerName="extract" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808409 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerName="extract" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808416 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerName="pull" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808422 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerName="pull" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808428 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerName="extract" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808434 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerName="extract" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808441 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerName="pull" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808446 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerName="pull" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808455 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerName="pull" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808460 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerName="pull" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808467 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerName="util" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808472 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerName="util" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808477 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerName="pull" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808482 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerName="pull" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808489 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerName="extract" Jun 12 22:27:01.808490 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808494 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerName="extract" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808502 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerName="util" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808506 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerName="util" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808514 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerName="extract" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808519 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerName="extract" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808529 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerName="util" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808533 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerName="util" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808583 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b" containerName="extract" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808591 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df628f8-a665-43da-bc45-2b6d398ee1b0" containerName="extract" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808598 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="13304b68-e9ad-4ab5-aa8f-6b819dfc9d33" containerName="extract" Jun 12 22:27:01.809115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.808604 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="452d2f4f-79e6-47ac-bf95-611e70b29c19" containerName="extract" Jun 12 22:27:01.811918 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.811898 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" Jun 12 22:27:01.814551 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.814529 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 22:27:01.814551 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.814529 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 12 22:27:01.815464 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.815447 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 22:27:01.815568 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.815451 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5f6j4\"" Jun 12 22:27:01.822252 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.822227 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk"] Jun 12 22:27:01.963714 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:01.963676 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h757d\" (UniqueName: \"kubernetes.io/projected/3ac4db84-2960-4679-b2b8-65f4b91109a4-kube-api-access-h757d\") pod \"dns-operator-controller-manager-864dd78c4c-gpdgk\" (UID: \"3ac4db84-2960-4679-b2b8-65f4b91109a4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" Jun 12 22:27:02.064726 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:02.064620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h757d\" (UniqueName: \"kubernetes.io/projected/3ac4db84-2960-4679-b2b8-65f4b91109a4-kube-api-access-h757d\") pod \"dns-operator-controller-manager-864dd78c4c-gpdgk\" (UID: \"3ac4db84-2960-4679-b2b8-65f4b91109a4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" Jun 12 22:27:02.077792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:02.077755 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h757d\" (UniqueName: \"kubernetes.io/projected/3ac4db84-2960-4679-b2b8-65f4b91109a4-kube-api-access-h757d\") pod \"dns-operator-controller-manager-864dd78c4c-gpdgk\" (UID: \"3ac4db84-2960-4679-b2b8-65f4b91109a4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" Jun 12 22:27:02.126737 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:02.126698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" Jun 12 22:27:02.266905 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:02.266880 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk"] Jun 12 22:27:02.268811 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:27:02.268777 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac4db84_2960_4679_b2b8_65f4b91109a4.slice/crio-75f5e907d73be444166e2f2de365b20a7857354585c220d8d881cb0143a61bbb WatchSource:0}: Error finding container 75f5e907d73be444166e2f2de365b20a7857354585c220d8d881cb0143a61bbb: Status 404 returned error can't find the container with id 75f5e907d73be444166e2f2de365b20a7857354585c220d8d881cb0143a61bbb Jun 12 22:27:03.183260 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:03.183203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" event={"ID":"3ac4db84-2960-4679-b2b8-65f4b91109a4","Type":"ContainerStarted","Data":"75f5e907d73be444166e2f2de365b20a7857354585c220d8d881cb0143a61bbb"} Jun 12 22:27:05.197994 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:05.197950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" event={"ID":"3ac4db84-2960-4679-b2b8-65f4b91109a4","Type":"ContainerStarted","Data":"db84eb2c85166f7e0229ccd776aef7d143f337cffcf47e9715697cd372acc77d"} Jun 12 22:27:05.198418 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:05.198094 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" Jun 12 22:27:05.218833 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:05.218781 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" podStartSLOduration=2.003155628 podStartE2EDuration="4.218764412s" totalImagesPullingTime="2.215608784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:27:05.216574953 +0000 UTC m=+384.255039274" watchObservedRunningTime="2026-06-12 22:27:05.218764412 +0000 UTC m=+384.257228732" Jun 12 22:27:10.610165 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:10.610128 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p"] Jun 12 22:27:10.614853 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:10.614831 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" Jun 12 22:27:10.618037 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:10.617851 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zpcgj\"" Jun 12 22:27:10.625835 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:10.625803 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p"] Jun 12 22:27:10.744613 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:10.744578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq5vr\" (UniqueName: \"kubernetes.io/projected/b54e4979-01e5-401b-bc91-e9b88d43d0f2-kube-api-access-gq5vr\") pod \"authorino-operator-75cc8d5cb7-ckb8p\" (UID: \"b54e4979-01e5-401b-bc91-e9b88d43d0f2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" Jun 12 22:27:10.845127 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:10.845064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq5vr\" (UniqueName: \"kubernetes.io/projected/b54e4979-01e5-401b-bc91-e9b88d43d0f2-kube-api-access-gq5vr\") pod \"authorino-operator-75cc8d5cb7-ckb8p\" (UID: \"b54e4979-01e5-401b-bc91-e9b88d43d0f2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" Jun 12 22:27:10.854319 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:10.854288 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq5vr\" (UniqueName: \"kubernetes.io/projected/b54e4979-01e5-401b-bc91-e9b88d43d0f2-kube-api-access-gq5vr\") pod \"authorino-operator-75cc8d5cb7-ckb8p\" (UID: \"b54e4979-01e5-401b-bc91-e9b88d43d0f2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" Jun 12 22:27:10.929566 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:10.929476 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" Jun 12 22:27:11.067463 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:11.067437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p"] Jun 12 22:27:11.069198 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:27:11.069165 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54e4979_01e5_401b_bc91_e9b88d43d0f2.slice/crio-d337fbb3c8e4ab9044019f335c6eb99cf1c5a17f8ff8578f2ceb699c3f635230 WatchSource:0}: Error finding container d337fbb3c8e4ab9044019f335c6eb99cf1c5a17f8ff8578f2ceb699c3f635230: Status 404 returned error can't find the container with id d337fbb3c8e4ab9044019f335c6eb99cf1c5a17f8ff8578f2ceb699c3f635230 Jun 12 22:27:11.230115 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:11.230060 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" event={"ID":"b54e4979-01e5-401b-bc91-e9b88d43d0f2","Type":"ContainerStarted","Data":"d337fbb3c8e4ab9044019f335c6eb99cf1c5a17f8ff8578f2ceb699c3f635230"} Jun 12 22:27:14.250592 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:14.250545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" event={"ID":"b54e4979-01e5-401b-bc91-e9b88d43d0f2","Type":"ContainerStarted","Data":"813e2834b77c3877da7ceeb0e7452572bc5ef4f406ddb55087ec3145c4be51cd"} Jun 12 22:27:14.250970 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:14.250631 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" Jun 12 22:27:14.269924 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:14.269870 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" podStartSLOduration=2.082700296 podStartE2EDuration="4.269854431s" totalImagesPullingTime="2.187154135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:27:14.266725749 +0000 UTC m=+393.305190083" watchObservedRunningTime="2026-06-12 22:27:14.269854431 +0000 UTC m=+393.308318791" Jun 12 22:27:16.206538 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:16.206509 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-gpdgk" Jun 12 22:27:18.020238 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.020198 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8c79d5c9-rnkz7"] Jun 12 22:27:18.025056 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.025032 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.038526 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.038500 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8c79d5c9-rnkz7"] Jun 12 22:27:18.211267 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.211225 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59mnq\" (UniqueName: \"kubernetes.io/projected/17fd8981-b6bd-43f6-af5c-6698c7345ba8-kube-api-access-59mnq\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.211450 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.211277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-config\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.211450 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.211360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-oauth-serving-cert\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.211450 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.211402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-oauth-config\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.211450 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.211421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-service-ca\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.211600 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.211481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-serving-cert\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.211600 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.211515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-trusted-ca-bundle\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.312504 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.312406 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59mnq\" (UniqueName: \"kubernetes.io/projected/17fd8981-b6bd-43f6-af5c-6698c7345ba8-kube-api-access-59mnq\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.312504 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.312457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-config\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.312739 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.312511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-oauth-serving-cert\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.312739 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.312546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-oauth-config\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.312739 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.312572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-service-ca\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.312739 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.312621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-serving-cert\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.312739 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.312664 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-trusted-ca-bundle\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.313336 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.313304 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-config\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.313449 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.313315 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-oauth-serving-cert\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.313449 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.313421 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-service-ca\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.313641 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.313621 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17fd8981-b6bd-43f6-af5c-6698c7345ba8-trusted-ca-bundle\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.315153 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.315127 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-oauth-config\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.315378 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.315354 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17fd8981-b6bd-43f6-af5c-6698c7345ba8-console-serving-cert\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.320572 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.320550 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59mnq\" (UniqueName: \"kubernetes.io/projected/17fd8981-b6bd-43f6-af5c-6698c7345ba8-kube-api-access-59mnq\") pod \"console-b8c79d5c9-rnkz7\" (UID: \"17fd8981-b6bd-43f6-af5c-6698c7345ba8\") " pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.334651 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.334621 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:18.478850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:18.478821 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8c79d5c9-rnkz7"] Jun 12 22:27:18.481221 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:27:18.481194 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17fd8981_b6bd_43f6_af5c_6698c7345ba8.slice/crio-3b4708cc0428402b04bb483d99271c9525c641cc40842173c83f0ba35a894ec6 WatchSource:0}: Error finding container 3b4708cc0428402b04bb483d99271c9525c641cc40842173c83f0ba35a894ec6: Status 404 returned error can't find the container with id 3b4708cc0428402b04bb483d99271c9525c641cc40842173c83f0ba35a894ec6 Jun 12 22:27:19.279794 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:19.279758 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c79d5c9-rnkz7" event={"ID":"17fd8981-b6bd-43f6-af5c-6698c7345ba8","Type":"ContainerStarted","Data":"72911121f0782c4b15b292e63c85abb4583272c12a4a4aa17522862b8fd27baa"} Jun 12 22:27:19.280208 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:19.279819 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8c79d5c9-rnkz7" event={"ID":"17fd8981-b6bd-43f6-af5c-6698c7345ba8","Type":"ContainerStarted","Data":"3b4708cc0428402b04bb483d99271c9525c641cc40842173c83f0ba35a894ec6"} Jun 12 22:27:19.302508 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:19.302449 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b8c79d5c9-rnkz7" podStartSLOduration=2.302434322 podStartE2EDuration="2.302434322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:27:19.300513697 +0000 UTC m=+398.338978019" watchObservedRunningTime="2026-06-12 22:27:19.302434322 +0000 UTC m=+398.340898642" Jun 12 22:27:25.258732 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:25.258701 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ckb8p" Jun 12 22:27:28.335626 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:28.335592 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:28.336059 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:28.335652 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:28.340833 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:28.340805 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:29.336751 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:29.336725 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b8c79d5c9-rnkz7" Jun 12 22:27:29.402814 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:29.402782 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7977c87887-qz692"] Jun 12 22:27:54.425143 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.425076 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7977c87887-qz692" podUID="b31d748a-13ba-4559-9f34-8c30d86f7e13" containerName="console" containerID="cri-o://f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083" gracePeriod=15 Jun 12 22:27:54.671159 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.671136 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7977c87887-qz692" Jun 12 22:27:54.847226 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847188 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-oauth-serving-cert\") pod \"b31d748a-13ba-4559-9f34-8c30d86f7e13\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " Jun 12 22:27:54.847226 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847231 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg7pg\" (UniqueName: \"kubernetes.io/projected/b31d748a-13ba-4559-9f34-8c30d86f7e13-kube-api-access-mg7pg\") pod \"b31d748a-13ba-4559-9f34-8c30d86f7e13\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " Jun 12 22:27:54.847479 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847258 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-serving-cert\") pod \"b31d748a-13ba-4559-9f34-8c30d86f7e13\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " Jun 12 22:27:54.847479 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847287 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-service-ca\") pod \"b31d748a-13ba-4559-9f34-8c30d86f7e13\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " Jun 12 22:27:54.847479 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847350 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-config\") pod \"b31d748a-13ba-4559-9f34-8c30d86f7e13\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " Jun 12 22:27:54.847479 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847401 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-trusted-ca-bundle\") pod \"b31d748a-13ba-4559-9f34-8c30d86f7e13\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " Jun 12 22:27:54.847479 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847433 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-oauth-config\") pod \"b31d748a-13ba-4559-9f34-8c30d86f7e13\" (UID: \"b31d748a-13ba-4559-9f34-8c30d86f7e13\") " Jun 12 22:27:54.847776 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847701 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b31d748a-13ba-4559-9f34-8c30d86f7e13" (UID: "b31d748a-13ba-4559-9f34-8c30d86f7e13"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:27:54.847870 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847846 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b31d748a-13ba-4559-9f34-8c30d86f7e13" (UID: "b31d748a-13ba-4559-9f34-8c30d86f7e13"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:27:54.847930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.847872 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-config" (OuterVolumeSpecName: "console-config") pod "b31d748a-13ba-4559-9f34-8c30d86f7e13" (UID: "b31d748a-13ba-4559-9f34-8c30d86f7e13"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:27:54.848177 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.848144 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-service-ca" (OuterVolumeSpecName: "service-ca") pod "b31d748a-13ba-4559-9f34-8c30d86f7e13" (UID: "b31d748a-13ba-4559-9f34-8c30d86f7e13"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:27:54.849681 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.849650 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b31d748a-13ba-4559-9f34-8c30d86f7e13" (UID: "b31d748a-13ba-4559-9f34-8c30d86f7e13"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:27:54.849681 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.849669 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b31d748a-13ba-4559-9f34-8c30d86f7e13" (UID: "b31d748a-13ba-4559-9f34-8c30d86f7e13"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 22:27:54.849681 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.849650 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31d748a-13ba-4559-9f34-8c30d86f7e13-kube-api-access-mg7pg" (OuterVolumeSpecName: "kube-api-access-mg7pg") pod "b31d748a-13ba-4559-9f34-8c30d86f7e13" (UID: "b31d748a-13ba-4559-9f34-8c30d86f7e13"). InnerVolumeSpecName "kube-api-access-mg7pg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:27:54.949061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.949014 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-oauth-serving-cert\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:27:54.949061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.949051 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg7pg\" (UniqueName: \"kubernetes.io/projected/b31d748a-13ba-4559-9f34-8c30d86f7e13-kube-api-access-mg7pg\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:27:54.949061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.949066 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-serving-cert\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:27:54.949327 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.949078 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-service-ca\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:27:54.949327 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.949108 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-config\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:27:54.949327 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.949119 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b31d748a-13ba-4559-9f34-8c30d86f7e13-trusted-ca-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:27:54.949327 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:54.949133 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b31d748a-13ba-4559-9f34-8c30d86f7e13-console-oauth-config\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:27:55.471664 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.471629 2580 generic.go:356] "Generic (PLEG): container finished" podID="b31d748a-13ba-4559-9f34-8c30d86f7e13" containerID="f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083" exitCode=0 Jun 12 22:27:55.472150 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.471686 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7977c87887-qz692" Jun 12 22:27:55.472150 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.471712 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7977c87887-qz692" event={"ID":"b31d748a-13ba-4559-9f34-8c30d86f7e13","Type":"ContainerDied","Data":"f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083"} Jun 12 22:27:55.472150 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.471777 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7977c87887-qz692" event={"ID":"b31d748a-13ba-4559-9f34-8c30d86f7e13","Type":"ContainerDied","Data":"07254120c9e7abde93640906af3db391aabf0e1c67323e6541d846668a80bc20"} Jun 12 22:27:55.472150 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.471812 2580 scope.go:117] "RemoveContainer" containerID="f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083" Jun 12 22:27:55.480460 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.480440 2580 scope.go:117] "RemoveContainer" containerID="f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083" Jun 12 22:27:55.480737 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:27:55.480721 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083\": container with ID starting with f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083 not found: ID does not exist" containerID="f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083" Jun 12 22:27:55.480791 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.480745 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083"} err="failed to get container status \"f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083\": rpc error: code = NotFound desc = could not find container \"f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083\": container with ID starting with f060c1bff2f9e3bee0891c479a1567f15ab29e0478520fb9818ccf81f9ce9083 not found: ID does not exist" Jun 12 22:27:55.495729 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.495695 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7977c87887-qz692"] Jun 12 22:27:55.502152 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:55.502115 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7977c87887-qz692"] Jun 12 22:27:57.418671 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:27:57.418638 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31d748a-13ba-4559-9f34-8c30d86f7e13" path="/var/lib/kubelet/pods/b31d748a-13ba-4559-9f34-8c30d86f7e13/volumes" Jun 12 22:28:11.339605 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.339352 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx"] Jun 12 22:28:11.340711 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.340683 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31d748a-13ba-4559-9f34-8c30d86f7e13" containerName="console" Jun 12 22:28:11.340851 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.340840 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31d748a-13ba-4559-9f34-8c30d86f7e13" containerName="console" Jun 12 22:28:11.341026 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.341015 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31d748a-13ba-4559-9f34-8c30d86f7e13" containerName="console" Jun 12 22:28:11.350025 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.349997 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.352217 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.352188 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx"] Jun 12 22:28:11.352923 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.352900 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7bmfn\"" Jun 12 22:28:11.387569 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387530 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.387741 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387576 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.387741 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387694 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.387741 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.387910 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.387910 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387784 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.387910 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.387910 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387835 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.387910 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.387887 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r6f2\" (UniqueName: \"kubernetes.io/projected/5adca4b6-c15a-4122-9c02-7732ccc02dd8-kube-api-access-7r6f2\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.488596 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.488596 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.488850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.488850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.488850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488706 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.488850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.488850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.488850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488844 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.489175 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.488898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r6f2\" (UniqueName: \"kubernetes.io/projected/5adca4b6-c15a-4122-9c02-7732ccc02dd8-kube-api-access-7r6f2\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.489175 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.489156 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.489255 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.489226 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.489319 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.489291 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.489404 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.489383 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.489850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.489827 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.491301 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.491279 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.491380 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.491299 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.496961 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.496932 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5adca4b6-c15a-4122-9c02-7732ccc02dd8-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.497099 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.497064 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r6f2\" (UniqueName: \"kubernetes.io/projected/5adca4b6-c15a-4122-9c02-7732ccc02dd8-kube-api-access-7r6f2\") pod \"maas-default-gateway-openshift-default-8559cd5744-95wdx\" (UID: \"5adca4b6-c15a-4122-9c02-7732ccc02dd8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.662684 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.662587 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:11.819069 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.819040 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx"] Jun 12 22:28:11.821575 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:28:11.821549 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5adca4b6_c15a_4122_9c02_7732ccc02dd8.slice/crio-12d9cf5147d5f600c97d8d455dd7b776e2bf26acbe79c20b4928aa02651d6afe WatchSource:0}: Error finding container 12d9cf5147d5f600c97d8d455dd7b776e2bf26acbe79c20b4928aa02651d6afe: Status 404 returned error can't find the container with id 12d9cf5147d5f600c97d8d455dd7b776e2bf26acbe79c20b4928aa02651d6afe Jun 12 22:28:11.824132 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.824102 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:28:11.824232 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.824169 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:28:11.824232 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:11.824202 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:28:12.577750 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:12.577715 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" event={"ID":"5adca4b6-c15a-4122-9c02-7732ccc02dd8","Type":"ContainerStarted","Data":"b65a697d78d8448e8a84c7629419dc6c4dc6ae7ca105dbfc737f02a8d9dc7599"} Jun 12 22:28:12.578149 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:12.577763 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" event={"ID":"5adca4b6-c15a-4122-9c02-7732ccc02dd8","Type":"ContainerStarted","Data":"12d9cf5147d5f600c97d8d455dd7b776e2bf26acbe79c20b4928aa02651d6afe"} Jun 12 22:28:12.599938 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:12.599879 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" podStartSLOduration=1.599858218 podStartE2EDuration="1.599858218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:28:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:28:12.597260037 +0000 UTC m=+451.635724398" watchObservedRunningTime="2026-06-12 22:28:12.599858218 +0000 UTC m=+451.638322539" Jun 12 22:28:12.663766 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:12.663735 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:12.668661 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:12.668636 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:13.583641 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:13.583595 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:13.584525 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:13.584503 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:28:14.799496 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.799455 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:28:14.803157 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.803134 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:14.805735 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.805713 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 22:28:14.805849 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.805713 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ctwcv\"" Jun 12 22:28:14.814123 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.814099 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:28:14.820896 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.820871 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzx9\" (UniqueName: \"kubernetes.io/projected/598d31b5-1e55-4484-bd73-3a88a351c14e-kube-api-access-jfzx9\") pod \"limitador-limitador-54d6d988d5-h4qpl\" (UID: \"598d31b5-1e55-4484-bd73-3a88a351c14e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:14.821018 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.820925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/598d31b5-1e55-4484-bd73-3a88a351c14e-config-file\") pod \"limitador-limitador-54d6d988d5-h4qpl\" (UID: \"598d31b5-1e55-4484-bd73-3a88a351c14e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:14.843984 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.843951 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:28:14.921848 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.921818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/598d31b5-1e55-4484-bd73-3a88a351c14e-config-file\") pod \"limitador-limitador-54d6d988d5-h4qpl\" (UID: \"598d31b5-1e55-4484-bd73-3a88a351c14e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:14.922034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.921885 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzx9\" (UniqueName: \"kubernetes.io/projected/598d31b5-1e55-4484-bd73-3a88a351c14e-kube-api-access-jfzx9\") pod \"limitador-limitador-54d6d988d5-h4qpl\" (UID: \"598d31b5-1e55-4484-bd73-3a88a351c14e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:14.922502 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.922484 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/598d31b5-1e55-4484-bd73-3a88a351c14e-config-file\") pod \"limitador-limitador-54d6d988d5-h4qpl\" (UID: \"598d31b5-1e55-4484-bd73-3a88a351c14e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:14.930123 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:14.930074 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzx9\" (UniqueName: \"kubernetes.io/projected/598d31b5-1e55-4484-bd73-3a88a351c14e-kube-api-access-jfzx9\") pod \"limitador-limitador-54d6d988d5-h4qpl\" (UID: \"598d31b5-1e55-4484-bd73-3a88a351c14e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:15.116297 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:15.116216 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:15.255167 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:15.255137 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:28:15.256769 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:28:15.256740 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod598d31b5_1e55_4484_bd73_3a88a351c14e.slice/crio-e9e3c60567040ac588557c226bb4d6ffa695e2b9fa5ecbfc72aad2aae5603f47 WatchSource:0}: Error finding container e9e3c60567040ac588557c226bb4d6ffa695e2b9fa5ecbfc72aad2aae5603f47: Status 404 returned error can't find the container with id e9e3c60567040ac588557c226bb4d6ffa695e2b9fa5ecbfc72aad2aae5603f47 Jun 12 22:28:15.596368 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:15.596335 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" event={"ID":"598d31b5-1e55-4484-bd73-3a88a351c14e","Type":"ContainerStarted","Data":"e9e3c60567040ac588557c226bb4d6ffa695e2b9fa5ecbfc72aad2aae5603f47"} Jun 12 22:28:18.616034 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:18.615996 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" event={"ID":"598d31b5-1e55-4484-bd73-3a88a351c14e","Type":"ContainerStarted","Data":"9c505215f85eb0c33a142d1acd8bd918f252f6e92d7d0f062f5733bccebeffe0"} Jun 12 22:28:18.616475 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:18.616139 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:18.635633 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:18.635574 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" podStartSLOduration=1.965610885 podStartE2EDuration="4.635559122s" totalImagesPullingTime="2.669948237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:28:18.633632585 +0000 UTC m=+457.672096931" watchObservedRunningTime="2026-06-12 22:28:18.635559122 +0000 UTC m=+457.674023443" Jun 12 22:28:29.622928 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:29.622892 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h4qpl" Jun 12 22:28:45.150822 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.150785 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2"] Jun 12 22:28:45.159238 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.159215 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.162346 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.162304 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 12 22:28:45.162346 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.162318 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 12 22:28:45.162566 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.162367 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wp7nm\"" Jun 12 22:28:45.163683 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.163656 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2"] Jun 12 22:28:45.292095 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.292056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4wcm\" (UniqueName: \"kubernetes.io/projected/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-kube-api-access-g4wcm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.292306 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.292124 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.292306 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.292228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.393021 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.392980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4wcm\" (UniqueName: \"kubernetes.io/projected/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-kube-api-access-g4wcm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.393021 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.393024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.393296 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.393060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.393434 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.393413 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.393506 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.393487 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.406458 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.406379 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4wcm\" (UniqueName: \"kubernetes.io/projected/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-kube-api-access-g4wcm\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.470749 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.470695 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:45.613895 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.613871 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2"] Jun 12 22:28:45.616008 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:28:45.615985 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0653776e_2ab0_4bf9_9ef1_139b417a2f8b.slice/crio-9e6dea89e95fb3d5830c398dd5d0b468ce200f77617644eefc9a3173e871c9a1 WatchSource:0}: Error finding container 9e6dea89e95fb3d5830c398dd5d0b468ce200f77617644eefc9a3173e871c9a1: Status 404 returned error can't find the container with id 9e6dea89e95fb3d5830c398dd5d0b468ce200f77617644eefc9a3173e871c9a1 Jun 12 22:28:45.767792 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.767756 2580 generic.go:356] "Generic (PLEG): container finished" podID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerID="ca39230043843b3f32cf2a0a5417a8eea84dd8d82b05cb3358a20195613f65e0" exitCode=0 Jun 12 22:28:45.767952 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.767804 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" event={"ID":"0653776e-2ab0-4bf9-9ef1-139b417a2f8b","Type":"ContainerDied","Data":"ca39230043843b3f32cf2a0a5417a8eea84dd8d82b05cb3358a20195613f65e0"} Jun 12 22:28:45.767952 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:45.767856 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" event={"ID":"0653776e-2ab0-4bf9-9ef1-139b417a2f8b","Type":"ContainerStarted","Data":"9e6dea89e95fb3d5830c398dd5d0b468ce200f77617644eefc9a3173e871c9a1"} Jun 12 22:28:46.775708 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:46.775670 2580 generic.go:356] "Generic (PLEG): container finished" podID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerID="fc710da102c7afd5a52cc89fc6be16fe9ad458442f839a810d94a52ee307b738" exitCode=0 Jun 12 22:28:46.776170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:46.775741 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" event={"ID":"0653776e-2ab0-4bf9-9ef1-139b417a2f8b","Type":"ContainerDied","Data":"fc710da102c7afd5a52cc89fc6be16fe9ad458442f839a810d94a52ee307b738"} Jun 12 22:28:47.784334 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:47.784295 2580 generic.go:356] "Generic (PLEG): container finished" podID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerID="819f4d8f04861eb8a3f800744654d5bdb8fbf4e6bb2013b6672a35f21dbb6a2e" exitCode=0 Jun 12 22:28:47.784725 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:47.784373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" event={"ID":"0653776e-2ab0-4bf9-9ef1-139b417a2f8b","Type":"ContainerDied","Data":"819f4d8f04861eb8a3f800744654d5bdb8fbf4e6bb2013b6672a35f21dbb6a2e"} Jun 12 22:28:48.924594 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:48.924567 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:49.030398 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.030358 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-bundle\") pod \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " Jun 12 22:28:49.030595 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.030468 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4wcm\" (UniqueName: \"kubernetes.io/projected/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-kube-api-access-g4wcm\") pod \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " Jun 12 22:28:49.030595 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.030552 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-util\") pod \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\" (UID: \"0653776e-2ab0-4bf9-9ef1-139b417a2f8b\") " Jun 12 22:28:49.030983 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.030959 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-bundle" (OuterVolumeSpecName: "bundle") pod "0653776e-2ab0-4bf9-9ef1-139b417a2f8b" (UID: "0653776e-2ab0-4bf9-9ef1-139b417a2f8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:28:49.032785 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.032754 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-kube-api-access-g4wcm" (OuterVolumeSpecName: "kube-api-access-g4wcm") pod "0653776e-2ab0-4bf9-9ef1-139b417a2f8b" (UID: "0653776e-2ab0-4bf9-9ef1-139b417a2f8b"). InnerVolumeSpecName "kube-api-access-g4wcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:28:49.036225 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.036187 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-util" (OuterVolumeSpecName: "util") pod "0653776e-2ab0-4bf9-9ef1-139b417a2f8b" (UID: "0653776e-2ab0-4bf9-9ef1-139b417a2f8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:28:49.131426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.131342 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-bundle\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:28:49.131426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.131374 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4wcm\" (UniqueName: \"kubernetes.io/projected/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-kube-api-access-g4wcm\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:28:49.131426 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.131384 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0653776e-2ab0-4bf9-9ef1-139b417a2f8b-util\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:28:49.797266 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.797233 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" Jun 12 22:28:49.797447 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.797239 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7489grh2" event={"ID":"0653776e-2ab0-4bf9-9ef1-139b417a2f8b","Type":"ContainerDied","Data":"9e6dea89e95fb3d5830c398dd5d0b468ce200f77617644eefc9a3173e871c9a1"} Jun 12 22:28:49.797447 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:28:49.797352 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e6dea89e95fb3d5830c398dd5d0b468ce200f77617644eefc9a3173e871c9a1" Jun 12 22:30:16.859282 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.859243 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-gp4gs"] Jun 12 22:30:16.859747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.859627 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerName="util" Jun 12 22:30:16.859747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.859639 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerName="util" Jun 12 22:30:16.859747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.859652 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerName="extract" Jun 12 22:30:16.859747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.859662 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerName="extract" Jun 12 22:30:16.859747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.859685 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerName="pull" Jun 12 22:30:16.859747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.859690 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerName="pull" Jun 12 22:30:16.859747 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.859746 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0653776e-2ab0-4bf9-9ef1-139b417a2f8b" containerName="extract" Jun 12 22:30:16.862823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.862806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" Jun 12 22:30:16.865351 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.865329 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 22:30:16.865478 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.865412 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-64k7p\"" Jun 12 22:30:16.879455 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.879431 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-gp4gs"] Jun 12 22:30:16.927834 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.927796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlx6h\" (UniqueName: \"kubernetes.io/projected/fecd1ea6-9473-47af-a496-2b8c839691ca-kube-api-access-wlx6h\") pod \"payload-pre-processing-579785bc64-gp4gs\" (UID: \"fecd1ea6-9473-47af-a496-2b8c839691ca\") " pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" Jun 12 22:30:16.942227 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:16.942194 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:30:17.028643 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:17.028603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlx6h\" (UniqueName: \"kubernetes.io/projected/fecd1ea6-9473-47af-a496-2b8c839691ca-kube-api-access-wlx6h\") pod \"payload-pre-processing-579785bc64-gp4gs\" (UID: \"fecd1ea6-9473-47af-a496-2b8c839691ca\") " pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" Jun 12 22:30:17.045650 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:17.045614 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlx6h\" (UniqueName: \"kubernetes.io/projected/fecd1ea6-9473-47af-a496-2b8c839691ca-kube-api-access-wlx6h\") pod \"payload-pre-processing-579785bc64-gp4gs\" (UID: \"fecd1ea6-9473-47af-a496-2b8c839691ca\") " pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" Jun 12 22:30:17.174032 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:17.173930 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" Jun 12 22:30:17.320315 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:17.320281 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-gp4gs"] Jun 12 22:30:17.321422 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:30:17.321396 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecd1ea6_9473_47af_a496_2b8c839691ca.slice/crio-a95e9609d73f0e6fb214d550bf9325d8cdb6adaf7abf4c71fe49c5ed57622d7e WatchSource:0}: Error finding container a95e9609d73f0e6fb214d550bf9325d8cdb6adaf7abf4c71fe49c5ed57622d7e: Status 404 returned error can't find the container with id a95e9609d73f0e6fb214d550bf9325d8cdb6adaf7abf4c71fe49c5ed57622d7e Jun 12 22:30:18.294930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:18.294896 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" event={"ID":"fecd1ea6-9473-47af-a496-2b8c839691ca","Type":"ContainerStarted","Data":"a95e9609d73f0e6fb214d550bf9325d8cdb6adaf7abf4c71fe49c5ed57622d7e"} Jun 12 22:30:20.316346 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:20.315284 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" event={"ID":"fecd1ea6-9473-47af-a496-2b8c839691ca","Type":"ContainerStarted","Data":"4b0b7d8cb22c61a010b3931dcbe65d770f47fbdf81a0c9723155ee056eb9a2a1"} Jun 12 22:30:20.316346 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:20.316221 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" Jun 12 22:30:20.333943 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:20.333877 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" podStartSLOduration=1.594766321 podStartE2EDuration="4.333839847s" totalImagesPullingTime="2.739073526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:30:20.33197806 +0000 UTC m=+579.370442386" watchObservedRunningTime="2026-06-12 22:30:20.333839847 +0000 UTC m=+579.372304169" Jun 12 22:30:24.363283 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:24.363201 2580 generic.go:356] "Generic (PLEG): container finished" podID="5adca4b6-c15a-4122-9c02-7732ccc02dd8" containerID="b65a697d78d8448e8a84c7629419dc6c4dc6ae7ca105dbfc737f02a8d9dc7599" exitCode=0 Jun 12 22:30:24.363658 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:24.363278 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" event={"ID":"5adca4b6-c15a-4122-9c02-7732ccc02dd8","Type":"ContainerDied","Data":"b65a697d78d8448e8a84c7629419dc6c4dc6ae7ca105dbfc737f02a8d9dc7599"} Jun 12 22:30:24.363713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:24.363699 2580 scope.go:117] "RemoveContainer" containerID="b65a697d78d8448e8a84c7629419dc6c4dc6ae7ca105dbfc737f02a8d9dc7599" Jun 12 22:30:24.364713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:24.364689 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:30:24.364768 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:24.364755 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:30:24.364804 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:24.364790 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:30:25.371037 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:25.371005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" event={"ID":"5adca4b6-c15a-4122-9c02-7732ccc02dd8","Type":"ContainerStarted","Data":"c6ae42793424ade015cd9e33847a3fbc1eec86c1456f69ec677309dee563a37b"} Jun 12 22:30:25.663600 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:25.663506 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:30:25.664757 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:25.664731 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-95wdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 12 22:30:25.664871 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:25.664797 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" podUID="5adca4b6-c15a-4122-9c02-7732ccc02dd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 12 22:30:26.663245 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:26.663204 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-95wdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 12 22:30:26.663653 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:26.663265 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" podUID="5adca4b6-c15a-4122-9c02-7732ccc02dd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 12 22:30:27.663965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:27.663918 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-95wdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 12 22:30:27.664365 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:27.663982 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" podUID="5adca4b6-c15a-4122-9c02-7732ccc02dd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 12 22:30:28.584297 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:28.584257 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:30:28.663345 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:28.663310 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-95wdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 12 22:30:28.663522 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:28.663364 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" podUID="5adca4b6-c15a-4122-9c02-7732ccc02dd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 12 22:30:29.667319 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:29.667290 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:30:29.668466 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:29.668448 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-95wdx" Jun 12 22:30:32.351849 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:32.351812 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-gp4gs" Jun 12 22:30:41.416775 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:41.416738 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:30:41.419497 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:30:41.419469 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:33:24.599225 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:33:24.599188 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:33:39.009021 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:33:39.008984 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:34:01.277263 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:34:01.277178 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:34:17.573589 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:34:17.573556 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:34:24.674055 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:34:24.674012 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:34:43.167043 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:34:43.167002 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:35:41.460362 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:35:41.460332 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:35:41.462736 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:35:41.462702 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:36:42.778051 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:36:42.778009 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:36:52.674593 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:36:52.674553 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:37:02.091513 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:37:02.091421 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:37:12.676995 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:37:12.676957 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:37:21.374050 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:37:21.374010 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:37:32.379014 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:37:32.378974 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:38:45.377540 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:38:45.377452 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:39:00.971677 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:39:00.971634 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:39:39.768729 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:39:39.768685 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:39:56.668997 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:39:56.668956 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:40:11.172173 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:40:11.172070 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:40:27.069530 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:40:27.069487 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:40:41.503004 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:40:41.502976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:40:41.512146 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:40:41.512122 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:41:26.569829 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:41:26.569791 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:41:35.476609 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:41:35.476511 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:41:52.371386 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:41:52.371351 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:42:00.764856 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:42:00.764817 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:42:18.380233 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:42:18.380190 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:42:26.469711 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:42:26.469677 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:42:58.975468 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:42:58.975385 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:43:07.972735 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:43:07.972694 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:43:16.673288 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:43:16.673255 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:43:24.271207 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:43:24.271165 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:43:32.766635 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:43:32.766596 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:43:58.175282 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:43:58.175248 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:44:10.367988 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:44:10.367942 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:44:57.686149 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:44:57.686038 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:45:00.149758 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.149718 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688405-qwn77"] Jun 12 22:45:00.152507 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.152489 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" Jun 12 22:45:00.155377 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.155358 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-g4sz4\"" Jun 12 22:45:00.173907 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.173881 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688405-qwn77"] Jun 12 22:45:00.249580 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.249542 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb7qk\" (UniqueName: \"kubernetes.io/projected/98bbd20f-b512-4cf0-b87a-506933c69c94-kube-api-access-cb7qk\") pod \"maas-api-key-cleanup-29688405-qwn77\" (UID: \"98bbd20f-b512-4cf0-b87a-506933c69c94\") " pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" Jun 12 22:45:00.350999 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.350968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb7qk\" (UniqueName: \"kubernetes.io/projected/98bbd20f-b512-4cf0-b87a-506933c69c94-kube-api-access-cb7qk\") pod \"maas-api-key-cleanup-29688405-qwn77\" (UID: \"98bbd20f-b512-4cf0-b87a-506933c69c94\") " pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" Jun 12 22:45:00.360114 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.360068 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb7qk\" (UniqueName: \"kubernetes.io/projected/98bbd20f-b512-4cf0-b87a-506933c69c94-kube-api-access-cb7qk\") pod \"maas-api-key-cleanup-29688405-qwn77\" (UID: \"98bbd20f-b512-4cf0-b87a-506933c69c94\") " pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" Jun 12 22:45:00.462648 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.462558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" Jun 12 22:45:00.604621 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.604590 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688405-qwn77"] Jun 12 22:45:00.606343 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:45:00.606306 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bbd20f_b512_4cf0_b87a_506933c69c94.slice/crio-cf5f7896ab937c9638968c630eb8363a3ed36f8eaa3b431df37b7a35cd80ff48 WatchSource:0}: Error finding container cf5f7896ab937c9638968c630eb8363a3ed36f8eaa3b431df37b7a35cd80ff48: Status 404 returned error can't find the container with id cf5f7896ab937c9638968c630eb8363a3ed36f8eaa3b431df37b7a35cd80ff48 Jun 12 22:45:00.608354 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:00.608332 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:45:01.306383 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:01.306341 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" event={"ID":"98bbd20f-b512-4cf0-b87a-506933c69c94","Type":"ContainerStarted","Data":"cf5f7896ab937c9638968c630eb8363a3ed36f8eaa3b431df37b7a35cd80ff48"} Jun 12 22:45:04.330013 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:04.329978 2580 generic.go:356] "Generic (PLEG): container finished" podID="98bbd20f-b512-4cf0-b87a-506933c69c94" containerID="7db875b4d59f54365daf6eabbd9536b2cc85d970680bf25a45a46b3fe8ce14fd" exitCode=0 Jun 12 22:45:04.330457 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:04.330072 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" event={"ID":"98bbd20f-b512-4cf0-b87a-506933c69c94","Type":"ContainerDied","Data":"7db875b4d59f54365daf6eabbd9536b2cc85d970680bf25a45a46b3fe8ce14fd"} Jun 12 22:45:05.472794 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:05.472760 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" Jun 12 22:45:05.601572 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:05.601468 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb7qk\" (UniqueName: \"kubernetes.io/projected/98bbd20f-b512-4cf0-b87a-506933c69c94-kube-api-access-cb7qk\") pod \"98bbd20f-b512-4cf0-b87a-506933c69c94\" (UID: \"98bbd20f-b512-4cf0-b87a-506933c69c94\") " Jun 12 22:45:05.603808 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:05.603773 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98bbd20f-b512-4cf0-b87a-506933c69c94-kube-api-access-cb7qk" (OuterVolumeSpecName: "kube-api-access-cb7qk") pod "98bbd20f-b512-4cf0-b87a-506933c69c94" (UID: "98bbd20f-b512-4cf0-b87a-506933c69c94"). InnerVolumeSpecName "kube-api-access-cb7qk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:45:05.702659 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:05.702627 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb7qk\" (UniqueName: \"kubernetes.io/projected/98bbd20f-b512-4cf0-b87a-506933c69c94-kube-api-access-cb7qk\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:45:05.773365 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:05.773332 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:45:06.342677 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:06.342647 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" Jun 12 22:45:06.342677 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:06.342657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688405-qwn77" event={"ID":"98bbd20f-b512-4cf0-b87a-506933c69c94","Type":"ContainerDied","Data":"cf5f7896ab937c9638968c630eb8363a3ed36f8eaa3b431df37b7a35cd80ff48"} Jun 12 22:45:06.342885 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:06.342706 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf5f7896ab937c9638968c630eb8363a3ed36f8eaa3b431df37b7a35cd80ff48" Jun 12 22:45:24.476148 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:24.476111 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:45:29.370887 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:29.370847 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:45:33.264936 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:33.264903 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:45:41.549299 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:41.549267 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:45:41.558823 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:41.558795 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:45:42.080400 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:42.080353 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:45:50.571564 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:45:50.571526 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:46:00.076397 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:46:00.076313 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:46:08.671321 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:46:08.671281 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:46:17.574647 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:46:17.574609 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:46:25.778363 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:46:25.778322 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:46:34.371544 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:46:34.371505 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:46:42.575975 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:46:42.575938 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:49:07.675275 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:49:07.675177 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:49:12.471552 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:49:12.471501 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:49:38.271192 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:49:38.271153 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:49:43.172252 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:49:43.172207 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:49:49.970024 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:49:49.969991 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:50:00.773597 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:00.773563 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:50:10.669491 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:10.669450 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:50:20.173962 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:20.173920 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:50:28.872542 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:28.872460 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:50:38.673576 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:38.673539 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:50:41.585946 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:41.585920 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:50:41.603415 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:41.603380 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:50:49.170939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:49.170896 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:50:57.872190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:50:57.872153 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:51:07.874865 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:51:07.874823 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:51:12.571233 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:51:12.571197 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:51:40.665512 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:51:40.665471 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:52:24.571855 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:52:24.571766 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:52:31.873489 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:52:31.873448 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:52:42.173291 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:52:42.173257 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:52:49.671850 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:52:49.671809 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:52:58.504576 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:52:58.504541 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:53:10.814841 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:53:10.814804 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:53:19.882514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:53:19.882478 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:53:25.378742 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:53:25.378704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:53:31.985397 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:53:31.985317 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:53:40.290311 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:53:40.290274 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:53:48.594401 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:53:48.594362 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:53:59.221546 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:53:59.221504 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:54:18.284542 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:54:18.284506 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:54:25.684851 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:54:25.684811 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:54:34.487165 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:54:34.487124 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:54:42.274853 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:54:42.274810 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:54:59.982545 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:54:59.982449 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:55:07.672928 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:55:07.672888 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:55:17.098997 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:55:17.098956 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:55:25.689624 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:55:25.689588 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:55:34.676508 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:55:34.676470 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:55:41.628549 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:55:41.628523 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:55:41.642617 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:55:41.642586 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:55:43.182205 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:55:43.182168 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:55:52.078876 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:55:52.078839 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:56:02.936824 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:56:02.936786 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:56:13.469360 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:56:13.469320 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:56:25.262098 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:56:25.262045 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:56:35.575772 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:56:35.575687 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:56:40.267245 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:56:40.267206 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:56:50.269435 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:56:50.269393 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:56:54.270064 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:56:54.270025 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:57:11.068392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:57:11.068346 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:57:19.870341 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:57:19.870301 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:57:29.278514 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:57:29.278476 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:57:35.071673 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:57:35.071628 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:57:56.976062 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:57:56.976021 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:58:09.277403 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:09.277306 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:58:11.243974 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.243935 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8"] Jun 12 22:58:11.244670 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.244643 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98bbd20f-b512-4cf0-b87a-506933c69c94" containerName="cleanup" Jun 12 22:58:11.244760 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.244675 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="98bbd20f-b512-4cf0-b87a-506933c69c94" containerName="cleanup" Jun 12 22:58:11.244822 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.244784 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="98bbd20f-b512-4cf0-b87a-506933c69c94" containerName="cleanup" Jun 12 22:58:11.248525 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.248504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.250974 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.250952 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-856854ff-openshift-default-dockercfg-nbgx4\"" Jun 12 22:58:11.268618 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.268585 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8"] Jun 12 22:58:11.405335 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405298 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-token\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.405544 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405344 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-envoy\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.405544 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-data\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.405544 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405449 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-credential-socket\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.405544 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405485 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-certs\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.405705 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istiod-ca-cert\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.405705 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcw7g\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-kube-api-access-gcw7g\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.405705 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-podinfo\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.405848 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.405709 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-socket\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.506713 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.506581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-data\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.506888 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.506742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-credential-socket\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.506888 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.506773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-certs\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.506888 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.506872 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istiod-ca-cert\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.506899 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcw7g\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-kube-api-access-gcw7g\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.506926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-podinfo\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.506956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-socket\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.507018 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-token\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507316 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.507064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-envoy\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507316 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.507121 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-data\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507485 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.507461 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-certs\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507678 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.507655 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-credential-socket\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.507794 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.507764 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-socket\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.508020 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.507995 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istiod-ca-cert\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.509824 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.509800 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-envoy\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.510194 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.510176 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-podinfo\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.531117 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.531044 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-token\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.531304 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.531192 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcw7g\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-kube-api-access-gcw7g\") pod \"e2e-ait-856854ff-openshift-default-7b77d54846-w45n8\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.561105 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.561058 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:11.735992 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.735960 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8"] Jun 12 22:58:11.737772 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:58:11.737742 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe4ab1e_9580_4bda_b643_e9d8eca07672.slice/crio-d4e5f38da50c7998c66e44326af89cadf9d559316bd95cad8f274a0ea7d6c99f WatchSource:0}: Error finding container d4e5f38da50c7998c66e44326af89cadf9d559316bd95cad8f274a0ea7d6c99f: Status 404 returned error can't find the container with id d4e5f38da50c7998c66e44326af89cadf9d559316bd95cad8f274a0ea7d6c99f Jun 12 22:58:11.739958 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.739928 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:58:11.740052 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.739994 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:58:11.740052 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.740022 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:58:11.873252 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.873211 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" event={"ID":"dbe4ab1e-9580-4bda-b643-e9d8eca07672","Type":"ContainerStarted","Data":"5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad"} Jun 12 22:58:11.873420 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.873281 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" event={"ID":"dbe4ab1e-9580-4bda-b643-e9d8eca07672","Type":"ContainerStarted","Data":"d4e5f38da50c7998c66e44326af89cadf9d559316bd95cad8f274a0ea7d6c99f"} Jun 12 22:58:11.895584 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:11.895523 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" podStartSLOduration=0.895497672 podStartE2EDuration="895.497672ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:58:11.892057315 +0000 UTC m=+2250.930521637" watchObservedRunningTime="2026-06-12 22:58:11.895497672 +0000 UTC m=+2250.933961996" Jun 12 22:58:12.562172 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:12.562134 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:12.563838 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:12.563804 2580 patch_prober.go:28] interesting pod/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jun 12 22:58:12.563948 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:12.563872 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" podUID="dbe4ab1e-9580-4bda-b643-e9d8eca07672" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jun 12 22:58:13.473494 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:13.473456 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h4qpl"] Jun 12 22:58:13.566336 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:13.566303 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:13.885936 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:13.885844 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:13.886909 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:13.886892 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:19.197707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:19.197663 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8"] Jun 12 22:58:19.198190 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:19.197881 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" podUID="dbe4ab1e-9580-4bda-b643-e9d8eca07672" containerName="istio-proxy" containerID="cri-o://5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad" gracePeriod=30 Jun 12 22:58:24.461526 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.461460 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:24.524773 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.524739 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-envoy\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.524940 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.524786 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcw7g\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-kube-api-access-gcw7g\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.524940 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.524816 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-credential-socket\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.524940 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.524876 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istiod-ca-cert\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.524940 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.524918 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-token\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.525184 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.524940 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-data\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.525184 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525007 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-podinfo\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.525184 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525060 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-socket\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.525184 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525111 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-certs\") pod \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\" (UID: \"dbe4ab1e-9580-4bda-b643-e9d8eca07672\") " Jun 12 22:58:24.525184 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525166 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:24.525451 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525311 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-data" (OuterVolumeSpecName: "istio-data") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:24.525451 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525322 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:58:24.525451 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525395 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:24.525616 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525516 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-socket\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.525616 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525549 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-credential-socket\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.525616 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525558 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istiod-ca-cert\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.525616 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525567 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-data\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.525825 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.525607 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:24.527511 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.527482 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-token" (OuterVolumeSpecName: "istio-token") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:58:24.527627 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.527518 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 12 22:58:24.527673 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.527639 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:24.527673 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.527639 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-kube-api-access-gcw7g" (OuterVolumeSpecName: "kube-api-access-gcw7g") pod "dbe4ab1e-9580-4bda-b643-e9d8eca07672" (UID: "dbe4ab1e-9580-4bda-b643-e9d8eca07672"). InnerVolumeSpecName "kube-api-access-gcw7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:58:24.626356 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.626315 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-token\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.626356 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.626346 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-podinfo\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.626356 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.626355 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-workload-certs\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.626356 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.626363 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dbe4ab1e-9580-4bda-b643-e9d8eca07672-istio-envoy\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.626881 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.626374 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcw7g\" (UniqueName: \"kubernetes.io/projected/dbe4ab1e-9580-4bda-b643-e9d8eca07672-kube-api-access-gcw7g\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:24.952560 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.951514 2580 generic.go:356] "Generic (PLEG): container finished" podID="dbe4ab1e-9580-4bda-b643-e9d8eca07672" containerID="5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad" exitCode=0 Jun 12 22:58:24.952560 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.951689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" event={"ID":"dbe4ab1e-9580-4bda-b643-e9d8eca07672","Type":"ContainerDied","Data":"5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad"} Jun 12 22:58:24.952560 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.951738 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" event={"ID":"dbe4ab1e-9580-4bda-b643-e9d8eca07672","Type":"ContainerDied","Data":"d4e5f38da50c7998c66e44326af89cadf9d559316bd95cad8f274a0ea7d6c99f"} Jun 12 22:58:24.952560 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.951767 2580 scope.go:117] "RemoveContainer" containerID="5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad" Jun 12 22:58:24.952560 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.951939 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8" Jun 12 22:58:24.963048 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.963027 2580 scope.go:117] "RemoveContainer" containerID="5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad" Jun 12 22:58:24.963345 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:58:24.963327 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad\": container with ID starting with 5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad not found: ID does not exist" containerID="5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad" Jun 12 22:58:24.963422 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.963353 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad"} err="failed to get container status \"5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad\": rpc error: code = NotFound desc = could not find container \"5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad\": container with ID starting with 5191582125fe42021de22c4c48eac5361f351d74fa22215e469f17c38a72a8ad not found: ID does not exist" Jun 12 22:58:24.976373 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.976345 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8"] Jun 12 22:58:24.979989 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:24.979960 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-856854ff-openshift-default-7b77d54846-w45n8"] Jun 12 22:58:25.419196 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.419167 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe4ab1e-9580-4bda-b643-e9d8eca07672" path="/var/lib/kubelet/pods/dbe4ab1e-9580-4bda-b643-e9d8eca07672/volumes" Jun 12 22:58:25.584468 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.584433 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh"] Jun 12 22:58:25.585002 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.584984 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe4ab1e-9580-4bda-b643-e9d8eca07672" containerName="istio-proxy" Jun 12 22:58:25.585066 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.585003 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe4ab1e-9580-4bda-b643-e9d8eca07672" containerName="istio-proxy" Jun 12 22:58:25.585139 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.585105 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe4ab1e-9580-4bda-b643-e9d8eca07672" containerName="istio-proxy" Jun 12 22:58:25.589543 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.589521 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.593425 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.593403 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-43839776-openshift-default-dockercfg-4r44m\"" Jun 12 22:58:25.608872 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.608836 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh"] Jun 12 22:58:25.635167 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-certs\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.635339 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-envoy\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.635339 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-data\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.635339 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-credential-socket\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.635339 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl2zb\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-kube-api-access-cl2zb\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.635339 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635286 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-socket\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.635339 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istiod-ca-cert\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.635339 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-token\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.635579 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.635423 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-podinfo\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.736484 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736438 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istiod-ca-cert\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.736684 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-token\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.736684 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-podinfo\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.736808 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-certs\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.736808 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-envoy\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.736808 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-data\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.736808 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-credential-socket\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.737007 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl2zb\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-kube-api-access-cl2zb\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.737007 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.736861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-socket\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.737282 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.737257 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-certs\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.737379 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.737254 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-data\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.737436 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.737418 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-socket\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.737519 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.737496 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-credential-socket\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.737816 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.737765 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istiod-ca-cert\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.739306 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.739282 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-envoy\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.739376 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.739324 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-podinfo\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.754331 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.754299 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-token\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.757295 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.757265 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl2zb\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-kube-api-access-cl2zb\") pod \"e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:25.906984 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:25.906933 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:26.066168 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:26.065629 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh"] Jun 12 22:58:26.068885 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:26.068849 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:58:26.068995 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:26.068921 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:58:26.068995 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:26.068951 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 12 22:58:26.967340 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:26.967303 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" event={"ID":"3ad70ad9-1ce6-42d6-8070-dd663da9e818","Type":"ContainerStarted","Data":"271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6"} Jun 12 22:58:26.967742 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:26.967359 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" event={"ID":"3ad70ad9-1ce6-42d6-8070-dd663da9e818","Type":"ContainerStarted","Data":"103a30eac22d8e634eb42ed0eb761bda290605396558e843e8a3c06f7b10b3f1"} Jun 12 22:58:26.989935 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:26.989879 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" podStartSLOduration=1.98986126 podStartE2EDuration="1.98986126s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:58:26.986575189 +0000 UTC m=+2266.025039509" watchObservedRunningTime="2026-06-12 22:58:26.98986126 +0000 UTC m=+2266.028325580" Jun 12 22:58:27.907782 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:27.907741 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:27.912261 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:27.912236 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:27.972928 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:27.972899 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:27.974059 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:27.974037 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:33.462346 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:33.462295 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh"] Jun 12 22:58:33.462869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:33.462505 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" podUID="3ad70ad9-1ce6-42d6-8070-dd663da9e818" containerName="istio-proxy" containerID="cri-o://271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6" gracePeriod=30 Jun 12 22:58:38.718547 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.718513 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:38.760294 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760201 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-credential-socket\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760294 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760261 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl2zb\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-kube-api-access-cl2zb\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760314 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istiod-ca-cert\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760345 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-data\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760364 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-certs\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760410 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-socket\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760454 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-envoy\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760477 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-podinfo\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760535 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760505 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-token\") pod \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\" (UID: \"3ad70ad9-1ce6-42d6-8070-dd663da9e818\") " Jun 12 22:58:38.760965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760530 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:38.760965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760687 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:38.760965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760872 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-credential-socket\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:38.760965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760869 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:38.760965 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760892 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-data\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:38.761257 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.760976 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:38.761257 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.761197 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 22:58:38.763402 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.763372 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:58:38.763655 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.763630 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-kube-api-access-cl2zb" (OuterVolumeSpecName: "kube-api-access-cl2zb") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "kube-api-access-cl2zb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 22:58:38.763773 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.763675 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 22:58:38.763773 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.763693 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ad70ad9-1ce6-42d6-8070-dd663da9e818" (UID: "3ad70ad9-1ce6-42d6-8070-dd663da9e818"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 12 22:58:38.861915 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.861886 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-envoy\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:38.861915 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.861911 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-podinfo\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:38.861915 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.861920 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istio-token\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:38.862170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.861929 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl2zb\" (UniqueName: \"kubernetes.io/projected/3ad70ad9-1ce6-42d6-8070-dd663da9e818-kube-api-access-cl2zb\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:38.862170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.861939 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ad70ad9-1ce6-42d6-8070-dd663da9e818-istiod-ca-cert\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:38.862170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.861947 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-certs\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:38.862170 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:38.861955 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ad70ad9-1ce6-42d6-8070-dd663da9e818-workload-socket\") on node \"ip-10-0-128-221.ec2.internal\" DevicePath \"\"" Jun 12 22:58:39.042229 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.042138 2580 generic.go:356] "Generic (PLEG): container finished" podID="3ad70ad9-1ce6-42d6-8070-dd663da9e818" containerID="271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6" exitCode=0 Jun 12 22:58:39.042229 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.042190 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" Jun 12 22:58:39.042229 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.042218 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" event={"ID":"3ad70ad9-1ce6-42d6-8070-dd663da9e818","Type":"ContainerDied","Data":"271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6"} Jun 12 22:58:39.042463 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.042276 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh" event={"ID":"3ad70ad9-1ce6-42d6-8070-dd663da9e818","Type":"ContainerDied","Data":"103a30eac22d8e634eb42ed0eb761bda290605396558e843e8a3c06f7b10b3f1"} Jun 12 22:58:39.042463 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.042298 2580 scope.go:117] "RemoveContainer" containerID="271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6" Jun 12 22:58:39.052557 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.052534 2580 scope.go:117] "RemoveContainer" containerID="271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6" Jun 12 22:58:39.052909 ip-10-0-128-221 kubenswrapper[2580]: E0612 22:58:39.052890 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6\": container with ID starting with 271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6 not found: ID does not exist" containerID="271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6" Jun 12 22:58:39.052954 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.052920 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6"} err="failed to get container status \"271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6\": rpc error: code = NotFound desc = could not find container \"271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6\": container with ID starting with 271c9d69fb81365d847698537ff978ea3d104a307b1018f07ceb7fe5b96236f6 not found: ID does not exist" Jun 12 22:58:39.063741 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.063714 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh"] Jun 12 22:58:39.069707 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.069684 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-43839776-openshift-default-78d89f5fb4-bz9fh"] Jun 12 22:58:39.422110 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:39.421988 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad70ad9-1ce6-42d6-8070-dd663da9e818" path="/var/lib/kubelet/pods/3ad70ad9-1ce6-42d6-8070-dd663da9e818/volumes" Jun 12 22:58:51.360869 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:51.360838 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-864595bf9c-cfhvg_050ea97e-3812-4d8d-a307-139da59c4ff2/nginx/0.log" Jun 12 22:58:51.474264 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:51.474231 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-s8d78_bcc73f57-9c8e-44d9-b38d-910c9f6719d9/manager/0.log" Jun 12 22:58:51.592575 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:51.592544 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lthnj_3364edc5-336f-47b5-b587-9e5fa593a1fb/manager/0.log" Jun 12 22:58:51.822139 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:51.822106 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688405-qwn77_98bbd20f-b512-4cf0-b87a-506933c69c94/cleanup/0.log" Jun 12 22:58:52.060153 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:52.060121 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-xs9sv_d7aec0f4-37d4-49e4-960a-506950bcfc21/server/0.log" Jun 12 22:58:52.173690 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:52.173603 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9zwgl_8b00ac87-a6ec-42ce-923c-ec711217926e/manager/0.log" Jun 12 22:58:52.404415 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:52.404382 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cd748fbc-8654m_e93d2a79-201f-4c26-9fdc-88dc69cf3a2a/copy-manifests/0.log" Jun 12 22:58:52.416997 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:52.416965 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cd748fbc-8654m_e93d2a79-201f-4c26-9fdc-88dc69cf3a2a/manager/0.log" Jun 12 22:58:53.400528 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.400496 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7_13304b68-e9ad-4ab5-aa8f-6b819dfc9d33/util/0.log" Jun 12 22:58:53.407497 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.407474 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7_13304b68-e9ad-4ab5-aa8f-6b819dfc9d33/pull/0.log" Jun 12 22:58:53.413703 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.413684 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7_13304b68-e9ad-4ab5-aa8f-6b819dfc9d33/extract/0.log" Jun 12 22:58:53.522744 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.522712 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt_452d2f4f-79e6-47ac-bf95-611e70b29c19/util/0.log" Jun 12 22:58:53.528373 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.528350 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt_452d2f4f-79e6-47ac-bf95-611e70b29c19/pull/0.log" Jun 12 22:58:53.533686 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.533665 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt_452d2f4f-79e6-47ac-bf95-611e70b29c19/extract/0.log" Jun 12 22:58:53.640897 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.640874 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w_5df628f8-a665-43da-bc45-2b6d398ee1b0/util/0.log" Jun 12 22:58:53.646591 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.646563 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w_5df628f8-a665-43da-bc45-2b6d398ee1b0/pull/0.log" Jun 12 22:58:53.652015 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.651959 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w_5df628f8-a665-43da-bc45-2b6d398ee1b0/extract/0.log" Jun 12 22:58:53.759244 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.759216 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n_5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b/util/0.log" Jun 12 22:58:53.764870 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.764852 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n_5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b/pull/0.log" Jun 12 22:58:53.770565 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:53.770540 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n_5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b/extract/0.log" Jun 12 22:58:54.017930 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:54.017904 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ckb8p_b54e4979-01e5-401b-bc91-e9b88d43d0f2/manager/0.log" Jun 12 22:58:54.127230 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:54.127203 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gpdgk_3ac4db84-2960-4679-b2b8-65f4b91109a4/manager/0.log" Jun 12 22:58:54.608408 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:54.608378 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h4qpl_598d31b5-1e55-4484-bd73-3a88a351c14e/limitador/0.log" Jun 12 22:58:55.084752 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:55.084724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcrpc8k_d33550ce-aca2-4af8-ba7e-57776734de12/istio-proxy/0.log" Jun 12 22:58:55.205239 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:55.205209 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4bmsg_325898a0-c9e9-4cf3-bf56-eecd690d32f8/discovery/0.log" Jun 12 22:58:55.317359 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:55.317328 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-842t8_1ee720b1-a1f9-4187-b370-1af79e5b3fbf/kube-auth-proxy/0.log" Jun 12 22:58:55.547653 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:55.547621 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/1.log" Jun 12 22:58:55.662012 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:58:55.661980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gp4gs_fecd1ea6-9473-47af-a496-2b8c839691ca/payload-pre-processing/0.log" Jun 12 22:59:01.033986 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.033943 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9xsf/must-gather-tc42n"] Jun 12 22:59:01.034583 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.034514 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad70ad9-1ce6-42d6-8070-dd663da9e818" containerName="istio-proxy" Jun 12 22:59:01.034583 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.034535 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad70ad9-1ce6-42d6-8070-dd663da9e818" containerName="istio-proxy" Jun 12 22:59:01.034720 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.034649 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad70ad9-1ce6-42d6-8070-dd663da9e818" containerName="istio-proxy" Jun 12 22:59:01.038030 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.038005 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xsf/must-gather-tc42n" Jun 12 22:59:01.040800 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.040778 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xsf\"/\"kube-root-ca.crt\"" Jun 12 22:59:01.040800 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.040796 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xsf\"/\"openshift-service-ca.crt\"" Jun 12 22:59:01.041704 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.041682 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w9xsf\"/\"default-dockercfg-b7wfq\"" Jun 12 22:59:01.046642 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.046214 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xsf/must-gather-tc42n"] Jun 12 22:59:01.161610 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.161578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/36bce9e8-3f0c-4a6b-b94b-bda174175384-must-gather-output\") pod \"must-gather-tc42n\" (UID: \"36bce9e8-3f0c-4a6b-b94b-bda174175384\") " pod="openshift-must-gather-w9xsf/must-gather-tc42n" Jun 12 22:59:01.161805 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.161630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntlvk\" (UniqueName: \"kubernetes.io/projected/36bce9e8-3f0c-4a6b-b94b-bda174175384-kube-api-access-ntlvk\") pod \"must-gather-tc42n\" (UID: \"36bce9e8-3f0c-4a6b-b94b-bda174175384\") " pod="openshift-must-gather-w9xsf/must-gather-tc42n" Jun 12 22:59:01.262586 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.262546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/36bce9e8-3f0c-4a6b-b94b-bda174175384-must-gather-output\") pod \"must-gather-tc42n\" (UID: \"36bce9e8-3f0c-4a6b-b94b-bda174175384\") " pod="openshift-must-gather-w9xsf/must-gather-tc42n" Jun 12 22:59:01.262766 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.262604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntlvk\" (UniqueName: \"kubernetes.io/projected/36bce9e8-3f0c-4a6b-b94b-bda174175384-kube-api-access-ntlvk\") pod \"must-gather-tc42n\" (UID: \"36bce9e8-3f0c-4a6b-b94b-bda174175384\") " pod="openshift-must-gather-w9xsf/must-gather-tc42n" Jun 12 22:59:01.262917 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.262886 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/36bce9e8-3f0c-4a6b-b94b-bda174175384-must-gather-output\") pod \"must-gather-tc42n\" (UID: \"36bce9e8-3f0c-4a6b-b94b-bda174175384\") " pod="openshift-must-gather-w9xsf/must-gather-tc42n" Jun 12 22:59:01.271388 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.271349 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntlvk\" (UniqueName: \"kubernetes.io/projected/36bce9e8-3f0c-4a6b-b94b-bda174175384-kube-api-access-ntlvk\") pod \"must-gather-tc42n\" (UID: \"36bce9e8-3f0c-4a6b-b94b-bda174175384\") " pod="openshift-must-gather-w9xsf/must-gather-tc42n" Jun 12 22:59:01.349817 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.349716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xsf/must-gather-tc42n" Jun 12 22:59:01.504169 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.504142 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xsf/must-gather-tc42n"] Jun 12 22:59:01.505751 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:59:01.505723 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36bce9e8_3f0c_4a6b_b94b_bda174175384.slice/crio-2b244d9422e9a732c21d6125eb3abb4836a85fd9c86b38e7127b1e879307fefa WatchSource:0}: Error finding container 2b244d9422e9a732c21d6125eb3abb4836a85fd9c86b38e7127b1e879307fefa: Status 404 returned error can't find the container with id 2b244d9422e9a732c21d6125eb3abb4836a85fd9c86b38e7127b1e879307fefa Jun 12 22:59:01.507937 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:01.507915 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 22:59:02.173849 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:02.173806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xsf/must-gather-tc42n" event={"ID":"36bce9e8-3f0c-4a6b-b94b-bda174175384","Type":"ContainerStarted","Data":"2b244d9422e9a732c21d6125eb3abb4836a85fd9c86b38e7127b1e879307fefa"} Jun 12 22:59:03.183640 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:03.183598 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xsf/must-gather-tc42n" event={"ID":"36bce9e8-3f0c-4a6b-b94b-bda174175384","Type":"ContainerStarted","Data":"896192d8fc5d3b6172be41cc48d6aa77036b879ccd31d950cf9e3c75225b1e41"} Jun 12 22:59:03.184162 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:03.183653 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xsf/must-gather-tc42n" event={"ID":"36bce9e8-3f0c-4a6b-b94b-bda174175384","Type":"ContainerStarted","Data":"a277e49b34f3077f9077cecba90e2999ceac2d167691f0116d7ea12d68f162ee"} Jun 12 22:59:03.233245 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:03.233179 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9xsf/must-gather-tc42n" podStartSLOduration=1.432831863 podStartE2EDuration="2.233159152s" totalImagesPullingTime="800.327289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 22:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:59:03.220203437 +0000 UTC m=+2302.258667759" watchObservedRunningTime="2026-06-12 22:59:03.233159152 +0000 UTC m=+2302.271623476" Jun 12 22:59:04.094270 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:04.094243 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-76jj7_3d1d3c0a-52a9-41fc-9da6-709a48ff47af/global-pull-secret-syncer/0.log" Jun 12 22:59:04.243768 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:04.243742 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g6xfl_44992e20-2fba-4d83-9580-9cb92530c93e/konnectivity-agent/0.log" Jun 12 22:59:04.314209 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:04.314172 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-221.ec2.internal_5598ad4d5a1007a22c59d161c2879d66/haproxy/0.log" Jun 12 22:59:08.565169 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:08.565133 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-hnks4_4530ccf9-1e19-4cc4-8ddc-872151825f27/sail-operator/0.log" Jun 12 22:59:08.945194 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:08.945054 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7_13304b68-e9ad-4ab5-aa8f-6b819dfc9d33/extract/0.log" Jun 12 22:59:08.964669 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:08.964625 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7_13304b68-e9ad-4ab5-aa8f-6b819dfc9d33/util/0.log" Jun 12 22:59:08.984530 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:08.984495 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r2vt7_13304b68-e9ad-4ab5-aa8f-6b819dfc9d33/pull/0.log" Jun 12 22:59:09.009145 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.009078 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt_452d2f4f-79e6-47ac-bf95-611e70b29c19/extract/0.log" Jun 12 22:59:09.028929 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.028903 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt_452d2f4f-79e6-47ac-bf95-611e70b29c19/util/0.log" Jun 12 22:59:09.045852 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.045820 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0csmqt_452d2f4f-79e6-47ac-bf95-611e70b29c19/pull/0.log" Jun 12 22:59:09.069100 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.069056 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w_5df628f8-a665-43da-bc45-2b6d398ee1b0/extract/0.log" Jun 12 22:59:09.085580 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.085555 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w_5df628f8-a665-43da-bc45-2b6d398ee1b0/util/0.log" Jun 12 22:59:09.103161 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.103137 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73js98w_5df628f8-a665-43da-bc45-2b6d398ee1b0/pull/0.log" Jun 12 22:59:09.149854 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.149828 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n_5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b/extract/0.log" Jun 12 22:59:09.162762 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.162736 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n_5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b/util/0.log" Jun 12 22:59:09.178480 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.178445 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dh98n_5d88b7fd-ca43-4e2a-9d1b-ac48d680c15b/pull/0.log" Jun 12 22:59:09.427298 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.427269 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ckb8p_b54e4979-01e5-401b-bc91-e9b88d43d0f2/manager/0.log" Jun 12 22:59:09.465002 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.464965 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-gpdgk_3ac4db84-2960-4679-b2b8-65f4b91109a4/manager/0.log" Jun 12 22:59:09.652390 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:09.652354 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h4qpl_598d31b5-1e55-4484-bd73-3a88a351c14e/limitador/0.log" Jun 12 22:59:11.470693 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.470628 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c8bmn_6b055e93-1964-49a9-bb45-82d25e776e01/kube-state-metrics/0.log" Jun 12 22:59:11.483594 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.483562 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c8bmn_6b055e93-1964-49a9-bb45-82d25e776e01/kube-rbac-proxy-main/0.log" Jun 12 22:59:11.499923 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.499889 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-c8bmn_6b055e93-1964-49a9-bb45-82d25e776e01/kube-rbac-proxy-self/0.log" Jun 12 22:59:11.528698 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.528666 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85bfc4b48d-44n9d_06f8aa8d-fd81-4481-8b93-3fa8f89c2978/metrics-server/0.log" Jun 12 22:59:11.548207 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.548174 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-mr7c7_8e45c7e7-e051-451d-8381-a6208c4d9073/monitoring-plugin/0.log" Jun 12 22:59:11.721776 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.721688 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcbk9_a78cf6e6-3d17-405f-9e2f-b8210298f0b3/node-exporter/0.log" Jun 12 22:59:11.740613 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.740577 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcbk9_a78cf6e6-3d17-405f-9e2f-b8210298f0b3/kube-rbac-proxy/0.log" Jun 12 22:59:11.760397 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.760366 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcbk9_a78cf6e6-3d17-405f-9e2f-b8210298f0b3/init-textfile/0.log" Jun 12 22:59:11.794472 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.794440 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-hltp6_3932190b-bca5-4b16-b571-4df885f7e47c/kube-rbac-proxy-main/0.log" Jun 12 22:59:11.816380 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.816346 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-hltp6_3932190b-bca5-4b16-b571-4df885f7e47c/kube-rbac-proxy-self/0.log" Jun 12 22:59:11.837199 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:11.837166 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-hltp6_3932190b-bca5-4b16-b571-4df885f7e47c/openshift-state-metrics/0.log" Jun 12 22:59:14.861413 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:14.861381 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b8c79d5c9-rnkz7_17fd8981-b6bd-43f6-af5c-6698c7345ba8/console/0.log" Jun 12 22:59:16.303674 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.303639 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs"] Jun 12 22:59:16.312430 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.312401 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.322794 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.321811 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs"] Jun 12 22:59:16.439040 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.439006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-podres\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.439345 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.439319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-lib-modules\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.439542 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.439524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lskt6\" (UniqueName: \"kubernetes.io/projected/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-kube-api-access-lskt6\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.439701 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.439685 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-proc\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.439859 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.439844 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-sys\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.540639 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.540595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-sys\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.540939 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.540734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-sys\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.541137 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.540966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-podres\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.541319 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.541299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-lib-modules\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.541641 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.541132 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-podres\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.541749 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.541531 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-lib-modules\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.541749 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.541614 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lskt6\" (UniqueName: \"kubernetes.io/projected/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-kube-api-access-lskt6\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.541749 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.541709 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-proc\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.541918 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.541818 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-proc\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.550726 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.550697 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lskt6\" (UniqueName: \"kubernetes.io/projected/5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d-kube-api-access-lskt6\") pod \"perf-node-gather-daemonset-lfzcs\" (UID: \"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d\") " pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.628882 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.628796 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:16.801326 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.800532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9s2kj_426010f2-435c-4186-ae22-7e4db75fa599/dns/0.log" Jun 12 22:59:16.819972 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.819943 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9s2kj_426010f2-435c-4186-ae22-7e4db75fa599/kube-rbac-proxy/0.log" Jun 12 22:59:16.823419 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.823379 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs"] Jun 12 22:59:16.823945 ip-10-0-128-221 kubenswrapper[2580]: W0612 22:59:16.823918 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c06ea6b_9b2a_4fc9_92a7_51ebb6dbc37d.slice/crio-21a41d77cd94b99361ac11e9bb6b77667496b9236bb45cef25e981a2f2599d34 WatchSource:0}: Error finding container 21a41d77cd94b99361ac11e9bb6b77667496b9236bb45cef25e981a2f2599d34: Status 404 returned error can't find the container with id 21a41d77cd94b99361ac11e9bb6b77667496b9236bb45cef25e981a2f2599d34 Jun 12 22:59:16.926309 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:16.924528 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7t2mm_24ae138a-81a1-4c68-ad2b-2f0af46a67fa/dns-node-resolver/0.log" Jun 12 22:59:17.315578 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:17.315524 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" event={"ID":"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d","Type":"ContainerStarted","Data":"cb07c84718c5af17557827afaa62ea519be79217bbdcece39ef1ab3cd4be5a30"} Jun 12 22:59:17.316061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:17.315598 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" event={"ID":"5c06ea6b-9b2a-4fc9-92a7-51ebb6dbc37d","Type":"ContainerStarted","Data":"21a41d77cd94b99361ac11e9bb6b77667496b9236bb45cef25e981a2f2599d34"} Jun 12 22:59:17.316061 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:17.315650 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:17.477520 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:17.477487 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69dd584db6-jtlnk_b71ed0b8-3c40-46dd-9684-eb9ee86c1d6b/registry/0.log" Jun 12 22:59:17.534932 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:17.534885 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrk8m_8f546eac-f83b-4fbe-972b-f4244b271180/node-ca/0.log" Jun 12 22:59:18.409321 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:18.409278 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcrpc8k_d33550ce-aca2-4af8-ba7e-57776734de12/istio-proxy/0.log" Jun 12 22:59:18.481156 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:18.481119 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4bmsg_325898a0-c9e9-4cf3-bf56-eecd690d32f8/discovery/0.log" Jun 12 22:59:18.500919 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:18.500890 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-842t8_1ee720b1-a1f9-4187-b370-1af79e5b3fbf/kube-auth-proxy/0.log" Jun 12 22:59:18.546131 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:18.543378 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/0.log" Jun 12 22:59:18.592228 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:18.592187 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/1.log" Jun 12 22:59:18.618672 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:18.618643 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gp4gs_fecd1ea6-9473-47af-a496-2b8c839691ca/payload-pre-processing/0.log" Jun 12 22:59:19.332369 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:19.332343 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njmqj_3da5abd4-9d9b-4288-92bb-4eb5b926d4bd/serve-healthcheck-canary/0.log" Jun 12 22:59:19.909249 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:19.909214 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdgcd_65e675ef-08b7-4f6b-9fe1-b08637096d7a/kube-rbac-proxy/0.log" Jun 12 22:59:19.924693 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:19.924661 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdgcd_65e675ef-08b7-4f6b-9fe1-b08637096d7a/exporter/0.log" Jun 12 22:59:19.940211 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:19.940174 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pdgcd_65e675ef-08b7-4f6b-9fe1-b08637096d7a/extractor/0.log" Jun 12 22:59:22.151134 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:22.151106 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-864595bf9c-cfhvg_050ea97e-3812-4d8d-a307-139da59c4ff2/nginx/0.log" Jun 12 22:59:22.170358 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:22.170331 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-s8d78_bcc73f57-9c8e-44d9-b38d-910c9f6719d9/manager/0.log" Jun 12 22:59:22.264023 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:22.263984 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-lthnj_3364edc5-336f-47b5-b587-9e5fa593a1fb/manager/0.log" Jun 12 22:59:22.326727 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:22.326697 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688405-qwn77_98bbd20f-b512-4cf0-b87a-506933c69c94/cleanup/0.log" Jun 12 22:59:22.473357 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:22.473330 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-xs9sv_d7aec0f4-37d4-49e4-960a-506950bcfc21/server/0.log" Jun 12 22:59:22.522793 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:22.522747 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-9zwgl_8b00ac87-a6ec-42ce-923c-ec711217926e/manager/0.log" Jun 12 22:59:22.674983 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:22.674950 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cd748fbc-8654m_e93d2a79-201f-4c26-9fdc-88dc69cf3a2a/manager/0.log" Jun 12 22:59:22.688247 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:22.688215 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cd748fbc-8654m_e93d2a79-201f-4c26-9fdc-88dc69cf3a2a/copy-manifests/0.log" Jun 12 22:59:23.337035 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:23.337003 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" Jun 12 22:59:23.355383 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:23.355325 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9xsf/perf-node-gather-daemonset-lfzcs" podStartSLOduration=7.3553078450000005 podStartE2EDuration="7.355307845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 22:59:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 22:59:17.331263656 +0000 UTC m=+2316.369727982" watchObservedRunningTime="2026-06-12 22:59:23.355307845 +0000 UTC m=+2322.393772167" Jun 12 22:59:29.607985 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:29.607955 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcrpc8k_d33550ce-aca2-4af8-ba7e-57776734de12/istio-proxy/0.log" Jun 12 22:59:29.680466 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:29.680438 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4bmsg_325898a0-c9e9-4cf3-bf56-eecd690d32f8/discovery/0.log" Jun 12 22:59:29.688639 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:29.688615 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-842t8_1ee720b1-a1f9-4187-b370-1af79e5b3fbf/kube-auth-proxy/0.log" Jun 12 22:59:29.720392 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:29.720367 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/0.log" Jun 12 22:59:29.762510 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:29.762482 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/1.log" Jun 12 22:59:29.781590 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:29.781552 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gp4gs_fecd1ea6-9473-47af-a496-2b8c839691ca/payload-pre-processing/0.log" Jun 12 22:59:31.077341 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.077298 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcrpc8k_d33550ce-aca2-4af8-ba7e-57776734de12/istio-proxy/0.log" Jun 12 22:59:31.149103 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.149057 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4bmsg_325898a0-c9e9-4cf3-bf56-eecd690d32f8/discovery/0.log" Jun 12 22:59:31.158648 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.158625 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-842t8_1ee720b1-a1f9-4187-b370-1af79e5b3fbf/kube-auth-proxy/0.log" Jun 12 22:59:31.189312 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.189282 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2dpb9_664473fe-50b2-4925-8b62-0ff1dcd99c0e/kube-multus/0.log" Jun 12 22:59:31.191633 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.191611 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/0.log" Jun 12 22:59:31.232607 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.232561 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/1.log" Jun 12 22:59:31.251155 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.251125 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gp4gs_fecd1ea6-9473-47af-a496-2b8c839691ca/payload-pre-processing/0.log" Jun 12 22:59:31.355571 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.355498 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bw7dc_c0b96b2f-9632-46cd-9267-ea256d6f9f2c/kube-multus-additional-cni-plugins/0.log" Jun 12 22:59:31.373541 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.373510 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bw7dc_c0b96b2f-9632-46cd-9267-ea256d6f9f2c/egress-router-binary-copy/0.log" Jun 12 22:59:31.391604 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.391580 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bw7dc_c0b96b2f-9632-46cd-9267-ea256d6f9f2c/cni-plugins/0.log" Jun 12 22:59:31.408318 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.408294 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bw7dc_c0b96b2f-9632-46cd-9267-ea256d6f9f2c/bond-cni-plugin/0.log" Jun 12 22:59:31.432532 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.432501 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bw7dc_c0b96b2f-9632-46cd-9267-ea256d6f9f2c/routeoverride-cni/0.log" Jun 12 22:59:31.449508 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.449477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bw7dc_c0b96b2f-9632-46cd-9267-ea256d6f9f2c/whereabouts-cni-bincopy/0.log" Jun 12 22:59:31.465629 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.465604 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bw7dc_c0b96b2f-9632-46cd-9267-ea256d6f9f2c/whereabouts-cni/0.log" Jun 12 22:59:31.699729 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.699650 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh5x7_d274c226-9653-45b2-b20c-0eae6c5650da/network-metrics-daemon/0.log" Jun 12 22:59:31.713627 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:31.713584 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gh5x7_d274c226-9653-45b2-b20c-0eae6c5650da/kube-rbac-proxy/0.log" Jun 12 22:59:32.902174 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:32.902139 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcrpc8k_d33550ce-aca2-4af8-ba7e-57776734de12/istio-proxy/0.log" Jun 12 22:59:32.966969 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:32.966932 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-4bmsg_325898a0-c9e9-4cf3-bf56-eecd690d32f8/discovery/0.log" Jun 12 22:59:32.976095 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:32.976034 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b7dfdf5dc-842t8_1ee720b1-a1f9-4187-b370-1af79e5b3fbf/kube-auth-proxy/0.log" Jun 12 22:59:33.004631 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.004602 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/0.log" Jun 12 22:59:33.028574 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.028529 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-controller/0.log" Jun 12 22:59:33.043620 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.043546 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/0.log" Jun 12 22:59:33.043620 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.043613 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovn-acl-logging/1.log" Jun 12 22:59:33.051372 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.051349 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-95wdx_5adca4b6-c15a-4122-9c02-7732ccc02dd8/istio-proxy/1.log" Jun 12 22:59:33.059358 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.059335 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/kube-rbac-proxy-node/0.log" Jun 12 22:59:33.070036 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.070013 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-gp4gs_fecd1ea6-9473-47af-a496-2b8c839691ca/payload-pre-processing/0.log" Jun 12 22:59:33.075049 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.075021 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/kube-rbac-proxy-ovn-metrics/0.log" Jun 12 22:59:33.090817 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.090798 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/northd/0.log" Jun 12 22:59:33.109120 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.109057 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/nbdb/0.log" Jun 12 22:59:33.126046 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.126009 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/sbdb/0.log" Jun 12 22:59:33.175230 ip-10-0-128-221 kubenswrapper[2580]: I0612 22:59:33.175145 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lz2xp_57f9117b-34be-450d-844f-25131262e963/ovnkube-controller/0.log"